Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 920468 Details for
Bug 1119664
Extending thin provisioning disks should not rely on racy isLocked()
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
vdsm.log
vdsm.log (text/x-log), 6.73 MB, created by
Gal Amado
on 2014-07-24 09:01:43 UTC
(
hide
)
Description:
vdsm.log
Filename:
MIME Type:
Creator:
Gal Amado
Created:
2014-07-24 09:01:43 UTC
Size:
6.73 MB
patch
obsolete
>MainThread::INFO::2014-07-24 07:49:07,823::vdsm::129::vds::(run) (PID: 9916) I am the actual vdsm 4.14.11-1.el6ev master-vds13.qa.lab.tlv.redhat.com (2.6.32-431.el6.x86_64) >MainThread::DEBUG::2014-07-24 07:49:07,828::resourceManager::421::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2014-07-24 07:49:07,828::threadPool::35::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::DEBUG::2014-07-24 07:49:08,977::multipath::150::Storage.Multipath::(isEnabled) multipath Defaulting to False >MainThread::DEBUG::2014-07-24 07:49:08,978::multipath::168::Storage.Misc.excCmd::(setupMultipath) '/usr/bin/sudo -n /bin/cp /tmp/tmpaVQq4_ /etc/multipath.conf' (cwd None) >MainThread::DEBUG::2014-07-24 07:49:08,997::multipath::168::Storage.Misc.excCmd::(setupMultipath) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2014-07-24 07:49:08,999::multipath::174::Storage.Misc.excCmd::(setupMultipath) '/usr/bin/sudo -n /sbin/multipath -F' (cwd None) >MainThread::DEBUG::2014-07-24 07:49:09,022::multipath::174::Storage.Misc.excCmd::(setupMultipath) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2014-07-24 07:49:09,023::multipath::177::Storage.Misc.excCmd::(setupMultipath) '/usr/bin/sudo -n /usr/bin/vdsm-tool service-reload multipathd' (cwd None) >MainThread::DEBUG::2014-07-24 07:49:09,182::multipath::177::Storage.Misc.excCmd::(setupMultipath) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2014-07-24 07:49:09,182::hsm::434::Storage.Misc.excCmd::(__validateLvmLockingType) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2014-07-24 07:49:09,345::hsm::434::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2014-07-24 07:49:09,346::hsm::458::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2014-07-24 07:49:09,349::hsm::490::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2014-07-24 07:49:09,349::hsm::491::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2014-07-24 07:49:09,349::hsm::493::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2014-07-24 07:49:09,351::hsm::536::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >storageRefresh::DEBUG::2014-07-24 07:49:09,361::misc::738::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >MainThread::INFO::2014-07-24 07:49:09,362::dispatcher::97::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >storageRefresh::DEBUG::2014-07-24 07:49:09,377::misc::740::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2014-07-24 07:49:09,386::misc::738::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >storageRefresh::DEBUG::2014-07-24 07:49:09,389::misc::740::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2014-07-24 07:49:09,390::iscsi::407::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >storageRefresh::DEBUG::2014-07-24 07:49:09,393::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >MainThread::DEBUG::2014-07-24 07:49:09,393::task::595::TaskManager.Task::(_updateState) Task=`3112e90a-d817-4fa6-bb22-f7970d92c6d6`::moving from state init -> state preparing >MainThread::INFO::2014-07-24 07:49:09,398::logUtils::44::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback(callbackFunc=<bound method clientIF.contEIOVms of <clientIF.clientIF instance at 0x1e77200>>) >MainThread::INFO::2014-07-24 07:49:09,399::logUtils::47::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback, Return response: None >MainThread::DEBUG::2014-07-24 07:49:09,399::task::1185::TaskManager.Task::(prepare) Task=`3112e90a-d817-4fa6-bb22-f7970d92c6d6`::finished: None >MainThread::DEBUG::2014-07-24 07:49:09,399::task::595::TaskManager.Task::(_updateState) Task=`3112e90a-d817-4fa6-bb22-f7970d92c6d6`::moving from state preparing -> state finished >MainThread::DEBUG::2014-07-24 07:49:09,399::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2014-07-24 07:49:09,399::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2014-07-24 07:49:09,399::task::990::TaskManager.Task::(_decref) Task=`3112e90a-d817-4fa6-bb22-f7970d92c6d6`::ref 0 aborting False >MainThread::INFO::2014-07-24 07:49:09,400::momIF::49::MOM::(__init__) Starting up MOM >MainThread::INFO::2014-07-24 07:49:09,406::vmChannels::191::vds::(settimeout) Setting channels' timeout to 30 seconds. >VM Channels Listener::INFO::2014-07-24 07:49:09,406::vmChannels::174::vds::(run) Starting VM channels listener thread. >clientIFinit::DEBUG::2014-07-24 07:49:09,415::libvirtconnection::145::root::(get) trying to connect libvirt >storageRefresh::DEBUG::2014-07-24 07:49:09,419::misc::748::SamplingMethod::(__call__) Returning last result >storageRefresh::DEBUG::2014-07-24 07:49:09,419::multipath::109::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >storageRefresh::DEBUG::2014-07-24 07:49:09,463::multipath::109::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-07-24 07:49:09,463::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-07-24 07:49:09,472::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-07-24 07:49:09,475::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-07-24 07:49:09,477::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-07-24 07:49:09,479::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-07-24 07:49:09,481::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-07-24 07:49:09,483::misc::748::SamplingMethod::(__call__) Returning last result >storageRefresh::DEBUG::2014-07-24 07:49:09,486::lvm::325::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2014-07-24 07:49:09,513::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >storageRefresh::DEBUG::2014-07-24 07:49:09,676::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-07-24 07:49:09,677::lvm::350::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2014-07-24 07:49:09,677::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2014-07-24 07:49:09,678::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >storageRefresh::DEBUG::2014-07-24 07:49:09,815::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2014-07-24 07:49:09,815::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2014-07-24 07:49:09,816::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >Thread-13::DEBUG::2014-07-24 07:49:09,893::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call ping with () {} flowID [4477652a] >Thread-13::DEBUG::2014-07-24 07:49:09,893::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >storageRefresh::DEBUG::2014-07-24 07:49:09,945::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2014-07-24 07:49:09,946::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2014-07-24 07:49:09,946::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >storageRefresh::DEBUG::2014-07-24 07:49:10,074::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2014-07-24 07:49:10,074::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2014-07-24 07:49:10,075::hsm::393::Storage.HSM::(storageRefresh) HSM is ready >Thread-13::DEBUG::2014-07-24 07:49:10,777::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call ping with () {} flowID [4477652a] >Thread-13::DEBUG::2014-07-24 07:49:10,777::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-13::DEBUG::2014-07-24 07:49:10,800::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call getCapabilities with () {} flowID [4477652a] >Thread-13::DEBUG::2014-07-24 07:49:10,863::utils::642::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-13::DEBUG::2014-07-24 07:49:10,870::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 07:49:10,903::BindingXMLRPC::1074::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:d2432ea2ceb0'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.el6.x86_64', 'buildtime': 1384114794.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1401730350L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1405619266L, 'version': '4.14.11'}, 'qemu-kvm': {'release': '2.415.el6_5.12', 'buildtime': 1404777941L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.9', 'buildtime': 1401355377L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.12', 'buildtime': 1404777941L, 'version': '0.12.1.2'}, 'mom': {'release': '2.el6', 'buildtime': 1403794344L, 'version': '0.4.1'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5649 @ 2.53GHz', 'hooks': {}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {}, 'bridges': {';vdsmdummy;': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '', 'ports': []}}, 'uuid': 'EDB5DCEA-C28B-11E0-A3A8-5CF3FC78EFF0', 'lastClientIface': 'eth0', 'nics': {'eth1': {'netmask': '', 'addr': '', 'hwaddr': '5c:f3:fc:78:ef:f2', 'cfg': {'UUID': '151f07ed-f286-4376-b894-70ac70ed0eab', 'NM_CONTROLLED': 'yes', 'HWADDR': '5C:F3:FC:78:EF:F2', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'speed': 0, 'mtu': '1500'}, 'eth0': {'netmask': '255.255.255.0', 'addr': '10.35.64.88', 'hwaddr': '5c:f3:fc:78:ef:f0', 'cfg': {'UUID': '49a619cf-0ffc-47d1-9361-c604c139808b', 'NM_CONTROLLED': 'yes', 'HWADDR': '5C:F3:FC:78:EF:F0', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth0', 'TYPE': 'Ethernet', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::5ef3:fcff:fe78:eff0/64'], 'speed': 1000, 'mtu': '1500'}}, 'software_revision': '1', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,ida,arat,epb,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:d2432ea2ceb0', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.14', 'memSize': '24017', 'cpuSpeed': '2660.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '12', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '24', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.5.0.1.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.163.76'}} >Thread-13::DEBUG::2014-07-24 07:49:11,292::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call setupNetworks with ({'rhevm': {'nic': 'eth0', 'bootproto': 'dhcp', 'STP': 'no', 'defaultRoute': True, 'bridged': 'true'}}, {}, {'connectivityCheck': 'true', 'connectivityTimeout': 120}) {} flowID [b8904b9] >Thread-13::DEBUG::2014-07-24 07:49:11,293::supervdsm::77::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >Thread-14::DEBUG::2014-07-24 07:49:11,317::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call ping with () {} flowID [b8904b9] >Thread-14::DEBUG::2014-07-24 07:49:11,318::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-14::DEBUG::2014-07-24 07:49:18,350::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call ping with () {} flowID [b8904b9] >Thread-14::DEBUG::2014-07-24 07:49:18,355::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-14::DEBUG::2014-07-24 07:49:18,384::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call ping with () {} flowID [b8904b9] >Thread-14::DEBUG::2014-07-24 07:49:18,384::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-14::DEBUG::2014-07-24 07:49:18,447::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call ping with () {} flowID [b8904b9] >Thread-14::DEBUG::2014-07-24 07:49:18,447::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-14::DEBUG::2014-07-24 07:49:19,012::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call ping with () {} flowID [b8904b9] >Thread-14::DEBUG::2014-07-24 07:49:19,012::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-13::DEBUG::2014-07-24 07:49:19,104::BindingXMLRPC::1074::vds::(wrapper) return setupNetworks with {'status': {'message': 'Done', 'code': 0}} >Thread-13::DEBUG::2014-07-24 07:49:19,539::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call getCapabilities with () {} flowID [b8904b9] >Thread-13::DEBUG::2014-07-24 07:49:19,543::utils::642::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-13::DEBUG::2014-07-24 07:49:19,551::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 07:49:19,583::BindingXMLRPC::1074::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:d2432ea2ceb0'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.el6.x86_64', 'buildtime': 1384114794.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1401730350L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1405619266L, 'version': '4.14.11'}, 'qemu-kvm': {'release': '2.415.el6_5.12', 'buildtime': 1404777941L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.9', 'buildtime': 1401355377L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.12', 'buildtime': 1404777941L, 'version': '0.12.1.2'}, 'mom': {'release': '2.el6', 'buildtime': 1403794344L, 'version': '0.4.1'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5649 @ 2.53GHz', 'hooks': {}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.64.88', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::5ef3:fcff:fe78:eff0/64'], 'gateway': '10.35.64.254', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {';vdsmdummy;': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '', 'ports': []}, 'rhevm': {'addr': '10.35.64.88', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::5ef3:fcff:fe78:eff0/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.35.64.254', 'ports': ['eth0']}}, 'uuid': 'EDB5DCEA-C28B-11E0-A3A8-5CF3FC78EFF0', 'lastClientIface': 'rhevm', 'nics': {'eth1': {'netmask': '', 'addr': '', 'hwaddr': '5c:f3:fc:78:ef:f2', 'cfg': {'UUID': '151f07ed-f286-4376-b894-70ac70ed0eab', 'NM_CONTROLLED': 'yes', 'HWADDR': '5C:F3:FC:78:EF:F2', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'speed': 0, 'mtu': '1500'}, 'eth0': {'netmask': '', 'addr': '', 'hwaddr': '5c:f3:fc:78:ef:f0', 'cfg': {'BRIDGE': 'rhevm', 'NM_CONTROLLED': 'no', 'HWADDR': '5c:f3:fc:78:ef:f0', 'STP': 'no', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::5ef3:fcff:fe78:eff0/64'], 'speed': 1000, 'mtu': '1500'}}, 'software_revision': '1', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,ida,arat,epb,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:d2432ea2ceb0', 'netConfigDirty': 'True', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.14', 'memSize': '24017', 'cpuSpeed': '2660.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '12', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '24', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.5.0.1.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.163.76'}} >Thread-13::DEBUG::2014-07-24 07:49:19,907::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call setSafeNetworkConfig with () {} flowID [2d389e7e] >Thread-13::DEBUG::2014-07-24 07:49:19,920::BindingXMLRPC::1074::vds::(wrapper) return setSafeNetworkConfig with {'status': {'message': 'Done', 'code': 0}} >Thread-13::DEBUG::2014-07-24 07:49:21,778::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call getCapabilities with () {} >Thread-13::DEBUG::2014-07-24 07:49:21,780::utils::642::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-13::DEBUG::2014-07-24 07:49:21,788::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 07:49:21,817::BindingXMLRPC::1074::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:d2432ea2ceb0'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.el6.x86_64', 'buildtime': 1384114794.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1401730350L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1405619266L, 'version': '4.14.11'}, 'qemu-kvm': {'release': '2.415.el6_5.12', 'buildtime': 1404777941L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.9', 'buildtime': 1401355377L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.12', 'buildtime': 1404777941L, 'version': '0.12.1.2'}, 'mom': {'release': '2.el6', 'buildtime': 1403794344L, 'version': '0.4.1'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5649 @ 2.53GHz', 'hooks': {}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.64.88', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::5ef3:fcff:fe78:eff0/64'], 'gateway': '10.35.64.254', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {';vdsmdummy;': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '', 'ports': []}, 'rhevm': {'addr': '10.35.64.88', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::5ef3:fcff:fe78:eff0/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.35.64.254', 'ports': ['eth0']}}, 'uuid': 'EDB5DCEA-C28B-11E0-A3A8-5CF3FC78EFF0', 'lastClientIface': 'rhevm', 'nics': {'eth1': {'netmask': '', 'addr': '', 'hwaddr': '5c:f3:fc:78:ef:f2', 'cfg': {'UUID': '151f07ed-f286-4376-b894-70ac70ed0eab', 'NM_CONTROLLED': 'yes', 'HWADDR': '5C:F3:FC:78:EF:F2', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'speed': 0, 'mtu': '1500'}, 'eth0': {'netmask': '', 'addr': '', 'hwaddr': '5c:f3:fc:78:ef:f0', 'cfg': {'BRIDGE': 'rhevm', 'NM_CONTROLLED': 'no', 'HWADDR': '5c:f3:fc:78:ef:f0', 'STP': 'no', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::5ef3:fcff:fe78:eff0/64'], 'speed': 1000, 'mtu': '1500'}}, 'software_revision': '1', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,ida,arat,epb,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:d2432ea2ceb0', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.14', 'memSize': '24017', 'cpuSpeed': '2660.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '12', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '24', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.5.0.1.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.163.76'}} >Thread-13::DEBUG::2014-07-24 07:49:21,969::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call getHardwareInfo with () {} >Thread-13::DEBUG::2014-07-24 07:49:22,041::BindingXMLRPC::1074::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'BladeCenter HS22 -[7870A7G]-', 'systemSerialNumber': '06EXY53', 'systemFamily': 'System x', 'systemVersion': '07', 'systemUUID': 'edb5dcea-c28b-11e0-a3a8-5cf3fc78eff0', 'systemManufacturer': 'IBM'}} >Thread-13::DEBUG::2014-07-24 07:49:22,309::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call getCapabilities with () {} flowID [778dade1] >Thread-13::DEBUG::2014-07-24 07:49:22,311::utils::642::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-13::DEBUG::2014-07-24 07:49:22,316::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 07:49:22,337::BindingXMLRPC::1074::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:d2432ea2ceb0'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.el6.x86_64', 'buildtime': 1384114794.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1401730350L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1405619266L, 'version': '4.14.11'}, 'qemu-kvm': {'release': '2.415.el6_5.12', 'buildtime': 1404777941L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.9', 'buildtime': 1401355377L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.12', 'buildtime': 1404777941L, 'version': '0.12.1.2'}, 'mom': {'release': '2.el6', 'buildtime': 1403794344L, 'version': '0.4.1'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5649 @ 2.53GHz', 'hooks': {}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.64.88', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::5ef3:fcff:fe78:eff0/64'], 'gateway': '10.35.64.254', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {';vdsmdummy;': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '', 'ports': []}, 'rhevm': {'addr': '10.35.64.88', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::5ef3:fcff:fe78:eff0/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.35.64.254', 'ports': ['eth0']}}, 'uuid': 'EDB5DCEA-C28B-11E0-A3A8-5CF3FC78EFF0', 'lastClientIface': 'rhevm', 'nics': {'eth1': {'netmask': '', 'addr': '', 'hwaddr': '5c:f3:fc:78:ef:f2', 'cfg': {'UUID': '151f07ed-f286-4376-b894-70ac70ed0eab', 'NM_CONTROLLED': 'yes', 'HWADDR': '5C:F3:FC:78:EF:F2', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'speed': 0, 'mtu': '1500'}, 'eth0': {'netmask': '', 'addr': '', 'hwaddr': '5c:f3:fc:78:ef:f0', 'cfg': {'BRIDGE': 'rhevm', 'NM_CONTROLLED': 'no', 'HWADDR': '5c:f3:fc:78:ef:f0', 'STP': 'no', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::5ef3:fcff:fe78:eff0/64'], 'speed': 1000, 'mtu': '1500'}}, 'software_revision': '1', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,ida,arat,epb,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:d2432ea2ceb0', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.14', 'memSize': '24017', 'cpuSpeed': '2660.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '12', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '24', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.5.0.1.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.163.76'}} >Thread-13::DEBUG::2014-07-24 07:49:22,480::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call getHardwareInfo with () {} flowID [778dade1] >Thread-13::DEBUG::2014-07-24 07:49:22,481::BindingXMLRPC::1074::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'BladeCenter HS22 -[7870A7G]-', 'systemSerialNumber': '06EXY53', 'systemFamily': 'System x', 'systemVersion': '07', 'systemUUID': 'edb5dcea-c28b-11e0-a3a8-5cf3fc78eff0', 'systemManufacturer': 'IBM'}} >Thread-13::DEBUG::2014-07-24 07:49:22,622::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call setMOMPolicyParameters with ({'balloonEnabled': False, 'ksmEnabled': True},) {} flowID [4f0a99c0] >Thread-13::DEBUG::2014-07-24 07:49:22,684::BindingXMLRPC::1074::vds::(wrapper) return setMOMPolicyParameters with {'status': {'message': 'Done', 'code': 0}} >Thread-13::DEBUG::2014-07-24 07:49:31,883::task::595::TaskManager.Task::(_updateState) Task=`d475a583-d602-495b-82ee-b790aec1a1c9`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 07:49:31,883::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 07:49:31,884::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 07:49:31,884::task::1185::TaskManager.Task::(prepare) Task=`d475a583-d602-495b-82ee-b790aec1a1c9`::finished: {} >Thread-13::DEBUG::2014-07-24 07:49:31,884::task::595::TaskManager.Task::(_updateState) Task=`d475a583-d602-495b-82ee-b790aec1a1c9`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 07:49:31,884::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 07:49:31,884::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 07:49:31,884::task::990::TaskManager.Task::(_decref) Task=`d475a583-d602-495b-82ee-b790aec1a1c9`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 07:49:47,288::task::595::TaskManager.Task::(_updateState) Task=`9655bf7b-cde3-4215-84da-5b828bef46d3`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 07:49:47,288::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 07:49:47,288::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 07:49:47,289::task::1185::TaskManager.Task::(prepare) Task=`9655bf7b-cde3-4215-84da-5b828bef46d3`::finished: {} >Thread-13::DEBUG::2014-07-24 07:49:47,289::task::595::TaskManager.Task::(_updateState) Task=`9655bf7b-cde3-4215-84da-5b828bef46d3`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 07:49:47,289::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 07:49:47,289::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 07:49:47,289::task::990::TaskManager.Task::(_decref) Task=`9655bf7b-cde3-4215-84da-5b828bef46d3`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 07:50:02,822::task::595::TaskManager.Task::(_updateState) Task=`13c5780e-b21a-424c-8723-51beb0b2db62`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 07:50:02,827::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 07:50:02,827::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 07:50:02,827::task::1185::TaskManager.Task::(prepare) Task=`13c5780e-b21a-424c-8723-51beb0b2db62`::finished: {} >Thread-13::DEBUG::2014-07-24 07:50:02,828::task::595::TaskManager.Task::(_updateState) Task=`13c5780e-b21a-424c-8723-51beb0b2db62`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 07:50:02,828::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 07:50:02,828::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 07:50:02,828::task::990::TaskManager.Task::(_decref) Task=`13c5780e-b21a-424c-8723-51beb0b2db62`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 07:50:18,150::task::595::TaskManager.Task::(_updateState) Task=`618049ba-b620-4643-bc0e-238a395f7bc4`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 07:50:18,151::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 07:50:18,151::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 07:50:18,151::task::1185::TaskManager.Task::(prepare) Task=`618049ba-b620-4643-bc0e-238a395f7bc4`::finished: {} >Thread-13::DEBUG::2014-07-24 07:50:18,151::task::595::TaskManager.Task::(_updateState) Task=`618049ba-b620-4643-bc0e-238a395f7bc4`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 07:50:18,151::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 07:50:18,151::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 07:50:18,152::task::990::TaskManager.Task::(_decref) Task=`618049ba-b620-4643-bc0e-238a395f7bc4`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 07:50:33,524::task::595::TaskManager.Task::(_updateState) Task=`d90daf1f-aa7d-46b7-86f9-9c6405ccb61f`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 07:50:33,524::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 07:50:33,524::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 07:50:33,525::task::1185::TaskManager.Task::(prepare) Task=`d90daf1f-aa7d-46b7-86f9-9c6405ccb61f`::finished: {} >Thread-13::DEBUG::2014-07-24 07:50:33,525::task::595::TaskManager.Task::(_updateState) Task=`d90daf1f-aa7d-46b7-86f9-9c6405ccb61f`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 07:50:33,525::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 07:50:33,525::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 07:50:33,525::task::990::TaskManager.Task::(_decref) Task=`d90daf1f-aa7d-46b7-86f9-9c6405ccb61f`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 07:50:48,844::task::595::TaskManager.Task::(_updateState) Task=`bbb7bb0b-e3cb-459c-8030-3c8de2e8c414`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 07:50:48,844::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 07:50:48,844::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 07:50:48,845::task::1185::TaskManager.Task::(prepare) Task=`bbb7bb0b-e3cb-459c-8030-3c8de2e8c414`::finished: {} >Thread-13::DEBUG::2014-07-24 07:50:48,845::task::595::TaskManager.Task::(_updateState) Task=`bbb7bb0b-e3cb-459c-8030-3c8de2e8c414`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 07:50:48,845::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 07:50:48,845::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 07:50:48,845::task::990::TaskManager.Task::(_decref) Task=`bbb7bb0b-e3cb-459c-8030-3c8de2e8c414`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 07:51:04,207::task::595::TaskManager.Task::(_updateState) Task=`87451b2f-5bab-4545-b6a6-c9003948ee27`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 07:51:04,207::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 07:51:04,207::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 07:51:04,207::task::1185::TaskManager.Task::(prepare) Task=`87451b2f-5bab-4545-b6a6-c9003948ee27`::finished: {} >Thread-13::DEBUG::2014-07-24 07:51:04,208::task::595::TaskManager.Task::(_updateState) Task=`87451b2f-5bab-4545-b6a6-c9003948ee27`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 07:51:04,208::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 07:51:04,208::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 07:51:04,208::task::990::TaskManager.Task::(_decref) Task=`87451b2f-5bab-4545-b6a6-c9003948ee27`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 07:51:19,532::task::595::TaskManager.Task::(_updateState) Task=`e0643110-4f62-4738-a66d-d40ca6569098`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 07:51:19,532::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 07:51:19,533::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 07:51:19,533::task::1185::TaskManager.Task::(prepare) Task=`e0643110-4f62-4738-a66d-d40ca6569098`::finished: {} >Thread-13::DEBUG::2014-07-24 07:51:19,533::task::595::TaskManager.Task::(_updateState) Task=`e0643110-4f62-4738-a66d-d40ca6569098`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 07:51:19,533::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 07:51:19,533::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 07:51:19,533::task::990::TaskManager.Task::(_decref) Task=`e0643110-4f62-4738-a66d-d40ca6569098`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 07:51:35,093::task::595::TaskManager.Task::(_updateState) Task=`b8efa470-a133-4b0d-a7e3-6fe55872ec7e`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 07:51:35,094::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 07:51:35,094::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 07:51:35,094::task::1185::TaskManager.Task::(prepare) Task=`b8efa470-a133-4b0d-a7e3-6fe55872ec7e`::finished: {} >Thread-13::DEBUG::2014-07-24 07:51:35,094::task::595::TaskManager.Task::(_updateState) Task=`b8efa470-a133-4b0d-a7e3-6fe55872ec7e`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 07:51:35,094::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 07:51:35,094::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 07:51:35,095::task::990::TaskManager.Task::(_decref) Task=`b8efa470-a133-4b0d-a7e3-6fe55872ec7e`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 07:51:44,392::task::595::TaskManager.Task::(_updateState) Task=`607dd0f5-1594-455d-8e0e-09306c99cb8d`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 07:51:44,393::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 07:51:44,393::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 07:51:44,393::task::1185::TaskManager.Task::(prepare) Task=`607dd0f5-1594-455d-8e0e-09306c99cb8d`::finished: {} >Thread-13::DEBUG::2014-07-24 07:51:44,393::task::595::TaskManager.Task::(_updateState) Task=`607dd0f5-1594-455d-8e0e-09306c99cb8d`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 07:51:44,393::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 07:51:44,393::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 07:51:44,393::task::990::TaskManager.Task::(_decref) Task=`607dd0f5-1594-455d-8e0e-09306c99cb8d`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 07:52:06,344::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call getCapabilities with () {} >Thread-15::DEBUG::2014-07-24 07:52:06,347::utils::642::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-15::DEBUG::2014-07-24 07:52:06,355::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-07-24 07:52:06,388::BindingXMLRPC::1074::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:d2432ea2ceb0'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.el6.x86_64', 'buildtime': 1384114794.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1401730350L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1405619266L, 'version': '4.14.11'}, 'qemu-kvm': {'release': '2.415.el6_5.12', 'buildtime': 1404777941L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.9', 'buildtime': 1401355377L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.12', 'buildtime': 1404777941L, 'version': '0.12.1.2'}, 'mom': {'release': '2.el6', 'buildtime': 1403794344L, 'version': '0.4.1'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5649 @ 2.53GHz', 'hooks': {}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.64.88', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::5ef3:fcff:fe78:eff0/64'], 'gateway': '10.35.64.254', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {';vdsmdummy;': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '', 'ports': []}, 'rhevm': {'addr': '10.35.64.88', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::5ef3:fcff:fe78:eff0/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.35.64.254', 'ports': ['eth0']}}, 'uuid': 'EDB5DCEA-C28B-11E0-A3A8-5CF3FC78EFF0', 'lastClientIface': 'rhevm', 'nics': {'eth1': {'netmask': '', 'addr': '', 'hwaddr': '5c:f3:fc:78:ef:f2', 'cfg': {'UUID': '151f07ed-f286-4376-b894-70ac70ed0eab', 'NM_CONTROLLED': 'yes', 'HWADDR': '5C:F3:FC:78:EF:F2', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'speed': 0, 'mtu': '1500'}, 'eth0': {'netmask': '', 'addr': '', 'hwaddr': '5c:f3:fc:78:ef:f0', 'cfg': {'BRIDGE': 'rhevm', 'NM_CONTROLLED': 'no', 'HWADDR': '5c:f3:fc:78:ef:f0', 'STP': 'no', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::5ef3:fcff:fe78:eff0/64'], 'speed': 1000, 'mtu': '1500'}}, 'software_revision': '1', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,ida,arat,epb,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:d2432ea2ceb0', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.14', 'memSize': '24017', 'cpuSpeed': '2660.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '12', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '24', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.5.0.1.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.163.76'}} >Thread-15::DEBUG::2014-07-24 07:52:06,578::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call getHardwareInfo with () {} >Thread-15::DEBUG::2014-07-24 07:52:06,595::BindingXMLRPC::1074::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'BladeCenter HS22 -[7870A7G]-', 'systemSerialNumber': '06EXY53', 'systemFamily': 'System x', 'systemVersion': '07', 'systemUUID': 'edb5dcea-c28b-11e0-a3a8-5cf3fc78eff0', 'systemManufacturer': 'IBM'}} >Thread-15::DEBUG::2014-07-24 07:52:06,730::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call getCapabilities with () {} flowID [3fc198b1] >Thread-15::DEBUG::2014-07-24 07:52:06,733::utils::642::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-15::DEBUG::2014-07-24 07:52:06,739::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-07-24 07:52:06,759::BindingXMLRPC::1074::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:d2432ea2ceb0'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.el6.x86_64', 'buildtime': 1384114794.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1401730350L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1405619266L, 'version': '4.14.11'}, 'qemu-kvm': {'release': '2.415.el6_5.12', 'buildtime': 1404777941L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.9', 'buildtime': 1401355377L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.12', 'buildtime': 1404777941L, 'version': '0.12.1.2'}, 'mom': {'release': '2.el6', 'buildtime': 1403794344L, 'version': '0.4.1'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5649 @ 2.53GHz', 'hooks': {}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.64.88', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::5ef3:fcff:fe78:eff0/64'], 'gateway': '10.35.64.254', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {';vdsmdummy;': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '', 'ports': []}, 'rhevm': {'addr': '10.35.64.88', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::5ef3:fcff:fe78:eff0/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.35.64.254', 'ports': ['eth0']}}, 'uuid': 'EDB5DCEA-C28B-11E0-A3A8-5CF3FC78EFF0', 'lastClientIface': 'rhevm', 'nics': {'eth1': {'netmask': '', 'addr': '', 'hwaddr': '5c:f3:fc:78:ef:f2', 'cfg': {'UUID': '151f07ed-f286-4376-b894-70ac70ed0eab', 'NM_CONTROLLED': 'yes', 'HWADDR': '5C:F3:FC:78:EF:F2', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'speed': 0, 'mtu': '1500'}, 'eth0': {'netmask': '', 'addr': '', 'hwaddr': '5c:f3:fc:78:ef:f0', 'cfg': {'BRIDGE': 'rhevm', 'NM_CONTROLLED': 'no', 'HWADDR': '5c:f3:fc:78:ef:f0', 'STP': 'no', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::5ef3:fcff:fe78:eff0/64'], 'speed': 1000, 'mtu': '1500'}}, 'software_revision': '1', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,ida,arat,epb,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:d2432ea2ceb0', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.14', 'memSize': '24017', 'cpuSpeed': '2660.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '12', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '24', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.5.0.1.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.163.76'}} >Thread-15::DEBUG::2014-07-24 07:52:07,009::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call getHardwareInfo with () {} flowID [3fc198b1] >Thread-15::DEBUG::2014-07-24 07:52:07,010::BindingXMLRPC::1074::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'BladeCenter HS22 -[7870A7G]-', 'systemSerialNumber': '06EXY53', 'systemFamily': 'System x', 'systemVersion': '07', 'systemUUID': 'edb5dcea-c28b-11e0-a3a8-5cf3fc78eff0', 'systemManufacturer': 'IBM'}} >Thread-15::DEBUG::2014-07-24 07:52:07,201::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call setMOMPolicyParameters with ({'balloonEnabled': False, 'ksmEnabled': False},) {} flowID [2fabcb7] >Thread-15::DEBUG::2014-07-24 07:52:07,257::BindingXMLRPC::1074::vds::(wrapper) return setMOMPolicyParameters with {'status': {'message': 'Done', 'code': 0}} >Thread-15::DEBUG::2014-07-24 07:52:19,631::task::595::TaskManager.Task::(_updateState) Task=`b0358397-8377-4d8b-9147-2c6e1577f710`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 07:52:19,631::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 07:52:19,631::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 07:52:19,631::task::1185::TaskManager.Task::(prepare) Task=`b0358397-8377-4d8b-9147-2c6e1577f710`::finished: {} >Thread-15::DEBUG::2014-07-24 07:52:19,632::task::595::TaskManager.Task::(_updateState) Task=`b0358397-8377-4d8b-9147-2c6e1577f710`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 07:52:19,632::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 07:52:19,632::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 07:52:19,632::task::990::TaskManager.Task::(_decref) Task=`b0358397-8377-4d8b-9147-2c6e1577f710`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 07:52:27,484::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-15::DEBUG::2014-07-24 07:52:27,485::task::595::TaskManager.Task::(_updateState) Task=`54bb9587-48c4-46eb-b819-97a31379e358`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 07:52:27,485::logUtils::44::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=3, options={}) >Thread-15::DEBUG::2014-07-24 07:52:27,486::misc::738::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-07-24 07:52:27,486::misc::740::SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-07-24 07:52:27,486::misc::738::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-07-24 07:52:27,486::misc::740::SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-07-24 07:52:27,486::iscsi::407::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-07-24 07:52:27,486::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-15::DEBUG::2014-07-24 07:52:27,516::misc::748::SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-07-24 07:52:27,517::multipath::109::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-15::DEBUG::2014-07-24 07:52:27,603::multipath::109::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-07-24 07:52:27,604::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-07-24 07:52:27,605::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-07-24 07:52:27,605::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-07-24 07:52:27,605::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-07-24 07:52:27,605::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-07-24 07:52:27,605::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-07-24 07:52:27,606::misc::748::SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-07-24 07:52:27,606::lvm::325::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-07-24 07:52:27,608::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-15::DEBUG::2014-07-24 07:52:27,793::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-07-24 07:52:27,794::lvm::350::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-07-24 07:52:27,824::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --test --metadatasize 128m --metadatacopies 2 --metadataignore y' (cwd None) >Thread-15::DEBUG::2014-07-24 07:52:27,965::lvm::296::Storage.Misc.excCmd::(cmd) FAILED: <err> = " TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.\n Please enter a physical volume path\n Run `pvcreate --help' for more information.\n"; <rc> = 3 >Thread-15::DEBUG::2014-07-24 07:52:27,965::lvm::860::Storage.LVM::(testPVCreate) rc: 3, out: [], err: [' TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.', ' Please enter a physical volume path', " Run `pvcreate --help' for more information."], unusedDevs: set([]), usedDevs: set([]) >Thread-15::INFO::2014-07-24 07:52:27,966::logUtils::47::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList': []} >Thread-15::DEBUG::2014-07-24 07:52:27,966::task::1185::TaskManager.Task::(prepare) Task=`54bb9587-48c4-46eb-b819-97a31379e358`::finished: {'devList': []} >Thread-15::DEBUG::2014-07-24 07:52:27,966::task::595::TaskManager.Task::(_updateState) Task=`54bb9587-48c4-46eb-b819-97a31379e358`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 07:52:27,966::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 07:52:27,967::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 07:52:27,967::task::990::TaskManager.Task::(_decref) Task=`54bb9587-48c4-46eb-b819-97a31379e358`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 07:52:35,024::task::595::TaskManager.Task::(_updateState) Task=`601b499e-ae70-4c6d-a7c9-287211531732`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 07:52:35,025::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 07:52:35,025::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 07:52:35,025::task::1185::TaskManager.Task::(prepare) Task=`601b499e-ae70-4c6d-a7c9-287211531732`::finished: {} >Thread-15::DEBUG::2014-07-24 07:52:35,025::task::595::TaskManager.Task::(_updateState) Task=`601b499e-ae70-4c6d-a7c9-287211531732`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 07:52:35,025::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 07:52:35,025::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 07:52:35,026::task::990::TaskManager.Task::(_decref) Task=`601b499e-ae70-4c6d-a7c9-287211531732`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 07:52:37,463::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-15::DEBUG::2014-07-24 07:52:37,463::task::595::TaskManager.Task::(_updateState) Task=`58986f8b-4970-44a4-8879-6faada680cf1`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 07:52:37,464::logUtils::44::dispatcher::(wrapper) Run and protect: discoverSendTargets(con={'connection': '10.35.160.104', 'password': '******', 'port': '3260', 'user': ''}, options=None) >Thread-15::DEBUG::2014-07-24 07:52:37,464::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.104:3260 --op=new' (cwd None) >Thread-15::DEBUG::2014-07-24 07:52:37,490::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-07-24 07:52:37,491::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.104:3260 --discover' (cwd None) >Thread-15::DEBUG::2014-07-24 07:52:37,509::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-07-24 07:52:37,509::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.104:3260 --op=delete' (cwd None) >Thread-15::DEBUG::2014-07-24 07:52:37,521::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::INFO::2014-07-24 07:52:37,521::logUtils::47::dispatcher::(wrapper) Run and protect: discoverSendTargets, Return response: {'fullTargets': ['10.35.160.104:3260,1 iqn.1992-04.com.emc:cx.ckm00121000438.a6', '10.35.160.105:3260,2 iqn.1992-04.com.emc:cx.ckm00121000438.a7', '10.35.160.106:3260,3 iqn.1992-04.com.emc:cx.ckm00121000438.b6', '10.35.160.107:3260,4 iqn.1992-04.com.emc:cx.ckm00121000438.b7'], 'targets': ['iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'iqn.1992-04.com.emc:cx.ckm00121000438.b7']} >Thread-15::DEBUG::2014-07-24 07:52:37,521::task::1185::TaskManager.Task::(prepare) Task=`58986f8b-4970-44a4-8879-6faada680cf1`::finished: {'fullTargets': ['10.35.160.104:3260,1 iqn.1992-04.com.emc:cx.ckm00121000438.a6', '10.35.160.105:3260,2 iqn.1992-04.com.emc:cx.ckm00121000438.a7', '10.35.160.106:3260,3 iqn.1992-04.com.emc:cx.ckm00121000438.b6', '10.35.160.107:3260,4 iqn.1992-04.com.emc:cx.ckm00121000438.b7'], 'targets': ['iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'iqn.1992-04.com.emc:cx.ckm00121000438.b7']} >Thread-15::DEBUG::2014-07-24 07:52:37,522::task::595::TaskManager.Task::(_updateState) Task=`58986f8b-4970-44a4-8879-6faada680cf1`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 07:52:37,522::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 07:52:37,522::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 07:52:37,522::task::990::TaskManager.Task::(_decref) Task=`58986f8b-4970-44a4-8879-6faada680cf1`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 07:52:39,154::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [372288dd] >Thread-15::DEBUG::2014-07-24 07:52:39,155::task::595::TaskManager.Task::(_updateState) Task=`56c00a63-6b43-451b-86e3-a58a48a4ef19`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 07:52:39,155::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'user': '', 'tpgt': '1', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-15::DEBUG::2014-07-24 07:52:39,155::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a6 -I default -p 10.35.160.104:3260,1 --op=new' (cwd None) >Thread-15::DEBUG::2014-07-24 07:52:39,176::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-07-24 07:52:39,177::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a6 -I default -p 10.35.160.104:3260,1 -l' (cwd None) >Thread-15::DEBUG::2014-07-24 07:52:39,732::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-07-24 07:52:39,733::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a6 -I default -p 10.35.160.104:3260,1 -n node.startup -v manual --op=update' (cwd None) >Thread-15::DEBUG::2014-07-24 07:52:39,748::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-07-24 07:52:39,749::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-07-24 07:52:39,750::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >Thread-15::DEBUG::2014-07-24 07:52:39,906::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-24 07:52:39,908::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-07-24 07:52:39,908::hsm::2352::Storage.HSM::(__prefetchDomains) Found SD uuids: () >Thread-15::DEBUG::2014-07-24 07:52:39,908::hsm::2408::Storage.HSM::(connectStorageServer) knownSDs: {} >Thread-15::INFO::2014-07-24 07:52:39,908::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-15::DEBUG::2014-07-24 07:52:39,909::task::1185::TaskManager.Task::(prepare) Task=`56c00a63-6b43-451b-86e3-a58a48a4ef19`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-15::DEBUG::2014-07-24 07:52:39,909::task::595::TaskManager.Task::(_updateState) Task=`56c00a63-6b43-451b-86e3-a58a48a4ef19`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 07:52:39,909::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 07:52:39,909::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 07:52:39,909::task::990::TaskManager.Task::(_decref) Task=`56c00a63-6b43-451b-86e3-a58a48a4ef19`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 07:52:40,166::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [2981e3a0] >Thread-15::DEBUG::2014-07-24 07:52:40,166::task::595::TaskManager.Task::(_updateState) Task=`76231c40-2d32-4fa2-b3b0-b5ed1dc4e638`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 07:52:40,166::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'user': '', 'tpgt': '1', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-15::DEBUG::2014-07-24 07:52:40,167::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a7 -I default -p 10.35.160.105:3260,1 --op=new' (cwd None) >Thread-15::DEBUG::2014-07-24 07:52:40,181::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-07-24 07:52:40,200::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a7 -I default -p 10.35.160.105:3260,1 -l' (cwd None) >Thread-15::DEBUG::2014-07-24 07:52:40,727::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-07-24 07:52:40,728::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a7 -I default -p 10.35.160.105:3260,1 -n node.startup -v manual --op=update' (cwd None) >Thread-15::DEBUG::2014-07-24 07:52:40,743::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-07-24 07:52:40,744::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-07-24 07:52:40,744::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >Thread-15::DEBUG::2014-07-24 07:52:40,890::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-24 07:52:40,890::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-07-24 07:52:40,891::hsm::2352::Storage.HSM::(__prefetchDomains) Found SD uuids: () >Thread-15::DEBUG::2014-07-24 07:52:40,891::hsm::2408::Storage.HSM::(connectStorageServer) knownSDs: {} >Thread-15::INFO::2014-07-24 07:52:40,891::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-15::DEBUG::2014-07-24 07:52:40,891::task::1185::TaskManager.Task::(prepare) Task=`76231c40-2d32-4fa2-b3b0-b5ed1dc4e638`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-15::DEBUG::2014-07-24 07:52:40,891::task::595::TaskManager.Task::(_updateState) Task=`76231c40-2d32-4fa2-b3b0-b5ed1dc4e638`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 07:52:40,892::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 07:52:40,892::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 07:52:40,892::task::990::TaskManager.Task::(_decref) Task=`76231c40-2d32-4fa2-b3b0-b5ed1dc4e638`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 07:52:41,225::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [630407b6] >Thread-15::DEBUG::2014-07-24 07:52:41,226::task::595::TaskManager.Task::(_updateState) Task=`ccdb02bc-bb74-4307-ac35-7d2fb5da4254`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 07:52:41,226::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'user': '', 'tpgt': '1', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-15::DEBUG::2014-07-24 07:52:41,226::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b6 -I default -p 10.35.160.106:3260,1 --op=new' (cwd None) >Thread-15::DEBUG::2014-07-24 07:52:41,254::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-07-24 07:52:41,255::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b6 -I default -p 10.35.160.106:3260,1 -l' (cwd None) >Thread-15::DEBUG::2014-07-24 07:52:41,788::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-07-24 07:52:41,788::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b6 -I default -p 10.35.160.106:3260,1 -n node.startup -v manual --op=update' (cwd None) >Thread-15::DEBUG::2014-07-24 07:52:41,801::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-07-24 07:52:41,801::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-07-24 07:52:41,802::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >Thread-15::DEBUG::2014-07-24 07:52:41,936::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-24 07:52:41,936::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-07-24 07:52:41,936::hsm::2352::Storage.HSM::(__prefetchDomains) Found SD uuids: () >Thread-15::DEBUG::2014-07-24 07:52:41,936::hsm::2408::Storage.HSM::(connectStorageServer) knownSDs: {} >Thread-15::INFO::2014-07-24 07:52:41,937::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-15::DEBUG::2014-07-24 07:52:41,937::task::1185::TaskManager.Task::(prepare) Task=`ccdb02bc-bb74-4307-ac35-7d2fb5da4254`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-15::DEBUG::2014-07-24 07:52:41,937::task::595::TaskManager.Task::(_updateState) Task=`ccdb02bc-bb74-4307-ac35-7d2fb5da4254`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 07:52:41,937::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 07:52:41,937::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 07:52:41,938::task::990::TaskManager.Task::(_decref) Task=`ccdb02bc-bb74-4307-ac35-7d2fb5da4254`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 07:52:42,223::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [12e8f5c4] >Thread-15::DEBUG::2014-07-24 07:52:42,223::task::595::TaskManager.Task::(_updateState) Task=`5f32d9a9-af25-4338-9fe8-e359c7e08ee2`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 07:52:42,224::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'user': '', 'tpgt': '1', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-15::DEBUG::2014-07-24 07:52:42,224::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b7 -I default -p 10.35.160.107:3260,1 --op=new' (cwd None) >Thread-15::DEBUG::2014-07-24 07:52:42,239::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-07-24 07:52:42,239::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b7 -I default -p 10.35.160.107:3260,1 -l' (cwd None) >Thread-15::DEBUG::2014-07-24 07:52:42,769::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-07-24 07:52:42,770::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b7 -I default -p 10.35.160.107:3260,1 -n node.startup -v manual --op=update' (cwd None) >Thread-15::DEBUG::2014-07-24 07:52:42,783::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-07-24 07:52:42,784::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-07-24 07:52:42,784::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >Thread-15::DEBUG::2014-07-24 07:52:42,912::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-24 07:52:42,912::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-07-24 07:52:42,913::hsm::2352::Storage.HSM::(__prefetchDomains) Found SD uuids: () >Thread-15::DEBUG::2014-07-24 07:52:42,913::hsm::2408::Storage.HSM::(connectStorageServer) knownSDs: {} >Thread-15::INFO::2014-07-24 07:52:42,913::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-15::DEBUG::2014-07-24 07:52:42,913::task::1185::TaskManager.Task::(prepare) Task=`5f32d9a9-af25-4338-9fe8-e359c7e08ee2`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-15::DEBUG::2014-07-24 07:52:42,913::task::595::TaskManager.Task::(_updateState) Task=`5f32d9a9-af25-4338-9fe8-e359c7e08ee2`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 07:52:42,914::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 07:52:42,914::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 07:52:42,914::task::990::TaskManager.Task::(_decref) Task=`5f32d9a9-af25-4338-9fe8-e359c7e08ee2`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 07:52:42,992::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-15::DEBUG::2014-07-24 07:52:42,992::task::595::TaskManager.Task::(_updateState) Task=`a8f678f1-5b17-4b50-8e1a-636b7c4cb1a3`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 07:52:42,993::logUtils::44::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=3, options={}) >Thread-15::DEBUG::2014-07-24 07:52:42,993::misc::738::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-15::DEBUG::2014-07-24 07:52:42,993::misc::740::SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-07-24 07:52:42,993::misc::738::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-15::DEBUG::2014-07-24 07:52:42,993::misc::740::SamplingMethod::(__call__) Got in to sampling method >Thread-15::DEBUG::2014-07-24 07:52:42,993::iscsi::407::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-15::DEBUG::2014-07-24 07:52:42,994::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-15::DEBUG::2014-07-24 07:52:43,013::misc::748::SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-07-24 07:52:43,016::multipath::109::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-15::DEBUG::2014-07-24 07:52:43,073::multipath::109::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-07-24 07:52:43,074::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-07-24 07:52:43,074::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-07-24 07:52:43,074::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-07-24 07:52:43,075::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-07-24 07:52:43,075::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-15::DEBUG::2014-07-24 07:52:43,075::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-15::DEBUG::2014-07-24 07:52:43,075::misc::748::SamplingMethod::(__call__) Returning last result >Thread-15::DEBUG::2014-07-24 07:52:43,076::lvm::325::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-15::DEBUG::2014-07-24 07:52:43,077::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-15::DEBUG::2014-07-24 07:52:43,218::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-07-24 07:52:43,219::lvm::350::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-15::DEBUG::2014-07-24 07:52:43,253::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --test --metadatasize 128m --metadatacopies 2 --metadataignore y' (cwd None) >Thread-15::DEBUG::2014-07-24 07:52:43,380::lvm::296::Storage.Misc.excCmd::(cmd) FAILED: <err> = " TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.\n Please enter a physical volume path\n Run `pvcreate --help' for more information.\n"; <rc> = 3 >Thread-15::DEBUG::2014-07-24 07:52:43,381::lvm::860::Storage.LVM::(testPVCreate) rc: 3, out: [], err: [' TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.', ' Please enter a physical volume path', " Run `pvcreate --help' for more information."], unusedDevs: set([]), usedDevs: set([]) >Thread-15::INFO::2014-07-24 07:52:43,381::logUtils::47::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList': []} >Thread-15::DEBUG::2014-07-24 07:52:43,382::task::1185::TaskManager.Task::(prepare) Task=`a8f678f1-5b17-4b50-8e1a-636b7c4cb1a3`::finished: {'devList': []} >Thread-15::DEBUG::2014-07-24 07:52:43,382::task::595::TaskManager.Task::(_updateState) Task=`a8f678f1-5b17-4b50-8e1a-636b7c4cb1a3`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 07:52:43,382::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 07:52:43,382::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 07:52:43,382::task::990::TaskManager.Task::(_decref) Task=`a8f678f1-5b17-4b50-8e1a-636b7c4cb1a3`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 07:52:50,497::task::595::TaskManager.Task::(_updateState) Task=`963f2a22-46b5-4fb5-b542-b6700f908f94`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 07:52:50,497::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 07:52:50,497::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 07:52:50,497::task::1185::TaskManager.Task::(prepare) Task=`963f2a22-46b5-4fb5-b542-b6700f908f94`::finished: {} >Thread-15::DEBUG::2014-07-24 07:52:50,498::task::595::TaskManager.Task::(_updateState) Task=`963f2a22-46b5-4fb5-b542-b6700f908f94`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 07:52:50,498::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 07:52:50,498::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 07:52:50,498::task::990::TaskManager.Task::(_decref) Task=`963f2a22-46b5-4fb5-b542-b6700f908f94`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 07:53:05,949::task::595::TaskManager.Task::(_updateState) Task=`b590f7d3-ac92-4280-9e25-085701388be5`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 07:53:05,950::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 07:53:05,950::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 07:53:05,950::task::1185::TaskManager.Task::(prepare) Task=`b590f7d3-ac92-4280-9e25-085701388be5`::finished: {} >Thread-15::DEBUG::2014-07-24 07:53:05,950::task::595::TaskManager.Task::(_updateState) Task=`b590f7d3-ac92-4280-9e25-085701388be5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 07:53:05,950::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 07:53:05,950::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 07:53:05,951::task::990::TaskManager.Task::(_decref) Task=`b590f7d3-ac92-4280-9e25-085701388be5`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 07:53:19,103::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-15::DEBUG::2014-07-24 07:53:19,103::task::595::TaskManager.Task::(_updateState) Task=`afc7bbf0-1d15-4105-a695-865f959848d5`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 07:53:19,104::logUtils::44::dispatcher::(wrapper) Run and protect: discoverSendTargets(con={'connection': '10.35.160.104', 'password': '******', 'port': '3260', 'user': ''}, options=None) >Thread-15::DEBUG::2014-07-24 07:53:19,104::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.104:3260 --op=new' (cwd None) >Thread-15::DEBUG::2014-07-24 07:53:19,122::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-07-24 07:53:19,123::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.104:3260 --discover' (cwd None) >Thread-15::DEBUG::2014-07-24 07:53:19,155::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-07-24 07:53:19,155::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.104:3260 --op=delete' (cwd None) >Thread-15::DEBUG::2014-07-24 07:53:19,221::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::INFO::2014-07-24 07:53:19,222::logUtils::47::dispatcher::(wrapper) Run and protect: discoverSendTargets, Return response: {'fullTargets': ['10.35.160.104:3260,1 iqn.1992-04.com.emc:cx.ckm00121000438.a6', '10.35.160.105:3260,2 iqn.1992-04.com.emc:cx.ckm00121000438.a7', '10.35.160.106:3260,3 iqn.1992-04.com.emc:cx.ckm00121000438.b6', '10.35.160.107:3260,4 iqn.1992-04.com.emc:cx.ckm00121000438.b7'], 'targets': ['iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'iqn.1992-04.com.emc:cx.ckm00121000438.b7']} >Thread-15::DEBUG::2014-07-24 07:53:19,222::task::1185::TaskManager.Task::(prepare) Task=`afc7bbf0-1d15-4105-a695-865f959848d5`::finished: {'fullTargets': ['10.35.160.104:3260,1 iqn.1992-04.com.emc:cx.ckm00121000438.a6', '10.35.160.105:3260,2 iqn.1992-04.com.emc:cx.ckm00121000438.a7', '10.35.160.106:3260,3 iqn.1992-04.com.emc:cx.ckm00121000438.b6', '10.35.160.107:3260,4 iqn.1992-04.com.emc:cx.ckm00121000438.b7'], 'targets': ['iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'iqn.1992-04.com.emc:cx.ckm00121000438.b7']} >Thread-15::DEBUG::2014-07-24 07:53:19,222::task::595::TaskManager.Task::(_updateState) Task=`afc7bbf0-1d15-4105-a695-865f959848d5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 07:53:19,222::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 07:53:19,222::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 07:53:19,223::task::990::TaskManager.Task::(_decref) Task=`afc7bbf0-1d15-4105-a695-865f959848d5`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 07:53:21,291::task::595::TaskManager.Task::(_updateState) Task=`ae36ce1f-6a68-4b20-8399-73bd375d0116`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 07:53:21,291::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 07:53:21,291::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 07:53:21,292::task::1185::TaskManager.Task::(prepare) Task=`ae36ce1f-6a68-4b20-8399-73bd375d0116`::finished: {} >Thread-15::DEBUG::2014-07-24 07:53:21,292::task::595::TaskManager.Task::(_updateState) Task=`ae36ce1f-6a68-4b20-8399-73bd375d0116`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 07:53:21,292::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 07:53:21,292::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 07:53:21,292::task::990::TaskManager.Task::(_decref) Task=`ae36ce1f-6a68-4b20-8399-73bd375d0116`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 07:53:25,089::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-15::DEBUG::2014-07-24 07:53:25,089::task::595::TaskManager.Task::(_updateState) Task=`b257e975-10aa-4894-a78e-b08f538c2bd4`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 07:53:25,089::logUtils::44::dispatcher::(wrapper) Run and protect: discoverSendTargets(con={'connection': '10.35.160.104', 'password': '******', 'port': '3260', 'user': ''}, options=None) >Thread-15::DEBUG::2014-07-24 07:53:25,090::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.104:3260 --op=new' (cwd None) >Thread-15::DEBUG::2014-07-24 07:53:25,104::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-07-24 07:53:25,104::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.104:3260 --discover' (cwd None) >Thread-15::DEBUG::2014-07-24 07:53:25,121::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-07-24 07:53:25,132::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.104:3260 --op=delete' (cwd None) >Thread-15::DEBUG::2014-07-24 07:53:25,145::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::INFO::2014-07-24 07:53:25,145::logUtils::47::dispatcher::(wrapper) Run and protect: discoverSendTargets, Return response: {'fullTargets': ['10.35.160.104:3260,1 iqn.1992-04.com.emc:cx.ckm00121000438.a6', '10.35.160.105:3260,2 iqn.1992-04.com.emc:cx.ckm00121000438.a7', '10.35.160.106:3260,3 iqn.1992-04.com.emc:cx.ckm00121000438.b6', '10.35.160.107:3260,4 iqn.1992-04.com.emc:cx.ckm00121000438.b7'], 'targets': ['iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'iqn.1992-04.com.emc:cx.ckm00121000438.b7']} >Thread-15::DEBUG::2014-07-24 07:53:25,146::task::1185::TaskManager.Task::(prepare) Task=`b257e975-10aa-4894-a78e-b08f538c2bd4`::finished: {'fullTargets': ['10.35.160.104:3260,1 iqn.1992-04.com.emc:cx.ckm00121000438.a6', '10.35.160.105:3260,2 iqn.1992-04.com.emc:cx.ckm00121000438.a7', '10.35.160.106:3260,3 iqn.1992-04.com.emc:cx.ckm00121000438.b6', '10.35.160.107:3260,4 iqn.1992-04.com.emc:cx.ckm00121000438.b7'], 'targets': ['iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'iqn.1992-04.com.emc:cx.ckm00121000438.b7']} >Thread-15::DEBUG::2014-07-24 07:53:25,146::task::595::TaskManager.Task::(_updateState) Task=`b257e975-10aa-4894-a78e-b08f538c2bd4`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 07:53:25,146::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 07:53:25,146::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 07:53:25,146::task::990::TaskManager.Task::(_decref) Task=`b257e975-10aa-4894-a78e-b08f538c2bd4`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 07:53:36,677::task::595::TaskManager.Task::(_updateState) Task=`f095561f-d371-4b96-9888-f6e73179f06c`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 07:53:36,678::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 07:53:36,678::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 07:53:36,678::task::1185::TaskManager.Task::(prepare) Task=`f095561f-d371-4b96-9888-f6e73179f06c`::finished: {} >Thread-15::DEBUG::2014-07-24 07:53:36,678::task::595::TaskManager.Task::(_updateState) Task=`f095561f-d371-4b96-9888-f6e73179f06c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 07:53:36,678::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 07:53:36,678::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 07:53:36,679::task::990::TaskManager.Task::(_decref) Task=`f095561f-d371-4b96-9888-f6e73179f06c`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 07:53:52,059::task::595::TaskManager.Task::(_updateState) Task=`c7270336-eb9e-4254-a3a5-31e735a4a8a5`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 07:53:52,059::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 07:53:52,060::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 07:53:52,060::task::1185::TaskManager.Task::(prepare) Task=`c7270336-eb9e-4254-a3a5-31e735a4a8a5`::finished: {} >Thread-15::DEBUG::2014-07-24 07:53:52,060::task::595::TaskManager.Task::(_updateState) Task=`c7270336-eb9e-4254-a3a5-31e735a4a8a5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 07:53:52,060::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 07:53:52,060::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 07:53:52,060::task::990::TaskManager.Task::(_decref) Task=`c7270336-eb9e-4254-a3a5-31e735a4a8a5`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 07:54:07,380::task::595::TaskManager.Task::(_updateState) Task=`b056fccd-8ec9-424a-a2b7-303d8a1ab388`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 07:54:07,381::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 07:54:07,381::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 07:54:07,381::task::1185::TaskManager.Task::(prepare) Task=`b056fccd-8ec9-424a-a2b7-303d8a1ab388`::finished: {} >Thread-15::DEBUG::2014-07-24 07:54:07,381::task::595::TaskManager.Task::(_updateState) Task=`b056fccd-8ec9-424a-a2b7-303d8a1ab388`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 07:54:07,381::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 07:54:07,382::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 07:54:07,382::task::990::TaskManager.Task::(_decref) Task=`b056fccd-8ec9-424a-a2b7-303d8a1ab388`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 07:54:23,168::task::595::TaskManager.Task::(_updateState) Task=`4dd14efa-f2e5-4ba2-b611-058cbfba7db2`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 07:54:23,168::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 07:54:23,169::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 07:54:23,169::task::1185::TaskManager.Task::(prepare) Task=`4dd14efa-f2e5-4ba2-b611-058cbfba7db2`::finished: {} >Thread-15::DEBUG::2014-07-24 07:54:23,169::task::595::TaskManager.Task::(_updateState) Task=`4dd14efa-f2e5-4ba2-b611-058cbfba7db2`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 07:54:23,169::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 07:54:23,169::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 07:54:23,169::task::990::TaskManager.Task::(_decref) Task=`4dd14efa-f2e5-4ba2-b611-058cbfba7db2`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 07:54:38,565::task::595::TaskManager.Task::(_updateState) Task=`9c63d1d1-a290-4c5f-b9e0-ccb45e359859`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 07:54:38,565::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 07:54:38,565::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 07:54:38,565::task::1185::TaskManager.Task::(prepare) Task=`9c63d1d1-a290-4c5f-b9e0-ccb45e359859`::finished: {} >Thread-15::DEBUG::2014-07-24 07:54:38,565::task::595::TaskManager.Task::(_updateState) Task=`9c63d1d1-a290-4c5f-b9e0-ccb45e359859`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 07:54:38,566::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 07:54:38,566::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 07:54:38,566::task::990::TaskManager.Task::(_decref) Task=`9c63d1d1-a290-4c5f-b9e0-ccb45e359859`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 07:54:54,023::task::595::TaskManager.Task::(_updateState) Task=`fd4400cd-c423-473e-b5b8-d66c64502604`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 07:54:54,024::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 07:54:54,024::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 07:54:54,024::task::1185::TaskManager.Task::(prepare) Task=`fd4400cd-c423-473e-b5b8-d66c64502604`::finished: {} >Thread-15::DEBUG::2014-07-24 07:54:54,024::task::595::TaskManager.Task::(_updateState) Task=`fd4400cd-c423-473e-b5b8-d66c64502604`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 07:54:54,024::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 07:54:54,024::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 07:54:54,025::task::990::TaskManager.Task::(_decref) Task=`fd4400cd-c423-473e-b5b8-d66c64502604`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 07:55:09,452::task::595::TaskManager.Task::(_updateState) Task=`5d1faa68-4599-4e42-9fbc-52e83ff98aa6`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 07:55:09,452::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 07:55:09,453::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 07:55:09,453::task::1185::TaskManager.Task::(prepare) Task=`5d1faa68-4599-4e42-9fbc-52e83ff98aa6`::finished: {} >Thread-15::DEBUG::2014-07-24 07:55:09,453::task::595::TaskManager.Task::(_updateState) Task=`5d1faa68-4599-4e42-9fbc-52e83ff98aa6`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 07:55:09,453::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 07:55:09,453::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 07:55:09,453::task::990::TaskManager.Task::(_decref) Task=`5d1faa68-4599-4e42-9fbc-52e83ff98aa6`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 07:55:24,939::task::595::TaskManager.Task::(_updateState) Task=`b0302081-fe09-4642-90db-48ad1465ca34`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 07:55:24,939::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 07:55:24,939::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 07:55:24,940::task::1185::TaskManager.Task::(prepare) Task=`b0302081-fe09-4642-90db-48ad1465ca34`::finished: {} >Thread-15::DEBUG::2014-07-24 07:55:24,940::task::595::TaskManager.Task::(_updateState) Task=`b0302081-fe09-4642-90db-48ad1465ca34`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 07:55:24,940::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 07:55:24,940::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 07:55:24,940::task::990::TaskManager.Task::(_decref) Task=`b0302081-fe09-4642-90db-48ad1465ca34`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 07:55:40,472::task::595::TaskManager.Task::(_updateState) Task=`475135fc-8358-4aa4-8504-cb5030db3feb`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 07:55:40,472::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 07:55:40,473::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 07:55:40,473::task::1185::TaskManager.Task::(prepare) Task=`475135fc-8358-4aa4-8504-cb5030db3feb`::finished: {} >Thread-15::DEBUG::2014-07-24 07:55:40,473::task::595::TaskManager.Task::(_updateState) Task=`475135fc-8358-4aa4-8504-cb5030db3feb`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 07:55:40,473::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 07:55:40,473::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 07:55:40,473::task::990::TaskManager.Task::(_decref) Task=`475135fc-8358-4aa4-8504-cb5030db3feb`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 07:55:55,987::task::595::TaskManager.Task::(_updateState) Task=`697cbee8-4525-4b99-b7df-0244ffae4670`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 07:55:55,987::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 07:55:55,987::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 07:55:55,987::task::1185::TaskManager.Task::(prepare) Task=`697cbee8-4525-4b99-b7df-0244ffae4670`::finished: {} >Thread-15::DEBUG::2014-07-24 07:55:55,987::task::595::TaskManager.Task::(_updateState) Task=`697cbee8-4525-4b99-b7df-0244ffae4670`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 07:55:55,988::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 07:55:55,988::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 07:55:55,988::task::990::TaskManager.Task::(_decref) Task=`697cbee8-4525-4b99-b7df-0244ffae4670`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 07:56:11,534::task::595::TaskManager.Task::(_updateState) Task=`0e3bf680-bda8-4c29-9cf9-1d84ae5cfcf6`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 07:56:11,535::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 07:56:11,535::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 07:56:11,535::task::1185::TaskManager.Task::(prepare) Task=`0e3bf680-bda8-4c29-9cf9-1d84ae5cfcf6`::finished: {} >Thread-15::DEBUG::2014-07-24 07:56:11,535::task::595::TaskManager.Task::(_updateState) Task=`0e3bf680-bda8-4c29-9cf9-1d84ae5cfcf6`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 07:56:11,535::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 07:56:11,535::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 07:56:11,535::task::990::TaskManager.Task::(_decref) Task=`0e3bf680-bda8-4c29-9cf9-1d84ae5cfcf6`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 07:56:27,116::task::595::TaskManager.Task::(_updateState) Task=`a3946bc4-6748-4e7d-92c2-23bf8554e8ba`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 07:56:27,116::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 07:56:27,116::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 07:56:27,117::task::1185::TaskManager.Task::(prepare) Task=`a3946bc4-6748-4e7d-92c2-23bf8554e8ba`::finished: {} >Thread-15::DEBUG::2014-07-24 07:56:27,117::task::595::TaskManager.Task::(_updateState) Task=`a3946bc4-6748-4e7d-92c2-23bf8554e8ba`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 07:56:27,117::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 07:56:27,117::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 07:56:27,117::task::990::TaskManager.Task::(_decref) Task=`a3946bc4-6748-4e7d-92c2-23bf8554e8ba`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 07:56:42,789::task::595::TaskManager.Task::(_updateState) Task=`f10549ad-0e76-4599-ac52-8a9237d14cbb`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 07:56:42,789::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 07:56:42,789::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 07:56:42,789::task::1185::TaskManager.Task::(prepare) Task=`f10549ad-0e76-4599-ac52-8a9237d14cbb`::finished: {} >Thread-15::DEBUG::2014-07-24 07:56:42,790::task::595::TaskManager.Task::(_updateState) Task=`f10549ad-0e76-4599-ac52-8a9237d14cbb`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 07:56:42,790::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 07:56:42,790::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 07:56:42,790::task::990::TaskManager.Task::(_decref) Task=`f10549ad-0e76-4599-ac52-8a9237d14cbb`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 07:56:58,283::task::595::TaskManager.Task::(_updateState) Task=`1bab6ed8-2dd4-402e-830a-5f2355b9ac41`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 07:56:58,283::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 07:56:58,283::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 07:56:58,283::task::1185::TaskManager.Task::(prepare) Task=`1bab6ed8-2dd4-402e-830a-5f2355b9ac41`::finished: {} >Thread-15::DEBUG::2014-07-24 07:56:58,283::task::595::TaskManager.Task::(_updateState) Task=`1bab6ed8-2dd4-402e-830a-5f2355b9ac41`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 07:56:58,284::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 07:56:58,284::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 07:56:58,284::task::990::TaskManager.Task::(_decref) Task=`1bab6ed8-2dd4-402e-830a-5f2355b9ac41`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 07:57:13,649::task::595::TaskManager.Task::(_updateState) Task=`03bc1bbf-e530-403b-8f5b-baa977e3b8de`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 07:57:13,649::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 07:57:13,649::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 07:57:13,649::task::1185::TaskManager.Task::(prepare) Task=`03bc1bbf-e530-403b-8f5b-baa977e3b8de`::finished: {} >Thread-15::DEBUG::2014-07-24 07:57:13,649::task::595::TaskManager.Task::(_updateState) Task=`03bc1bbf-e530-403b-8f5b-baa977e3b8de`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 07:57:13,650::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 07:57:13,650::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 07:57:13,650::task::990::TaskManager.Task::(_decref) Task=`03bc1bbf-e530-403b-8f5b-baa977e3b8de`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 07:57:29,001::task::595::TaskManager.Task::(_updateState) Task=`335f7d37-0057-4a5d-86c8-2770e7eb877f`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 07:57:29,001::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 07:57:29,001::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 07:57:29,001::task::1185::TaskManager.Task::(prepare) Task=`335f7d37-0057-4a5d-86c8-2770e7eb877f`::finished: {} >Thread-15::DEBUG::2014-07-24 07:57:29,002::task::595::TaskManager.Task::(_updateState) Task=`335f7d37-0057-4a5d-86c8-2770e7eb877f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 07:57:29,002::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 07:57:29,002::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 07:57:29,002::task::990::TaskManager.Task::(_decref) Task=`335f7d37-0057-4a5d-86c8-2770e7eb877f`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 07:57:44,324::task::595::TaskManager.Task::(_updateState) Task=`c422a4a4-a7db-4b1c-b442-41b90715cee2`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 07:57:44,325::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 07:57:44,325::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 07:57:44,325::task::1185::TaskManager.Task::(prepare) Task=`c422a4a4-a7db-4b1c-b442-41b90715cee2`::finished: {} >Thread-15::DEBUG::2014-07-24 07:57:44,325::task::595::TaskManager.Task::(_updateState) Task=`c422a4a4-a7db-4b1c-b442-41b90715cee2`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 07:57:44,325::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 07:57:44,326::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 07:57:44,326::task::990::TaskManager.Task::(_decref) Task=`c422a4a4-a7db-4b1c-b442-41b90715cee2`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 07:57:59,700::task::595::TaskManager.Task::(_updateState) Task=`6f34522b-2005-436b-817f-000066f37d49`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 07:57:59,701::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 07:57:59,701::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 07:57:59,701::task::1185::TaskManager.Task::(prepare) Task=`6f34522b-2005-436b-817f-000066f37d49`::finished: {} >Thread-15::DEBUG::2014-07-24 07:57:59,701::task::595::TaskManager.Task::(_updateState) Task=`6f34522b-2005-436b-817f-000066f37d49`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 07:57:59,701::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 07:57:59,702::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 07:57:59,702::task::990::TaskManager.Task::(_decref) Task=`6f34522b-2005-436b-817f-000066f37d49`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 07:58:15,073::task::595::TaskManager.Task::(_updateState) Task=`dc03037a-ae7b-4382-9bb6-d6ed3569e690`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 07:58:15,073::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 07:58:15,073::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 07:58:15,074::task::1185::TaskManager.Task::(prepare) Task=`dc03037a-ae7b-4382-9bb6-d6ed3569e690`::finished: {} >Thread-15::DEBUG::2014-07-24 07:58:15,074::task::595::TaskManager.Task::(_updateState) Task=`dc03037a-ae7b-4382-9bb6-d6ed3569e690`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 07:58:15,074::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 07:58:15,074::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 07:58:15,074::task::990::TaskManager.Task::(_decref) Task=`dc03037a-ae7b-4382-9bb6-d6ed3569e690`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 07:58:30,480::task::595::TaskManager.Task::(_updateState) Task=`a032e8e9-d468-468a-8cc5-1c40551d6193`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 07:58:30,480::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 07:58:30,480::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 07:58:30,480::task::1185::TaskManager.Task::(prepare) Task=`a032e8e9-d468-468a-8cc5-1c40551d6193`::finished: {} >Thread-15::DEBUG::2014-07-24 07:58:30,481::task::595::TaskManager.Task::(_updateState) Task=`a032e8e9-d468-468a-8cc5-1c40551d6193`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 07:58:30,481::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 07:58:30,481::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 07:58:30,481::task::990::TaskManager.Task::(_decref) Task=`a032e8e9-d468-468a-8cc5-1c40551d6193`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 07:58:45,804::task::595::TaskManager.Task::(_updateState) Task=`ff011249-66a2-415a-a02c-d7f9c9ce68dd`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 07:58:45,804::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 07:58:45,805::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 07:58:45,805::task::1185::TaskManager.Task::(prepare) Task=`ff011249-66a2-415a-a02c-d7f9c9ce68dd`::finished: {} >Thread-15::DEBUG::2014-07-24 07:58:45,805::task::595::TaskManager.Task::(_updateState) Task=`ff011249-66a2-415a-a02c-d7f9c9ce68dd`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 07:58:45,805::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 07:58:45,805::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 07:58:45,805::task::990::TaskManager.Task::(_decref) Task=`ff011249-66a2-415a-a02c-d7f9c9ce68dd`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 07:59:01,311::task::595::TaskManager.Task::(_updateState) Task=`54af5130-35aa-480a-a398-3d5f223fb307`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 07:59:01,312::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 07:59:01,312::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 07:59:01,312::task::1185::TaskManager.Task::(prepare) Task=`54af5130-35aa-480a-a398-3d5f223fb307`::finished: {} >Thread-15::DEBUG::2014-07-24 07:59:01,312::task::595::TaskManager.Task::(_updateState) Task=`54af5130-35aa-480a-a398-3d5f223fb307`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 07:59:01,312::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 07:59:01,312::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 07:59:01,313::task::990::TaskManager.Task::(_decref) Task=`54af5130-35aa-480a-a398-3d5f223fb307`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 07:59:17,013::task::595::TaskManager.Task::(_updateState) Task=`c05b0120-dfaf-4247-9454-bac8f19c0d40`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 07:59:17,013::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 07:59:17,013::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 07:59:17,014::task::1185::TaskManager.Task::(prepare) Task=`c05b0120-dfaf-4247-9454-bac8f19c0d40`::finished: {} >Thread-15::DEBUG::2014-07-24 07:59:17,014::task::595::TaskManager.Task::(_updateState) Task=`c05b0120-dfaf-4247-9454-bac8f19c0d40`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 07:59:17,014::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 07:59:17,014::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 07:59:17,014::task::990::TaskManager.Task::(_decref) Task=`c05b0120-dfaf-4247-9454-bac8f19c0d40`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 07:59:32,376::task::595::TaskManager.Task::(_updateState) Task=`3e7ba410-46f3-46a5-882e-1366aaed9cf7`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 07:59:32,377::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 07:59:32,377::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 07:59:32,377::task::1185::TaskManager.Task::(prepare) Task=`3e7ba410-46f3-46a5-882e-1366aaed9cf7`::finished: {} >Thread-15::DEBUG::2014-07-24 07:59:32,377::task::595::TaskManager.Task::(_updateState) Task=`3e7ba410-46f3-46a5-882e-1366aaed9cf7`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 07:59:32,377::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 07:59:32,378::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 07:59:32,378::task::990::TaskManager.Task::(_decref) Task=`3e7ba410-46f3-46a5-882e-1366aaed9cf7`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 07:59:47,685::task::595::TaskManager.Task::(_updateState) Task=`ade8c9f7-b6d9-4f8a-8741-cec95e7149d5`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 07:59:47,686::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 07:59:47,686::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 07:59:47,686::task::1185::TaskManager.Task::(prepare) Task=`ade8c9f7-b6d9-4f8a-8741-cec95e7149d5`::finished: {} >Thread-15::DEBUG::2014-07-24 07:59:47,686::task::595::TaskManager.Task::(_updateState) Task=`ade8c9f7-b6d9-4f8a-8741-cec95e7149d5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 07:59:47,686::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 07:59:47,686::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 07:59:47,687::task::990::TaskManager.Task::(_decref) Task=`ade8c9f7-b6d9-4f8a-8741-cec95e7149d5`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:00:03,009::task::595::TaskManager.Task::(_updateState) Task=`8875dc9a-cdea-4bd3-90ea-782a6cb0e545`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:00:03,016::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:00:03,016::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:00:03,016::task::1185::TaskManager.Task::(prepare) Task=`8875dc9a-cdea-4bd3-90ea-782a6cb0e545`::finished: {} >Thread-15::DEBUG::2014-07-24 08:00:03,016::task::595::TaskManager.Task::(_updateState) Task=`8875dc9a-cdea-4bd3-90ea-782a6cb0e545`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:00:03,016::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:00:03,016::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:00:03,016::task::990::TaskManager.Task::(_decref) Task=`8875dc9a-cdea-4bd3-90ea-782a6cb0e545`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:00:18,386::task::595::TaskManager.Task::(_updateState) Task=`89b86afd-4fbc-4c1b-abad-c926a30126b9`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:00:18,387::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:00:18,387::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:00:18,387::task::1185::TaskManager.Task::(prepare) Task=`89b86afd-4fbc-4c1b-abad-c926a30126b9`::finished: {} >Thread-15::DEBUG::2014-07-24 08:00:18,387::task::595::TaskManager.Task::(_updateState) Task=`89b86afd-4fbc-4c1b-abad-c926a30126b9`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:00:18,387::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:00:18,388::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:00:18,388::task::990::TaskManager.Task::(_decref) Task=`89b86afd-4fbc-4c1b-abad-c926a30126b9`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:00:33,709::task::595::TaskManager.Task::(_updateState) Task=`0bbb70d7-89a2-4b26-9244-72c8f03c7226`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:00:33,710::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:00:33,710::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:00:33,710::task::1185::TaskManager.Task::(prepare) Task=`0bbb70d7-89a2-4b26-9244-72c8f03c7226`::finished: {} >Thread-15::DEBUG::2014-07-24 08:00:33,710::task::595::TaskManager.Task::(_updateState) Task=`0bbb70d7-89a2-4b26-9244-72c8f03c7226`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:00:33,710::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:00:33,710::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:00:33,711::task::990::TaskManager.Task::(_decref) Task=`0bbb70d7-89a2-4b26-9244-72c8f03c7226`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:00:49,109::task::595::TaskManager.Task::(_updateState) Task=`6b60f631-56d7-4d3f-8cb3-1f2549ce4c1c`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:00:49,110::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:00:49,110::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:00:49,110::task::1185::TaskManager.Task::(prepare) Task=`6b60f631-56d7-4d3f-8cb3-1f2549ce4c1c`::finished: {} >Thread-15::DEBUG::2014-07-24 08:00:49,110::task::595::TaskManager.Task::(_updateState) Task=`6b60f631-56d7-4d3f-8cb3-1f2549ce4c1c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:00:49,110::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:00:49,110::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:00:49,111::task::990::TaskManager.Task::(_decref) Task=`6b60f631-56d7-4d3f-8cb3-1f2549ce4c1c`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:01:04,495::task::595::TaskManager.Task::(_updateState) Task=`20061877-2d7f-4bb4-b485-c816a4c6eeed`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:01:04,496::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:01:04,496::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:01:04,496::task::1185::TaskManager.Task::(prepare) Task=`20061877-2d7f-4bb4-b485-c816a4c6eeed`::finished: {} >Thread-15::DEBUG::2014-07-24 08:01:04,496::task::595::TaskManager.Task::(_updateState) Task=`20061877-2d7f-4bb4-b485-c816a4c6eeed`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:01:04,496::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:01:04,496::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:01:04,497::task::990::TaskManager.Task::(_decref) Task=`20061877-2d7f-4bb4-b485-c816a4c6eeed`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:01:19,834::task::595::TaskManager.Task::(_updateState) Task=`5c7a6cbc-b130-48d2-8cd0-ca593d3498a1`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:01:19,834::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:01:19,834::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:01:19,835::task::1185::TaskManager.Task::(prepare) Task=`5c7a6cbc-b130-48d2-8cd0-ca593d3498a1`::finished: {} >Thread-15::DEBUG::2014-07-24 08:01:19,835::task::595::TaskManager.Task::(_updateState) Task=`5c7a6cbc-b130-48d2-8cd0-ca593d3498a1`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:01:19,835::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:01:19,835::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:01:19,835::task::990::TaskManager.Task::(_decref) Task=`5c7a6cbc-b130-48d2-8cd0-ca593d3498a1`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:01:35,153::task::595::TaskManager.Task::(_updateState) Task=`3fa397fc-04a7-405a-ae00-573ac70ef040`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:01:35,153::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:01:35,154::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:01:35,154::task::1185::TaskManager.Task::(prepare) Task=`3fa397fc-04a7-405a-ae00-573ac70ef040`::finished: {} >Thread-15::DEBUG::2014-07-24 08:01:35,154::task::595::TaskManager.Task::(_updateState) Task=`3fa397fc-04a7-405a-ae00-573ac70ef040`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:01:35,154::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:01:35,154::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:01:35,154::task::990::TaskManager.Task::(_decref) Task=`3fa397fc-04a7-405a-ae00-573ac70ef040`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:01:50,516::task::595::TaskManager.Task::(_updateState) Task=`149aa224-d1d2-4d26-985e-9a1784b695e9`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:01:50,517::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:01:50,517::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:01:50,517::task::1185::TaskManager.Task::(prepare) Task=`149aa224-d1d2-4d26-985e-9a1784b695e9`::finished: {} >Thread-15::DEBUG::2014-07-24 08:01:50,517::task::595::TaskManager.Task::(_updateState) Task=`149aa224-d1d2-4d26-985e-9a1784b695e9`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:01:50,517::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:01:50,518::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:01:50,518::task::990::TaskManager.Task::(_decref) Task=`149aa224-d1d2-4d26-985e-9a1784b695e9`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:02:05,882::task::595::TaskManager.Task::(_updateState) Task=`60a9f1fd-ac3f-4206-9ed9-159aa6907e45`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:02:05,882::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:02:05,882::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:02:05,882::task::1185::TaskManager.Task::(prepare) Task=`60a9f1fd-ac3f-4206-9ed9-159aa6907e45`::finished: {} >Thread-15::DEBUG::2014-07-24 08:02:05,882::task::595::TaskManager.Task::(_updateState) Task=`60a9f1fd-ac3f-4206-9ed9-159aa6907e45`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:02:05,883::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:02:05,883::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:02:05,883::task::990::TaskManager.Task::(_decref) Task=`60a9f1fd-ac3f-4206-9ed9-159aa6907e45`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:02:21,228::task::595::TaskManager.Task::(_updateState) Task=`35ba581b-921a-4e0e-9931-5f955483e674`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:02:21,228::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:02:21,228::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:02:21,228::task::1185::TaskManager.Task::(prepare) Task=`35ba581b-921a-4e0e-9931-5f955483e674`::finished: {} >Thread-15::DEBUG::2014-07-24 08:02:21,228::task::595::TaskManager.Task::(_updateState) Task=`35ba581b-921a-4e0e-9931-5f955483e674`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:02:21,229::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:02:21,229::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:02:21,229::task::990::TaskManager.Task::(_decref) Task=`35ba581b-921a-4e0e-9931-5f955483e674`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:02:36,649::task::595::TaskManager.Task::(_updateState) Task=`9ecebdbd-eb92-4c62-b96c-ecc17c1c1317`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:02:36,650::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:02:36,650::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:02:36,650::task::1185::TaskManager.Task::(prepare) Task=`9ecebdbd-eb92-4c62-b96c-ecc17c1c1317`::finished: {} >Thread-15::DEBUG::2014-07-24 08:02:36,650::task::595::TaskManager.Task::(_updateState) Task=`9ecebdbd-eb92-4c62-b96c-ecc17c1c1317`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:02:36,650::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:02:36,650::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:02:36,651::task::990::TaskManager.Task::(_decref) Task=`9ecebdbd-eb92-4c62-b96c-ecc17c1c1317`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:02:52,031::task::595::TaskManager.Task::(_updateState) Task=`6de8cb49-8620-459c-a8ee-e1b2db504c50`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:02:52,032::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:02:52,032::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:02:52,032::task::1185::TaskManager.Task::(prepare) Task=`6de8cb49-8620-459c-a8ee-e1b2db504c50`::finished: {} >Thread-15::DEBUG::2014-07-24 08:02:52,032::task::595::TaskManager.Task::(_updateState) Task=`6de8cb49-8620-459c-a8ee-e1b2db504c50`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:02:52,032::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:02:52,032::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:02:52,033::task::990::TaskManager.Task::(_decref) Task=`6de8cb49-8620-459c-a8ee-e1b2db504c50`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:03:07,392::task::595::TaskManager.Task::(_updateState) Task=`b281f188-47bb-4a79-b591-2ded81ce7a43`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:03:07,393::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:03:07,393::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:03:07,393::task::1185::TaskManager.Task::(prepare) Task=`b281f188-47bb-4a79-b591-2ded81ce7a43`::finished: {} >Thread-15::DEBUG::2014-07-24 08:03:07,393::task::595::TaskManager.Task::(_updateState) Task=`b281f188-47bb-4a79-b591-2ded81ce7a43`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:03:07,393::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:03:07,394::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:03:07,394::task::990::TaskManager.Task::(_decref) Task=`b281f188-47bb-4a79-b591-2ded81ce7a43`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:03:22,759::task::595::TaskManager.Task::(_updateState) Task=`41cd5a07-9614-4574-bba3-ed2bf52decbc`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:03:22,760::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:03:22,760::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:03:22,760::task::1185::TaskManager.Task::(prepare) Task=`41cd5a07-9614-4574-bba3-ed2bf52decbc`::finished: {} >Thread-15::DEBUG::2014-07-24 08:03:22,760::task::595::TaskManager.Task::(_updateState) Task=`41cd5a07-9614-4574-bba3-ed2bf52decbc`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:03:22,760::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:03:22,760::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:03:22,760::task::990::TaskManager.Task::(_decref) Task=`41cd5a07-9614-4574-bba3-ed2bf52decbc`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:03:38,116::task::595::TaskManager.Task::(_updateState) Task=`ab113a1b-ee56-4522-8169-ec0a504863d4`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:03:38,116::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:03:38,116::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:03:38,116::task::1185::TaskManager.Task::(prepare) Task=`ab113a1b-ee56-4522-8169-ec0a504863d4`::finished: {} >Thread-15::DEBUG::2014-07-24 08:03:38,117::task::595::TaskManager.Task::(_updateState) Task=`ab113a1b-ee56-4522-8169-ec0a504863d4`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:03:38,117::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:03:38,117::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:03:38,117::task::990::TaskManager.Task::(_decref) Task=`ab113a1b-ee56-4522-8169-ec0a504863d4`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:03:53,609::task::595::TaskManager.Task::(_updateState) Task=`7d7486cc-8d73-417d-8608-0ffba2335031`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:03:53,609::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:03:53,610::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:03:53,610::task::1185::TaskManager.Task::(prepare) Task=`7d7486cc-8d73-417d-8608-0ffba2335031`::finished: {} >Thread-15::DEBUG::2014-07-24 08:03:53,610::task::595::TaskManager.Task::(_updateState) Task=`7d7486cc-8d73-417d-8608-0ffba2335031`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:03:53,610::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:03:53,610::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:03:53,610::task::990::TaskManager.Task::(_decref) Task=`7d7486cc-8d73-417d-8608-0ffba2335031`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:04:08,962::task::595::TaskManager.Task::(_updateState) Task=`4333455d-b8ea-492e-9794-c913fc3ce191`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:04:08,962::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:04:08,963::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:04:08,963::task::1185::TaskManager.Task::(prepare) Task=`4333455d-b8ea-492e-9794-c913fc3ce191`::finished: {} >Thread-15::DEBUG::2014-07-24 08:04:08,963::task::595::TaskManager.Task::(_updateState) Task=`4333455d-b8ea-492e-9794-c913fc3ce191`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:04:08,963::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:04:08,963::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:04:08,963::task::990::TaskManager.Task::(_decref) Task=`4333455d-b8ea-492e-9794-c913fc3ce191`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:04:24,613::task::595::TaskManager.Task::(_updateState) Task=`8f6e866f-c102-434c-9be8-880ffb81b6fa`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:04:24,613::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:04:24,613::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:04:24,614::task::1185::TaskManager.Task::(prepare) Task=`8f6e866f-c102-434c-9be8-880ffb81b6fa`::finished: {} >Thread-15::DEBUG::2014-07-24 08:04:24,614::task::595::TaskManager.Task::(_updateState) Task=`8f6e866f-c102-434c-9be8-880ffb81b6fa`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:04:24,614::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:04:24,614::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:04:24,614::task::990::TaskManager.Task::(_decref) Task=`8f6e866f-c102-434c-9be8-880ffb81b6fa`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:04:39,932::task::595::TaskManager.Task::(_updateState) Task=`3b918a42-194b-4a10-ac7d-e783a1efcb31`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:04:39,932::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:04:39,932::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:04:39,932::task::1185::TaskManager.Task::(prepare) Task=`3b918a42-194b-4a10-ac7d-e783a1efcb31`::finished: {} >Thread-15::DEBUG::2014-07-24 08:04:39,933::task::595::TaskManager.Task::(_updateState) Task=`3b918a42-194b-4a10-ac7d-e783a1efcb31`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:04:39,933::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:04:39,933::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:04:39,933::task::990::TaskManager.Task::(_decref) Task=`3b918a42-194b-4a10-ac7d-e783a1efcb31`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:04:55,251::task::595::TaskManager.Task::(_updateState) Task=`66396646-73ca-4c3d-89ad-14cf947a2123`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:04:55,251::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:04:55,252::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:04:55,252::task::1185::TaskManager.Task::(prepare) Task=`66396646-73ca-4c3d-89ad-14cf947a2123`::finished: {} >Thread-15::DEBUG::2014-07-24 08:04:55,252::task::595::TaskManager.Task::(_updateState) Task=`66396646-73ca-4c3d-89ad-14cf947a2123`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:04:55,252::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:04:55,252::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:04:55,252::task::990::TaskManager.Task::(_decref) Task=`66396646-73ca-4c3d-89ad-14cf947a2123`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:05:10,576::task::595::TaskManager.Task::(_updateState) Task=`6674fa66-b14e-4a47-91f0-3fdbc23e1efb`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:05:10,576::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:05:10,577::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:05:10,577::task::1185::TaskManager.Task::(prepare) Task=`6674fa66-b14e-4a47-91f0-3fdbc23e1efb`::finished: {} >Thread-15::DEBUG::2014-07-24 08:05:10,577::task::595::TaskManager.Task::(_updateState) Task=`6674fa66-b14e-4a47-91f0-3fdbc23e1efb`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:05:10,577::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:05:10,577::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:05:10,577::task::990::TaskManager.Task::(_decref) Task=`6674fa66-b14e-4a47-91f0-3fdbc23e1efb`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:05:25,895::task::595::TaskManager.Task::(_updateState) Task=`63a47375-4790-4e1e-80ac-4284c862ff74`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:05:25,895::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:05:25,895::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:05:25,895::task::1185::TaskManager.Task::(prepare) Task=`63a47375-4790-4e1e-80ac-4284c862ff74`::finished: {} >Thread-15::DEBUG::2014-07-24 08:05:25,896::task::595::TaskManager.Task::(_updateState) Task=`63a47375-4790-4e1e-80ac-4284c862ff74`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:05:25,896::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:05:25,896::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:05:25,896::task::990::TaskManager.Task::(_decref) Task=`63a47375-4790-4e1e-80ac-4284c862ff74`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:05:41,216::task::595::TaskManager.Task::(_updateState) Task=`2021ff8e-c7e4-410f-bad0-5114e7ff3ca1`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:05:41,217::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:05:41,217::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:05:41,217::task::1185::TaskManager.Task::(prepare) Task=`2021ff8e-c7e4-410f-bad0-5114e7ff3ca1`::finished: {} >Thread-15::DEBUG::2014-07-24 08:05:41,217::task::595::TaskManager.Task::(_updateState) Task=`2021ff8e-c7e4-410f-bad0-5114e7ff3ca1`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:05:41,217::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:05:41,217::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:05:41,218::task::990::TaskManager.Task::(_decref) Task=`2021ff8e-c7e4-410f-bad0-5114e7ff3ca1`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:05:56,576::task::595::TaskManager.Task::(_updateState) Task=`3069802c-771b-4e7c-86c6-b151ca96d549`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:05:56,576::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:05:56,576::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:05:56,577::task::1185::TaskManager.Task::(prepare) Task=`3069802c-771b-4e7c-86c6-b151ca96d549`::finished: {} >Thread-15::DEBUG::2014-07-24 08:05:56,577::task::595::TaskManager.Task::(_updateState) Task=`3069802c-771b-4e7c-86c6-b151ca96d549`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:05:56,577::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:05:56,577::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:05:56,577::task::990::TaskManager.Task::(_decref) Task=`3069802c-771b-4e7c-86c6-b151ca96d549`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:06:11,880::task::595::TaskManager.Task::(_updateState) Task=`385a05b3-3420-442d-87ad-e4922aac5aa2`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:06:11,880::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:06:11,880::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:06:11,880::task::1185::TaskManager.Task::(prepare) Task=`385a05b3-3420-442d-87ad-e4922aac5aa2`::finished: {} >Thread-15::DEBUG::2014-07-24 08:06:11,880::task::595::TaskManager.Task::(_updateState) Task=`385a05b3-3420-442d-87ad-e4922aac5aa2`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:06:11,881::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:06:11,881::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:06:11,881::task::990::TaskManager.Task::(_decref) Task=`385a05b3-3420-442d-87ad-e4922aac5aa2`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:06:27,211::task::595::TaskManager.Task::(_updateState) Task=`4848d2c1-53be-4cd0-b23c-f511bba3aa09`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:06:27,211::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:06:27,211::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:06:27,212::task::1185::TaskManager.Task::(prepare) Task=`4848d2c1-53be-4cd0-b23c-f511bba3aa09`::finished: {} >Thread-15::DEBUG::2014-07-24 08:06:27,212::task::595::TaskManager.Task::(_updateState) Task=`4848d2c1-53be-4cd0-b23c-f511bba3aa09`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:06:27,212::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:06:27,212::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:06:27,212::task::990::TaskManager.Task::(_decref) Task=`4848d2c1-53be-4cd0-b23c-f511bba3aa09`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:06:42,578::task::595::TaskManager.Task::(_updateState) Task=`7e59efeb-ba9b-4efb-8268-38c3a24942cb`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:06:42,579::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:06:42,579::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:06:42,579::task::1185::TaskManager.Task::(prepare) Task=`7e59efeb-ba9b-4efb-8268-38c3a24942cb`::finished: {} >Thread-15::DEBUG::2014-07-24 08:06:42,579::task::595::TaskManager.Task::(_updateState) Task=`7e59efeb-ba9b-4efb-8268-38c3a24942cb`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:06:42,579::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:06:42,579::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:06:42,580::task::990::TaskManager.Task::(_decref) Task=`7e59efeb-ba9b-4efb-8268-38c3a24942cb`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:06:57,920::task::595::TaskManager.Task::(_updateState) Task=`f5a028fd-da30-40a7-be94-856cbdd0b9c6`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:06:57,921::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:06:57,921::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:06:57,921::task::1185::TaskManager.Task::(prepare) Task=`f5a028fd-da30-40a7-be94-856cbdd0b9c6`::finished: {} >Thread-15::DEBUG::2014-07-24 08:06:57,921::task::595::TaskManager.Task::(_updateState) Task=`f5a028fd-da30-40a7-be94-856cbdd0b9c6`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:06:57,921::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:06:57,922::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:06:57,922::task::990::TaskManager.Task::(_decref) Task=`f5a028fd-da30-40a7-be94-856cbdd0b9c6`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:07:13,327::task::595::TaskManager.Task::(_updateState) Task=`e8381afd-9891-4076-a687-925cb723e464`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:07:13,327::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:07:13,327::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:07:13,328::task::1185::TaskManager.Task::(prepare) Task=`e8381afd-9891-4076-a687-925cb723e464`::finished: {} >Thread-15::DEBUG::2014-07-24 08:07:13,328::task::595::TaskManager.Task::(_updateState) Task=`e8381afd-9891-4076-a687-925cb723e464`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:07:13,328::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:07:13,328::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:07:13,328::task::990::TaskManager.Task::(_decref) Task=`e8381afd-9891-4076-a687-925cb723e464`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:07:28,668::task::595::TaskManager.Task::(_updateState) Task=`bca0f4a9-0b5c-4f7b-8568-30accf10baec`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:07:28,668::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:07:28,668::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:07:28,669::task::1185::TaskManager.Task::(prepare) Task=`bca0f4a9-0b5c-4f7b-8568-30accf10baec`::finished: {} >Thread-15::DEBUG::2014-07-24 08:07:28,669::task::595::TaskManager.Task::(_updateState) Task=`bca0f4a9-0b5c-4f7b-8568-30accf10baec`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:07:28,669::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:07:28,669::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:07:28,669::task::990::TaskManager.Task::(_decref) Task=`bca0f4a9-0b5c-4f7b-8568-30accf10baec`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:07:43,985::task::595::TaskManager.Task::(_updateState) Task=`83e5fbc0-7c71-4926-87ca-e8993c98def4`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:07:43,986::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:07:43,986::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:07:43,986::task::1185::TaskManager.Task::(prepare) Task=`83e5fbc0-7c71-4926-87ca-e8993c98def4`::finished: {} >Thread-15::DEBUG::2014-07-24 08:07:43,986::task::595::TaskManager.Task::(_updateState) Task=`83e5fbc0-7c71-4926-87ca-e8993c98def4`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:07:43,986::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:07:43,986::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:07:43,987::task::990::TaskManager.Task::(_decref) Task=`83e5fbc0-7c71-4926-87ca-e8993c98def4`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:07:59,362::task::595::TaskManager.Task::(_updateState) Task=`354e1477-53ef-4d3c-8904-95238207a2ad`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:07:59,363::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:07:59,363::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:07:59,363::task::1185::TaskManager.Task::(prepare) Task=`354e1477-53ef-4d3c-8904-95238207a2ad`::finished: {} >Thread-15::DEBUG::2014-07-24 08:07:59,363::task::595::TaskManager.Task::(_updateState) Task=`354e1477-53ef-4d3c-8904-95238207a2ad`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:07:59,363::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:07:59,363::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:07:59,364::task::990::TaskManager.Task::(_decref) Task=`354e1477-53ef-4d3c-8904-95238207a2ad`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:08:14,679::task::595::TaskManager.Task::(_updateState) Task=`bae94df5-4ce6-4be9-a738-35f4c5db8885`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:08:14,679::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:08:14,679::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:08:14,679::task::1185::TaskManager.Task::(prepare) Task=`bae94df5-4ce6-4be9-a738-35f4c5db8885`::finished: {} >Thread-15::DEBUG::2014-07-24 08:08:14,680::task::595::TaskManager.Task::(_updateState) Task=`bae94df5-4ce6-4be9-a738-35f4c5db8885`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:08:14,680::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:08:14,680::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:08:14,680::task::990::TaskManager.Task::(_decref) Task=`bae94df5-4ce6-4be9-a738-35f4c5db8885`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:08:30,093::task::595::TaskManager.Task::(_updateState) Task=`4405405d-00b7-436d-a4a3-d56ae00cb45a`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:08:30,093::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:08:30,093::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:08:30,093::task::1185::TaskManager.Task::(prepare) Task=`4405405d-00b7-436d-a4a3-d56ae00cb45a`::finished: {} >Thread-15::DEBUG::2014-07-24 08:08:30,093::task::595::TaskManager.Task::(_updateState) Task=`4405405d-00b7-436d-a4a3-d56ae00cb45a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:08:30,094::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:08:30,094::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:08:30,094::task::990::TaskManager.Task::(_decref) Task=`4405405d-00b7-436d-a4a3-d56ae00cb45a`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:08:45,496::task::595::TaskManager.Task::(_updateState) Task=`fbcba606-98e9-4427-8323-ce42490a356c`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:08:45,496::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:08:45,497::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:08:45,497::task::1185::TaskManager.Task::(prepare) Task=`fbcba606-98e9-4427-8323-ce42490a356c`::finished: {} >Thread-15::DEBUG::2014-07-24 08:08:45,497::task::595::TaskManager.Task::(_updateState) Task=`fbcba606-98e9-4427-8323-ce42490a356c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:08:45,497::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:08:45,497::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:08:45,497::task::990::TaskManager.Task::(_decref) Task=`fbcba606-98e9-4427-8323-ce42490a356c`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:09:01,025::task::595::TaskManager.Task::(_updateState) Task=`6fbbc502-b764-4f51-a835-89ad77211d37`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:09:01,025::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:09:01,025::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:09:01,025::task::1185::TaskManager.Task::(prepare) Task=`6fbbc502-b764-4f51-a835-89ad77211d37`::finished: {} >Thread-15::DEBUG::2014-07-24 08:09:01,025::task::595::TaskManager.Task::(_updateState) Task=`6fbbc502-b764-4f51-a835-89ad77211d37`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:09:01,026::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:09:01,026::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:09:01,026::task::990::TaskManager.Task::(_decref) Task=`6fbbc502-b764-4f51-a835-89ad77211d37`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:09:16,543::task::595::TaskManager.Task::(_updateState) Task=`665e6372-fe92-4365-a1b5-728266c56343`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:09:16,543::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:09:16,544::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:09:16,544::task::1185::TaskManager.Task::(prepare) Task=`665e6372-fe92-4365-a1b5-728266c56343`::finished: {} >Thread-15::DEBUG::2014-07-24 08:09:16,544::task::595::TaskManager.Task::(_updateState) Task=`665e6372-fe92-4365-a1b5-728266c56343`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:09:16,544::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:09:16,544::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:09:16,544::task::990::TaskManager.Task::(_decref) Task=`665e6372-fe92-4365-a1b5-728266c56343`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:09:32,490::task::595::TaskManager.Task::(_updateState) Task=`c5703a87-bd88-4789-969a-7f3bdcc105fc`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:09:32,490::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:09:32,490::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:09:32,490::task::1185::TaskManager.Task::(prepare) Task=`c5703a87-bd88-4789-969a-7f3bdcc105fc`::finished: {} >Thread-15::DEBUG::2014-07-24 08:09:32,490::task::595::TaskManager.Task::(_updateState) Task=`c5703a87-bd88-4789-969a-7f3bdcc105fc`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:09:32,491::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:09:32,491::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:09:32,491::task::990::TaskManager.Task::(_decref) Task=`c5703a87-bd88-4789-969a-7f3bdcc105fc`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:09:48,030::task::595::TaskManager.Task::(_updateState) Task=`1fee705d-6321-4501-bbb7-f8d5325bfa52`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:09:48,030::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:09:48,030::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:09:48,030::task::1185::TaskManager.Task::(prepare) Task=`1fee705d-6321-4501-bbb7-f8d5325bfa52`::finished: {} >Thread-15::DEBUG::2014-07-24 08:09:48,031::task::595::TaskManager.Task::(_updateState) Task=`1fee705d-6321-4501-bbb7-f8d5325bfa52`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:09:48,031::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:09:48,031::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:09:48,031::task::990::TaskManager.Task::(_decref) Task=`1fee705d-6321-4501-bbb7-f8d5325bfa52`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:10:03,564::task::595::TaskManager.Task::(_updateState) Task=`8ff033cc-d3f6-4b59-aad5-09af834bf833`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:10:03,564::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:10:03,564::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:10:03,565::task::1185::TaskManager.Task::(prepare) Task=`8ff033cc-d3f6-4b59-aad5-09af834bf833`::finished: {} >Thread-15::DEBUG::2014-07-24 08:10:03,565::task::595::TaskManager.Task::(_updateState) Task=`8ff033cc-d3f6-4b59-aad5-09af834bf833`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:10:03,565::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:10:03,565::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:10:03,565::task::990::TaskManager.Task::(_decref) Task=`8ff033cc-d3f6-4b59-aad5-09af834bf833`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:10:18,997::task::595::TaskManager.Task::(_updateState) Task=`1af32592-91c2-4005-ac5e-36054943a5d0`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:10:18,997::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:10:18,998::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:10:18,998::task::1185::TaskManager.Task::(prepare) Task=`1af32592-91c2-4005-ac5e-36054943a5d0`::finished: {} >Thread-15::DEBUG::2014-07-24 08:10:18,998::task::595::TaskManager.Task::(_updateState) Task=`1af32592-91c2-4005-ac5e-36054943a5d0`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:10:18,998::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:10:18,998::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:10:18,998::task::990::TaskManager.Task::(_decref) Task=`1af32592-91c2-4005-ac5e-36054943a5d0`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:10:34,322::task::595::TaskManager.Task::(_updateState) Task=`33ee8b72-5855-4b50-b389-b4123fe5db0a`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:10:34,323::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:10:34,323::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:10:34,323::task::1185::TaskManager.Task::(prepare) Task=`33ee8b72-5855-4b50-b389-b4123fe5db0a`::finished: {} >Thread-15::DEBUG::2014-07-24 08:10:34,323::task::595::TaskManager.Task::(_updateState) Task=`33ee8b72-5855-4b50-b389-b4123fe5db0a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:10:34,323::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:10:34,323::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:10:34,324::task::990::TaskManager.Task::(_decref) Task=`33ee8b72-5855-4b50-b389-b4123fe5db0a`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:10:49,712::task::595::TaskManager.Task::(_updateState) Task=`95ee778b-adf6-4f38-aca4-613c76826704`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:10:49,713::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:10:49,713::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:10:49,713::task::1185::TaskManager.Task::(prepare) Task=`95ee778b-adf6-4f38-aca4-613c76826704`::finished: {} >Thread-15::DEBUG::2014-07-24 08:10:49,713::task::595::TaskManager.Task::(_updateState) Task=`95ee778b-adf6-4f38-aca4-613c76826704`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:10:49,713::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:10:49,714::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:10:49,714::task::990::TaskManager.Task::(_decref) Task=`95ee778b-adf6-4f38-aca4-613c76826704`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:11:05,139::task::595::TaskManager.Task::(_updateState) Task=`74573edf-c363-4c62-ad21-c9a2d25b4990`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:11:05,140::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:11:05,140::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:11:05,140::task::1185::TaskManager.Task::(prepare) Task=`74573edf-c363-4c62-ad21-c9a2d25b4990`::finished: {} >Thread-15::DEBUG::2014-07-24 08:11:05,140::task::595::TaskManager.Task::(_updateState) Task=`74573edf-c363-4c62-ad21-c9a2d25b4990`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:11:05,140::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:11:05,140::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:11:05,140::task::990::TaskManager.Task::(_decref) Task=`74573edf-c363-4c62-ad21-c9a2d25b4990`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:11:20,461::task::595::TaskManager.Task::(_updateState) Task=`e833ba3e-e0d8-4620-8711-278166e8e6bd`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:11:20,462::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:11:20,462::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:11:20,462::task::1185::TaskManager.Task::(prepare) Task=`e833ba3e-e0d8-4620-8711-278166e8e6bd`::finished: {} >Thread-15::DEBUG::2014-07-24 08:11:20,462::task::595::TaskManager.Task::(_updateState) Task=`e833ba3e-e0d8-4620-8711-278166e8e6bd`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:11:20,462::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:11:20,463::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:11:20,463::task::990::TaskManager.Task::(_decref) Task=`e833ba3e-e0d8-4620-8711-278166e8e6bd`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:11:35,771::task::595::TaskManager.Task::(_updateState) Task=`05d11877-6008-4eb9-b5f2-a9d93ca9ba22`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:11:35,771::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:11:35,772::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:11:35,772::task::1185::TaskManager.Task::(prepare) Task=`05d11877-6008-4eb9-b5f2-a9d93ca9ba22`::finished: {} >Thread-15::DEBUG::2014-07-24 08:11:35,772::task::595::TaskManager.Task::(_updateState) Task=`05d11877-6008-4eb9-b5f2-a9d93ca9ba22`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:11:35,772::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:11:35,772::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:11:35,772::task::990::TaskManager.Task::(_decref) Task=`05d11877-6008-4eb9-b5f2-a9d93ca9ba22`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:11:51,111::task::595::TaskManager.Task::(_updateState) Task=`d549a359-7cd7-4dfe-8bc4-7a24ebf0c142`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:11:51,112::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:11:51,112::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:11:51,112::task::1185::TaskManager.Task::(prepare) Task=`d549a359-7cd7-4dfe-8bc4-7a24ebf0c142`::finished: {} >Thread-15::DEBUG::2014-07-24 08:11:51,112::task::595::TaskManager.Task::(_updateState) Task=`d549a359-7cd7-4dfe-8bc4-7a24ebf0c142`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:11:51,112::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:11:51,112::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:11:51,113::task::990::TaskManager.Task::(_decref) Task=`d549a359-7cd7-4dfe-8bc4-7a24ebf0c142`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:12:06,512::task::595::TaskManager.Task::(_updateState) Task=`587e8ac7-7b88-4d94-bd55-b2e4de84c67a`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:12:06,512::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:12:06,513::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:12:06,513::task::1185::TaskManager.Task::(prepare) Task=`587e8ac7-7b88-4d94-bd55-b2e4de84c67a`::finished: {} >Thread-15::DEBUG::2014-07-24 08:12:06,513::task::595::TaskManager.Task::(_updateState) Task=`587e8ac7-7b88-4d94-bd55-b2e4de84c67a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:12:06,513::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:12:06,513::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:12:06,513::task::990::TaskManager.Task::(_decref) Task=`587e8ac7-7b88-4d94-bd55-b2e4de84c67a`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:12:21,903::task::595::TaskManager.Task::(_updateState) Task=`3bd4fa86-a6c5-45a1-939d-8b85a4bb426d`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:12:21,904::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:12:21,904::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:12:21,904::task::1185::TaskManager.Task::(prepare) Task=`3bd4fa86-a6c5-45a1-939d-8b85a4bb426d`::finished: {} >Thread-15::DEBUG::2014-07-24 08:12:21,904::task::595::TaskManager.Task::(_updateState) Task=`3bd4fa86-a6c5-45a1-939d-8b85a4bb426d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:12:21,904::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:12:21,905::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:12:21,905::task::990::TaskManager.Task::(_decref) Task=`3bd4fa86-a6c5-45a1-939d-8b85a4bb426d`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:12:37,264::task::595::TaskManager.Task::(_updateState) Task=`06272610-bbf0-474b-9509-a11c74ea709d`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:12:37,264::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:12:37,264::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:12:37,264::task::1185::TaskManager.Task::(prepare) Task=`06272610-bbf0-474b-9509-a11c74ea709d`::finished: {} >Thread-15::DEBUG::2014-07-24 08:12:37,265::task::595::TaskManager.Task::(_updateState) Task=`06272610-bbf0-474b-9509-a11c74ea709d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:12:37,265::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:12:37,265::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:12:37,265::task::990::TaskManager.Task::(_decref) Task=`06272610-bbf0-474b-9509-a11c74ea709d`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:12:52,596::task::595::TaskManager.Task::(_updateState) Task=`d5a903fd-84b2-4c4c-8b70-263b3186ea37`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:12:52,596::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:12:52,596::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:12:52,596::task::1185::TaskManager.Task::(prepare) Task=`d5a903fd-84b2-4c4c-8b70-263b3186ea37`::finished: {} >Thread-15::DEBUG::2014-07-24 08:12:52,597::task::595::TaskManager.Task::(_updateState) Task=`d5a903fd-84b2-4c4c-8b70-263b3186ea37`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:12:52,597::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:12:52,597::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:12:52,597::task::990::TaskManager.Task::(_decref) Task=`d5a903fd-84b2-4c4c-8b70-263b3186ea37`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:13:07,974::task::595::TaskManager.Task::(_updateState) Task=`8ed0fccd-b426-4b54-8372-70d3fc43011e`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:13:07,974::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:13:07,974::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:13:07,974::task::1185::TaskManager.Task::(prepare) Task=`8ed0fccd-b426-4b54-8372-70d3fc43011e`::finished: {} >Thread-15::DEBUG::2014-07-24 08:13:07,975::task::595::TaskManager.Task::(_updateState) Task=`8ed0fccd-b426-4b54-8372-70d3fc43011e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:13:07,975::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:13:07,975::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:13:07,975::task::990::TaskManager.Task::(_decref) Task=`8ed0fccd-b426-4b54-8372-70d3fc43011e`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:13:23,438::task::595::TaskManager.Task::(_updateState) Task=`8ee46761-d80a-406d-a079-54cf299f72ca`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:13:23,438::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:13:23,438::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:13:23,438::task::1185::TaskManager.Task::(prepare) Task=`8ee46761-d80a-406d-a079-54cf299f72ca`::finished: {} >Thread-15::DEBUG::2014-07-24 08:13:23,439::task::595::TaskManager.Task::(_updateState) Task=`8ee46761-d80a-406d-a079-54cf299f72ca`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:13:23,439::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:13:23,439::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:13:23,439::task::990::TaskManager.Task::(_decref) Task=`8ee46761-d80a-406d-a079-54cf299f72ca`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:13:38,789::task::595::TaskManager.Task::(_updateState) Task=`79dfad89-9542-4568-99ea-ce378559986f`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:13:38,789::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:13:38,789::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:13:38,789::task::1185::TaskManager.Task::(prepare) Task=`79dfad89-9542-4568-99ea-ce378559986f`::finished: {} >Thread-15::DEBUG::2014-07-24 08:13:38,789::task::595::TaskManager.Task::(_updateState) Task=`79dfad89-9542-4568-99ea-ce378559986f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:13:38,790::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:13:38,790::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:13:38,790::task::990::TaskManager.Task::(_decref) Task=`79dfad89-9542-4568-99ea-ce378559986f`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:13:54,151::task::595::TaskManager.Task::(_updateState) Task=`40486297-7c84-4186-b763-60e6dc823fbc`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:13:54,151::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:13:54,152::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:13:54,152::task::1185::TaskManager.Task::(prepare) Task=`40486297-7c84-4186-b763-60e6dc823fbc`::finished: {} >Thread-15::DEBUG::2014-07-24 08:13:54,152::task::595::TaskManager.Task::(_updateState) Task=`40486297-7c84-4186-b763-60e6dc823fbc`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:13:54,152::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:13:54,152::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:13:54,152::task::990::TaskManager.Task::(_decref) Task=`40486297-7c84-4186-b763-60e6dc823fbc`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:14:09,460::task::595::TaskManager.Task::(_updateState) Task=`6fe8c100-d44c-4c12-b663-7c9cced03b87`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:14:09,460::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:14:09,461::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:14:09,461::task::1185::TaskManager.Task::(prepare) Task=`6fe8c100-d44c-4c12-b663-7c9cced03b87`::finished: {} >Thread-15::DEBUG::2014-07-24 08:14:09,461::task::595::TaskManager.Task::(_updateState) Task=`6fe8c100-d44c-4c12-b663-7c9cced03b87`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:14:09,461::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:14:09,461::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:14:09,461::task::990::TaskManager.Task::(_decref) Task=`6fe8c100-d44c-4c12-b663-7c9cced03b87`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:14:25,101::task::595::TaskManager.Task::(_updateState) Task=`ec931447-e643-44a2-998b-e6a936ebd305`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:14:25,102::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:14:25,102::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:14:25,102::task::1185::TaskManager.Task::(prepare) Task=`ec931447-e643-44a2-998b-e6a936ebd305`::finished: {} >Thread-15::DEBUG::2014-07-24 08:14:25,102::task::595::TaskManager.Task::(_updateState) Task=`ec931447-e643-44a2-998b-e6a936ebd305`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:14:25,102::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:14:25,102::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:14:25,102::task::990::TaskManager.Task::(_decref) Task=`ec931447-e643-44a2-998b-e6a936ebd305`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:14:40,403::task::595::TaskManager.Task::(_updateState) Task=`efc9d770-56c8-4c3c-916d-8bab6cda622f`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:14:40,403::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:14:40,403::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:14:40,403::task::1185::TaskManager.Task::(prepare) Task=`efc9d770-56c8-4c3c-916d-8bab6cda622f`::finished: {} >Thread-15::DEBUG::2014-07-24 08:14:40,404::task::595::TaskManager.Task::(_updateState) Task=`efc9d770-56c8-4c3c-916d-8bab6cda622f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:14:40,404::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:14:40,404::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:14:40,404::task::990::TaskManager.Task::(_decref) Task=`efc9d770-56c8-4c3c-916d-8bab6cda622f`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:14:55,737::task::595::TaskManager.Task::(_updateState) Task=`7c26b713-aa4b-402b-977a-8557f1df6822`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:14:55,737::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:14:55,737::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:14:55,737::task::1185::TaskManager.Task::(prepare) Task=`7c26b713-aa4b-402b-977a-8557f1df6822`::finished: {} >Thread-15::DEBUG::2014-07-24 08:14:55,737::task::595::TaskManager.Task::(_updateState) Task=`7c26b713-aa4b-402b-977a-8557f1df6822`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:14:55,738::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:14:55,738::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:14:55,738::task::990::TaskManager.Task::(_decref) Task=`7c26b713-aa4b-402b-977a-8557f1df6822`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:15:11,148::task::595::TaskManager.Task::(_updateState) Task=`8e8b9d51-4a95-464c-bae9-47868b6aa341`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:15:11,148::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:15:11,148::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:15:11,149::task::1185::TaskManager.Task::(prepare) Task=`8e8b9d51-4a95-464c-bae9-47868b6aa341`::finished: {} >Thread-15::DEBUG::2014-07-24 08:15:11,149::task::595::TaskManager.Task::(_updateState) Task=`8e8b9d51-4a95-464c-bae9-47868b6aa341`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:15:11,149::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:15:11,149::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:15:11,149::task::990::TaskManager.Task::(_decref) Task=`8e8b9d51-4a95-464c-bae9-47868b6aa341`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:15:26,466::task::595::TaskManager.Task::(_updateState) Task=`eb8d8eed-b0fb-41ce-8ca5-00fd5191647d`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:15:26,467::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:15:26,467::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:15:26,467::task::1185::TaskManager.Task::(prepare) Task=`eb8d8eed-b0fb-41ce-8ca5-00fd5191647d`::finished: {} >Thread-15::DEBUG::2014-07-24 08:15:26,467::task::595::TaskManager.Task::(_updateState) Task=`eb8d8eed-b0fb-41ce-8ca5-00fd5191647d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:15:26,467::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:15:26,467::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:15:26,468::task::990::TaskManager.Task::(_decref) Task=`eb8d8eed-b0fb-41ce-8ca5-00fd5191647d`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:15:41,792::task::595::TaskManager.Task::(_updateState) Task=`9689e286-daa0-4567-ae10-efa700e9583d`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:15:41,792::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:15:41,792::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:15:41,792::task::1185::TaskManager.Task::(prepare) Task=`9689e286-daa0-4567-ae10-efa700e9583d`::finished: {} >Thread-15::DEBUG::2014-07-24 08:15:41,793::task::595::TaskManager.Task::(_updateState) Task=`9689e286-daa0-4567-ae10-efa700e9583d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:15:41,793::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:15:41,793::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:15:41,793::task::990::TaskManager.Task::(_decref) Task=`9689e286-daa0-4567-ae10-efa700e9583d`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:15:57,107::task::595::TaskManager.Task::(_updateState) Task=`0308b97f-2b55-4a26-b500-5c3755d321e5`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:15:57,107::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:15:57,108::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:15:57,108::task::1185::TaskManager.Task::(prepare) Task=`0308b97f-2b55-4a26-b500-5c3755d321e5`::finished: {} >Thread-15::DEBUG::2014-07-24 08:15:57,108::task::595::TaskManager.Task::(_updateState) Task=`0308b97f-2b55-4a26-b500-5c3755d321e5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:15:57,108::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:15:57,108::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:15:57,108::task::990::TaskManager.Task::(_decref) Task=`0308b97f-2b55-4a26-b500-5c3755d321e5`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:16:12,452::task::595::TaskManager.Task::(_updateState) Task=`2fd4dc93-4511-4721-b8c8-00f0a8a01cc1`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:16:12,452::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:16:12,452::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:16:12,452::task::1185::TaskManager.Task::(prepare) Task=`2fd4dc93-4511-4721-b8c8-00f0a8a01cc1`::finished: {} >Thread-15::DEBUG::2014-07-24 08:16:12,452::task::595::TaskManager.Task::(_updateState) Task=`2fd4dc93-4511-4721-b8c8-00f0a8a01cc1`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:16:12,453::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:16:12,453::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:16:12,453::task::990::TaskManager.Task::(_decref) Task=`2fd4dc93-4511-4721-b8c8-00f0a8a01cc1`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:16:27,759::task::595::TaskManager.Task::(_updateState) Task=`72d3ce2a-b397-4e32-b8ab-8318ffc7e22f`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:16:27,759::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:16:27,760::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:16:27,760::task::1185::TaskManager.Task::(prepare) Task=`72d3ce2a-b397-4e32-b8ab-8318ffc7e22f`::finished: {} >Thread-15::DEBUG::2014-07-24 08:16:27,760::task::595::TaskManager.Task::(_updateState) Task=`72d3ce2a-b397-4e32-b8ab-8318ffc7e22f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:16:27,760::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:16:27,760::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:16:27,760::task::990::TaskManager.Task::(_decref) Task=`72d3ce2a-b397-4e32-b8ab-8318ffc7e22f`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:16:43,130::task::595::TaskManager.Task::(_updateState) Task=`97080d77-cb0b-4e4f-9f56-158666468eae`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:16:43,130::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:16:43,130::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:16:43,130::task::1185::TaskManager.Task::(prepare) Task=`97080d77-cb0b-4e4f-9f56-158666468eae`::finished: {} >Thread-15::DEBUG::2014-07-24 08:16:43,130::task::595::TaskManager.Task::(_updateState) Task=`97080d77-cb0b-4e4f-9f56-158666468eae`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:16:43,131::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:16:43,131::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:16:43,131::task::990::TaskManager.Task::(_decref) Task=`97080d77-cb0b-4e4f-9f56-158666468eae`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:16:58,484::task::595::TaskManager.Task::(_updateState) Task=`a53e552c-a726-4236-9f3b-2fef42d4aaf2`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:16:58,485::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:16:58,485::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:16:58,485::task::1185::TaskManager.Task::(prepare) Task=`a53e552c-a726-4236-9f3b-2fef42d4aaf2`::finished: {} >Thread-15::DEBUG::2014-07-24 08:16:58,485::task::595::TaskManager.Task::(_updateState) Task=`a53e552c-a726-4236-9f3b-2fef42d4aaf2`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:16:58,485::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:16:58,486::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:16:58,486::task::990::TaskManager.Task::(_decref) Task=`a53e552c-a726-4236-9f3b-2fef42d4aaf2`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:17:13,799::task::595::TaskManager.Task::(_updateState) Task=`f529dae3-6c4d-498e-a70a-6319c29ff1f9`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:17:13,799::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:17:13,799::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:17:13,799::task::1185::TaskManager.Task::(prepare) Task=`f529dae3-6c4d-498e-a70a-6319c29ff1f9`::finished: {} >Thread-15::DEBUG::2014-07-24 08:17:13,799::task::595::TaskManager.Task::(_updateState) Task=`f529dae3-6c4d-498e-a70a-6319c29ff1f9`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:17:13,800::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:17:13,800::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:17:13,800::task::990::TaskManager.Task::(_decref) Task=`f529dae3-6c4d-498e-a70a-6319c29ff1f9`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:17:29,118::task::595::TaskManager.Task::(_updateState) Task=`e21e979a-8fff-4c99-a487-8caf1565afd6`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:17:29,119::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:17:29,119::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:17:29,119::task::1185::TaskManager.Task::(prepare) Task=`e21e979a-8fff-4c99-a487-8caf1565afd6`::finished: {} >Thread-15::DEBUG::2014-07-24 08:17:29,119::task::595::TaskManager.Task::(_updateState) Task=`e21e979a-8fff-4c99-a487-8caf1565afd6`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:17:29,119::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:17:29,120::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:17:29,120::task::990::TaskManager.Task::(_decref) Task=`e21e979a-8fff-4c99-a487-8caf1565afd6`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:17:44,435::task::595::TaskManager.Task::(_updateState) Task=`bfc8ffae-fbb9-430f-b239-f13ba3b72573`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:17:44,435::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:17:44,436::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:17:44,436::task::1185::TaskManager.Task::(prepare) Task=`bfc8ffae-fbb9-430f-b239-f13ba3b72573`::finished: {} >Thread-15::DEBUG::2014-07-24 08:17:44,436::task::595::TaskManager.Task::(_updateState) Task=`bfc8ffae-fbb9-430f-b239-f13ba3b72573`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:17:44,436::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:17:44,436::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:17:44,436::task::990::TaskManager.Task::(_decref) Task=`bfc8ffae-fbb9-430f-b239-f13ba3b72573`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:17:59,817::task::595::TaskManager.Task::(_updateState) Task=`36022c22-5f31-4996-8c51-34c6ce1c6e3b`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:17:59,817::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:17:59,817::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:17:59,818::task::1185::TaskManager.Task::(prepare) Task=`36022c22-5f31-4996-8c51-34c6ce1c6e3b`::finished: {} >Thread-15::DEBUG::2014-07-24 08:17:59,818::task::595::TaskManager.Task::(_updateState) Task=`36022c22-5f31-4996-8c51-34c6ce1c6e3b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:17:59,818::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:17:59,818::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:17:59,818::task::990::TaskManager.Task::(_decref) Task=`36022c22-5f31-4996-8c51-34c6ce1c6e3b`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:18:15,143::task::595::TaskManager.Task::(_updateState) Task=`cbdce8a0-82f2-48e6-bf2b-57ce1051761f`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:18:15,143::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:18:15,144::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:18:15,144::task::1185::TaskManager.Task::(prepare) Task=`cbdce8a0-82f2-48e6-bf2b-57ce1051761f`::finished: {} >Thread-15::DEBUG::2014-07-24 08:18:15,144::task::595::TaskManager.Task::(_updateState) Task=`cbdce8a0-82f2-48e6-bf2b-57ce1051761f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:18:15,144::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:18:15,144::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:18:15,144::task::990::TaskManager.Task::(_decref) Task=`cbdce8a0-82f2-48e6-bf2b-57ce1051761f`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:18:30,559::task::595::TaskManager.Task::(_updateState) Task=`9bdd7577-2f57-4a42-a106-4c7bb02bd676`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:18:30,559::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:18:30,560::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:18:30,560::task::1185::TaskManager.Task::(prepare) Task=`9bdd7577-2f57-4a42-a106-4c7bb02bd676`::finished: {} >Thread-15::DEBUG::2014-07-24 08:18:30,560::task::595::TaskManager.Task::(_updateState) Task=`9bdd7577-2f57-4a42-a106-4c7bb02bd676`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:18:30,560::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:18:30,560::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:18:30,560::task::990::TaskManager.Task::(_decref) Task=`9bdd7577-2f57-4a42-a106-4c7bb02bd676`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:18:45,868::task::595::TaskManager.Task::(_updateState) Task=`60a4a3e1-a4fd-4441-b47c-4efc1a9d6a7d`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:18:45,869::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:18:45,869::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:18:45,869::task::1185::TaskManager.Task::(prepare) Task=`60a4a3e1-a4fd-4441-b47c-4efc1a9d6a7d`::finished: {} >Thread-15::DEBUG::2014-07-24 08:18:45,869::task::595::TaskManager.Task::(_updateState) Task=`60a4a3e1-a4fd-4441-b47c-4efc1a9d6a7d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:18:45,869::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:18:45,870::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:18:45,870::task::990::TaskManager.Task::(_decref) Task=`60a4a3e1-a4fd-4441-b47c-4efc1a9d6a7d`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:19:01,197::task::595::TaskManager.Task::(_updateState) Task=`1626cce2-329f-4def-9e9b-9b2453141479`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:19:01,197::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:19:01,197::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:19:01,197::task::1185::TaskManager.Task::(prepare) Task=`1626cce2-329f-4def-9e9b-9b2453141479`::finished: {} >Thread-15::DEBUG::2014-07-24 08:19:01,197::task::595::TaskManager.Task::(_updateState) Task=`1626cce2-329f-4def-9e9b-9b2453141479`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:19:01,197::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:19:01,198::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:19:01,198::task::990::TaskManager.Task::(_decref) Task=`1626cce2-329f-4def-9e9b-9b2453141479`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:19:16,588::task::595::TaskManager.Task::(_updateState) Task=`60082f62-d928-4f26-9c67-eee8f74994e0`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:19:16,588::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:19:16,588::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:19:16,588::task::1185::TaskManager.Task::(prepare) Task=`60082f62-d928-4f26-9c67-eee8f74994e0`::finished: {} >Thread-15::DEBUG::2014-07-24 08:19:16,589::task::595::TaskManager.Task::(_updateState) Task=`60082f62-d928-4f26-9c67-eee8f74994e0`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:19:16,589::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:19:16,589::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:19:16,589::task::990::TaskManager.Task::(_decref) Task=`60082f62-d928-4f26-9c67-eee8f74994e0`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:19:32,259::task::595::TaskManager.Task::(_updateState) Task=`eb606a71-725e-4677-84e1-f0f5e493c69d`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:19:32,259::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:19:32,260::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:19:32,260::task::1185::TaskManager.Task::(prepare) Task=`eb606a71-725e-4677-84e1-f0f5e493c69d`::finished: {} >Thread-15::DEBUG::2014-07-24 08:19:32,260::task::595::TaskManager.Task::(_updateState) Task=`eb606a71-725e-4677-84e1-f0f5e493c69d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:19:32,260::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:19:32,260::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:19:32,260::task::990::TaskManager.Task::(_decref) Task=`eb606a71-725e-4677-84e1-f0f5e493c69d`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:19:47,621::task::595::TaskManager.Task::(_updateState) Task=`c76d9c81-2c41-4468-92da-c33d183005aa`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:19:47,621::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:19:47,621::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:19:47,621::task::1185::TaskManager.Task::(prepare) Task=`c76d9c81-2c41-4468-92da-c33d183005aa`::finished: {} >Thread-15::DEBUG::2014-07-24 08:19:47,621::task::595::TaskManager.Task::(_updateState) Task=`c76d9c81-2c41-4468-92da-c33d183005aa`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:19:47,622::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:19:47,622::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:19:47,622::task::990::TaskManager.Task::(_decref) Task=`c76d9c81-2c41-4468-92da-c33d183005aa`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:20:02,936::task::595::TaskManager.Task::(_updateState) Task=`6fe0ea86-b7f4-4e7d-82cb-76dc4d37ab3f`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:20:02,937::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:20:02,937::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:20:02,937::task::1185::TaskManager.Task::(prepare) Task=`6fe0ea86-b7f4-4e7d-82cb-76dc4d37ab3f`::finished: {} >Thread-15::DEBUG::2014-07-24 08:20:02,937::task::595::TaskManager.Task::(_updateState) Task=`6fe0ea86-b7f4-4e7d-82cb-76dc4d37ab3f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:20:02,937::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:20:02,937::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:20:02,938::task::990::TaskManager.Task::(_decref) Task=`6fe0ea86-b7f4-4e7d-82cb-76dc4d37ab3f`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:20:18,271::task::595::TaskManager.Task::(_updateState) Task=`33f3507e-7424-4dbe-aad4-cb154886713b`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:20:18,271::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:20:18,271::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:20:18,271::task::1185::TaskManager.Task::(prepare) Task=`33f3507e-7424-4dbe-aad4-cb154886713b`::finished: {} >Thread-15::DEBUG::2014-07-24 08:20:18,272::task::595::TaskManager.Task::(_updateState) Task=`33f3507e-7424-4dbe-aad4-cb154886713b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:20:18,272::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:20:18,272::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:20:18,272::task::990::TaskManager.Task::(_decref) Task=`33f3507e-7424-4dbe-aad4-cb154886713b`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:20:33,648::task::595::TaskManager.Task::(_updateState) Task=`e32db31d-2b68-4501-b038-182c98faa848`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:20:33,649::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:20:33,649::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:20:33,649::task::1185::TaskManager.Task::(prepare) Task=`e32db31d-2b68-4501-b038-182c98faa848`::finished: {} >Thread-15::DEBUG::2014-07-24 08:20:33,649::task::595::TaskManager.Task::(_updateState) Task=`e32db31d-2b68-4501-b038-182c98faa848`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:20:33,649::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:20:33,649::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:20:33,650::task::990::TaskManager.Task::(_decref) Task=`e32db31d-2b68-4501-b038-182c98faa848`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:20:48,988::task::595::TaskManager.Task::(_updateState) Task=`7b7c12cd-e81d-432f-a5ab-2454d98f792f`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:20:48,988::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:20:48,988::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:20:48,988::task::1185::TaskManager.Task::(prepare) Task=`7b7c12cd-e81d-432f-a5ab-2454d98f792f`::finished: {} >Thread-15::DEBUG::2014-07-24 08:20:48,988::task::595::TaskManager.Task::(_updateState) Task=`7b7c12cd-e81d-432f-a5ab-2454d98f792f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:20:48,989::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:20:48,989::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:20:48,989::task::990::TaskManager.Task::(_decref) Task=`7b7c12cd-e81d-432f-a5ab-2454d98f792f`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:21:04,316::task::595::TaskManager.Task::(_updateState) Task=`2950d978-053f-4c48-892f-2cebfaffcf46`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:21:04,317::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:21:04,317::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:21:04,317::task::1185::TaskManager.Task::(prepare) Task=`2950d978-053f-4c48-892f-2cebfaffcf46`::finished: {} >Thread-15::DEBUG::2014-07-24 08:21:04,317::task::595::TaskManager.Task::(_updateState) Task=`2950d978-053f-4c48-892f-2cebfaffcf46`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:21:04,317::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:21:04,317::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:21:04,317::task::990::TaskManager.Task::(_decref) Task=`2950d978-053f-4c48-892f-2cebfaffcf46`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:21:19,661::task::595::TaskManager.Task::(_updateState) Task=`9ea85eaa-8fd2-4f9d-898d-b80eefc7fb19`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:21:19,661::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:21:19,661::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:21:19,661::task::1185::TaskManager.Task::(prepare) Task=`9ea85eaa-8fd2-4f9d-898d-b80eefc7fb19`::finished: {} >Thread-15::DEBUG::2014-07-24 08:21:19,662::task::595::TaskManager.Task::(_updateState) Task=`9ea85eaa-8fd2-4f9d-898d-b80eefc7fb19`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:21:19,662::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:21:19,662::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:21:19,662::task::990::TaskManager.Task::(_decref) Task=`9ea85eaa-8fd2-4f9d-898d-b80eefc7fb19`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:21:35,014::task::595::TaskManager.Task::(_updateState) Task=`1313fdf0-832f-49cc-965b-80be945c66b8`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:21:35,014::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:21:35,015::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:21:35,015::task::1185::TaskManager.Task::(prepare) Task=`1313fdf0-832f-49cc-965b-80be945c66b8`::finished: {} >Thread-15::DEBUG::2014-07-24 08:21:35,015::task::595::TaskManager.Task::(_updateState) Task=`1313fdf0-832f-49cc-965b-80be945c66b8`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:21:35,015::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:21:35,015::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:21:35,015::task::990::TaskManager.Task::(_decref) Task=`1313fdf0-832f-49cc-965b-80be945c66b8`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:21:50,311::task::595::TaskManager.Task::(_updateState) Task=`43d6dd5e-c372-4139-a696-98ab253dd773`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:21:50,311::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:21:50,311::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:21:50,311::task::1185::TaskManager.Task::(prepare) Task=`43d6dd5e-c372-4139-a696-98ab253dd773`::finished: {} >Thread-15::DEBUG::2014-07-24 08:21:50,312::task::595::TaskManager.Task::(_updateState) Task=`43d6dd5e-c372-4139-a696-98ab253dd773`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:21:50,312::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:21:50,312::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:21:50,312::task::990::TaskManager.Task::(_decref) Task=`43d6dd5e-c372-4139-a696-98ab253dd773`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:22:05,613::task::595::TaskManager.Task::(_updateState) Task=`a67af466-6c9a-42cb-9154-a215d200388e`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:22:05,613::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:22:05,614::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:22:05,614::task::1185::TaskManager.Task::(prepare) Task=`a67af466-6c9a-42cb-9154-a215d200388e`::finished: {} >Thread-15::DEBUG::2014-07-24 08:22:05,614::task::595::TaskManager.Task::(_updateState) Task=`a67af466-6c9a-42cb-9154-a215d200388e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:22:05,614::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:22:05,614::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:22:05,614::task::990::TaskManager.Task::(_decref) Task=`a67af466-6c9a-42cb-9154-a215d200388e`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:22:21,049::task::595::TaskManager.Task::(_updateState) Task=`802472e9-a17c-4a9c-82a0-585161c6d4ad`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:22:21,050::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:22:21,050::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:22:21,050::task::1185::TaskManager.Task::(prepare) Task=`802472e9-a17c-4a9c-82a0-585161c6d4ad`::finished: {} >Thread-15::DEBUG::2014-07-24 08:22:21,050::task::595::TaskManager.Task::(_updateState) Task=`802472e9-a17c-4a9c-82a0-585161c6d4ad`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:22:21,050::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:22:21,050::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:22:21,051::task::990::TaskManager.Task::(_decref) Task=`802472e9-a17c-4a9c-82a0-585161c6d4ad`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:22:36,533::task::595::TaskManager.Task::(_updateState) Task=`06c6bed4-f138-4228-b7ad-86b12cc296ad`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:22:36,533::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:22:36,533::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:22:36,533::task::1185::TaskManager.Task::(prepare) Task=`06c6bed4-f138-4228-b7ad-86b12cc296ad`::finished: {} >Thread-15::DEBUG::2014-07-24 08:22:36,533::task::595::TaskManager.Task::(_updateState) Task=`06c6bed4-f138-4228-b7ad-86b12cc296ad`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:22:36,534::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:22:36,534::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:22:36,534::task::990::TaskManager.Task::(_decref) Task=`06c6bed4-f138-4228-b7ad-86b12cc296ad`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:22:51,980::task::595::TaskManager.Task::(_updateState) Task=`2210e227-d353-4a2f-b7f0-8e6e8f8e5c25`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:22:51,980::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:22:51,980::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:22:51,980::task::1185::TaskManager.Task::(prepare) Task=`2210e227-d353-4a2f-b7f0-8e6e8f8e5c25`::finished: {} >Thread-15::DEBUG::2014-07-24 08:22:51,980::task::595::TaskManager.Task::(_updateState) Task=`2210e227-d353-4a2f-b7f0-8e6e8f8e5c25`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:22:51,981::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:22:51,981::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:22:51,981::task::990::TaskManager.Task::(_decref) Task=`2210e227-d353-4a2f-b7f0-8e6e8f8e5c25`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:23:07,505::task::595::TaskManager.Task::(_updateState) Task=`dfe5f549-498e-49ce-bc19-564abe13bd54`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:23:07,505::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:23:07,506::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:23:07,506::task::1185::TaskManager.Task::(prepare) Task=`dfe5f549-498e-49ce-bc19-564abe13bd54`::finished: {} >Thread-15::DEBUG::2014-07-24 08:23:07,506::task::595::TaskManager.Task::(_updateState) Task=`dfe5f549-498e-49ce-bc19-564abe13bd54`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:23:07,506::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:23:07,506::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:23:07,506::task::990::TaskManager.Task::(_decref) Task=`dfe5f549-498e-49ce-bc19-564abe13bd54`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:23:22,970::task::595::TaskManager.Task::(_updateState) Task=`126a115c-c021-4714-a10e-20bd920ac2be`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:23:22,970::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:23:22,970::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:23:22,970::task::1185::TaskManager.Task::(prepare) Task=`126a115c-c021-4714-a10e-20bd920ac2be`::finished: {} >Thread-15::DEBUG::2014-07-24 08:23:22,970::task::595::TaskManager.Task::(_updateState) Task=`126a115c-c021-4714-a10e-20bd920ac2be`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:23:22,971::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:23:22,971::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:23:22,971::task::990::TaskManager.Task::(_decref) Task=`126a115c-c021-4714-a10e-20bd920ac2be`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:23:38,414::task::595::TaskManager.Task::(_updateState) Task=`567c7b48-340f-4187-a311-3f5f460b67db`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:23:38,414::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:23:38,414::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:23:38,414::task::1185::TaskManager.Task::(prepare) Task=`567c7b48-340f-4187-a311-3f5f460b67db`::finished: {} >Thread-15::DEBUG::2014-07-24 08:23:38,415::task::595::TaskManager.Task::(_updateState) Task=`567c7b48-340f-4187-a311-3f5f460b67db`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:23:38,415::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:23:38,415::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:23:38,415::task::990::TaskManager.Task::(_decref) Task=`567c7b48-340f-4187-a311-3f5f460b67db`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:23:53,821::task::595::TaskManager.Task::(_updateState) Task=`1063b837-b9c1-4c2b-8076-5e283c713513`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:23:53,822::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:23:53,822::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:23:53,822::task::1185::TaskManager.Task::(prepare) Task=`1063b837-b9c1-4c2b-8076-5e283c713513`::finished: {} >Thread-15::DEBUG::2014-07-24 08:23:53,822::task::595::TaskManager.Task::(_updateState) Task=`1063b837-b9c1-4c2b-8076-5e283c713513`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:23:53,822::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:23:53,823::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:23:53,823::task::990::TaskManager.Task::(_decref) Task=`1063b837-b9c1-4c2b-8076-5e283c713513`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:24:09,127::task::595::TaskManager.Task::(_updateState) Task=`fb497e8c-a906-42ed-a442-5b9b3db7716c`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:24:09,127::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:24:09,128::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:24:09,128::task::1185::TaskManager.Task::(prepare) Task=`fb497e8c-a906-42ed-a442-5b9b3db7716c`::finished: {} >Thread-15::DEBUG::2014-07-24 08:24:09,128::task::595::TaskManager.Task::(_updateState) Task=`fb497e8c-a906-42ed-a442-5b9b3db7716c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:24:09,128::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:24:09,128::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:24:09,128::task::990::TaskManager.Task::(_decref) Task=`fb497e8c-a906-42ed-a442-5b9b3db7716c`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:24:24,751::task::595::TaskManager.Task::(_updateState) Task=`ae40a4aa-6e02-4003-a1f8-7045b09c34d6`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:24:24,752::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:24:24,752::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:24:24,752::task::1185::TaskManager.Task::(prepare) Task=`ae40a4aa-6e02-4003-a1f8-7045b09c34d6`::finished: {} >Thread-15::DEBUG::2014-07-24 08:24:24,752::task::595::TaskManager.Task::(_updateState) Task=`ae40a4aa-6e02-4003-a1f8-7045b09c34d6`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:24:24,752::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:24:24,753::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:24:24,753::task::990::TaskManager.Task::(_decref) Task=`ae40a4aa-6e02-4003-a1f8-7045b09c34d6`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:24:40,079::task::595::TaskManager.Task::(_updateState) Task=`747c89c3-da88-4849-bfa8-1850a4ecbb7b`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:24:40,079::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:24:40,079::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:24:40,079::task::1185::TaskManager.Task::(prepare) Task=`747c89c3-da88-4849-bfa8-1850a4ecbb7b`::finished: {} >Thread-15::DEBUG::2014-07-24 08:24:40,079::task::595::TaskManager.Task::(_updateState) Task=`747c89c3-da88-4849-bfa8-1850a4ecbb7b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:24:40,080::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:24:40,080::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:24:40,080::task::990::TaskManager.Task::(_decref) Task=`747c89c3-da88-4849-bfa8-1850a4ecbb7b`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:24:55,389::task::595::TaskManager.Task::(_updateState) Task=`1f19d6f1-446e-4f4c-852b-54336d2cbd58`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:24:55,390::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:24:55,390::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:24:55,390::task::1185::TaskManager.Task::(prepare) Task=`1f19d6f1-446e-4f4c-852b-54336d2cbd58`::finished: {} >Thread-15::DEBUG::2014-07-24 08:24:55,390::task::595::TaskManager.Task::(_updateState) Task=`1f19d6f1-446e-4f4c-852b-54336d2cbd58`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:24:55,390::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:24:55,390::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:24:55,391::task::990::TaskManager.Task::(_decref) Task=`1f19d6f1-446e-4f4c-852b-54336d2cbd58`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:25:10,756::task::595::TaskManager.Task::(_updateState) Task=`ab984bff-3914-43f4-b7c0-bd45f82756a5`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:25:10,756::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:25:10,756::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:25:10,756::task::1185::TaskManager.Task::(prepare) Task=`ab984bff-3914-43f4-b7c0-bd45f82756a5`::finished: {} >Thread-15::DEBUG::2014-07-24 08:25:10,756::task::595::TaskManager.Task::(_updateState) Task=`ab984bff-3914-43f4-b7c0-bd45f82756a5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:25:10,757::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:25:10,757::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:25:10,757::task::990::TaskManager.Task::(_decref) Task=`ab984bff-3914-43f4-b7c0-bd45f82756a5`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:25:26,074::task::595::TaskManager.Task::(_updateState) Task=`b67587f6-c415-435e-9c27-bab427e18c8a`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:25:26,074::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:25:26,075::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:25:26,075::task::1185::TaskManager.Task::(prepare) Task=`b67587f6-c415-435e-9c27-bab427e18c8a`::finished: {} >Thread-15::DEBUG::2014-07-24 08:25:26,075::task::595::TaskManager.Task::(_updateState) Task=`b67587f6-c415-435e-9c27-bab427e18c8a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:25:26,075::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:25:26,075::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:25:26,075::task::990::TaskManager.Task::(_decref) Task=`b67587f6-c415-435e-9c27-bab427e18c8a`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:25:41,387::task::595::TaskManager.Task::(_updateState) Task=`d55dabe0-94d6-425a-9e5c-63ac326db575`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:25:41,387::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:25:41,387::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:25:41,388::task::1185::TaskManager.Task::(prepare) Task=`d55dabe0-94d6-425a-9e5c-63ac326db575`::finished: {} >Thread-15::DEBUG::2014-07-24 08:25:41,388::task::595::TaskManager.Task::(_updateState) Task=`d55dabe0-94d6-425a-9e5c-63ac326db575`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:25:41,388::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:25:41,388::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:25:41,388::task::990::TaskManager.Task::(_decref) Task=`d55dabe0-94d6-425a-9e5c-63ac326db575`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:25:56,718::task::595::TaskManager.Task::(_updateState) Task=`a3082e70-d175-4521-aef1-ccd1a5cc49ca`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:25:56,718::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:25:56,718::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:25:56,719::task::1185::TaskManager.Task::(prepare) Task=`a3082e70-d175-4521-aef1-ccd1a5cc49ca`::finished: {} >Thread-15::DEBUG::2014-07-24 08:25:56,719::task::595::TaskManager.Task::(_updateState) Task=`a3082e70-d175-4521-aef1-ccd1a5cc49ca`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:25:56,719::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:25:56,719::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:25:56,719::task::990::TaskManager.Task::(_decref) Task=`a3082e70-d175-4521-aef1-ccd1a5cc49ca`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:26:12,080::task::595::TaskManager.Task::(_updateState) Task=`63ea1f3d-4fa8-47d4-9235-c77cf5de55a9`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:26:12,080::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:26:12,080::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:26:12,080::task::1185::TaskManager.Task::(prepare) Task=`63ea1f3d-4fa8-47d4-9235-c77cf5de55a9`::finished: {} >Thread-15::DEBUG::2014-07-24 08:26:12,080::task::595::TaskManager.Task::(_updateState) Task=`63ea1f3d-4fa8-47d4-9235-c77cf5de55a9`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:26:12,081::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:26:12,081::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:26:12,081::task::990::TaskManager.Task::(_decref) Task=`63ea1f3d-4fa8-47d4-9235-c77cf5de55a9`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:26:27,401::task::595::TaskManager.Task::(_updateState) Task=`9bbe8e98-5657-4fe6-89b4-047f1d74c0e8`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:26:27,401::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:26:27,401::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:26:27,401::task::1185::TaskManager.Task::(prepare) Task=`9bbe8e98-5657-4fe6-89b4-047f1d74c0e8`::finished: {} >Thread-15::DEBUG::2014-07-24 08:26:27,402::task::595::TaskManager.Task::(_updateState) Task=`9bbe8e98-5657-4fe6-89b4-047f1d74c0e8`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:26:27,402::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:26:27,402::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:26:27,402::task::990::TaskManager.Task::(_decref) Task=`9bbe8e98-5657-4fe6-89b4-047f1d74c0e8`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:26:42,737::task::595::TaskManager.Task::(_updateState) Task=`ae442e47-aee3-4c71-aca5-3cfbdacad058`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:26:42,738::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:26:42,738::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:26:42,738::task::1185::TaskManager.Task::(prepare) Task=`ae442e47-aee3-4c71-aca5-3cfbdacad058`::finished: {} >Thread-15::DEBUG::2014-07-24 08:26:42,738::task::595::TaskManager.Task::(_updateState) Task=`ae442e47-aee3-4c71-aca5-3cfbdacad058`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:26:42,738::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:26:42,738::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:26:42,738::task::990::TaskManager.Task::(_decref) Task=`ae442e47-aee3-4c71-aca5-3cfbdacad058`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:26:58,058::task::595::TaskManager.Task::(_updateState) Task=`785afb87-4f88-403d-a76a-30e79d4b8ecc`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:26:58,058::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:26:58,058::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:26:58,059::task::1185::TaskManager.Task::(prepare) Task=`785afb87-4f88-403d-a76a-30e79d4b8ecc`::finished: {} >Thread-15::DEBUG::2014-07-24 08:26:58,059::task::595::TaskManager.Task::(_updateState) Task=`785afb87-4f88-403d-a76a-30e79d4b8ecc`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:26:58,059::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:26:58,059::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:26:58,059::task::990::TaskManager.Task::(_decref) Task=`785afb87-4f88-403d-a76a-30e79d4b8ecc`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:27:13,380::task::595::TaskManager.Task::(_updateState) Task=`ba4ec575-acf1-46bf-96e8-2f8680f4d977`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:27:13,381::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:27:13,381::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:27:13,381::task::1185::TaskManager.Task::(prepare) Task=`ba4ec575-acf1-46bf-96e8-2f8680f4d977`::finished: {} >Thread-15::DEBUG::2014-07-24 08:27:13,381::task::595::TaskManager.Task::(_updateState) Task=`ba4ec575-acf1-46bf-96e8-2f8680f4d977`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:27:13,381::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:27:13,381::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:27:13,382::task::990::TaskManager.Task::(_decref) Task=`ba4ec575-acf1-46bf-96e8-2f8680f4d977`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:27:28,721::task::595::TaskManager.Task::(_updateState) Task=`bb67a131-871b-4697-8d3f-c3b8eb0c0238`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:27:28,721::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:27:28,721::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:27:28,721::task::1185::TaskManager.Task::(prepare) Task=`bb67a131-871b-4697-8d3f-c3b8eb0c0238`::finished: {} >Thread-15::DEBUG::2014-07-24 08:27:28,721::task::595::TaskManager.Task::(_updateState) Task=`bb67a131-871b-4697-8d3f-c3b8eb0c0238`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:27:28,722::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:27:28,722::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:27:28,722::task::990::TaskManager.Task::(_decref) Task=`bb67a131-871b-4697-8d3f-c3b8eb0c0238`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:27:44,103::task::595::TaskManager.Task::(_updateState) Task=`06ea9359-69e1-4f70-abc5-cb39afc83b34`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:27:44,104::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:27:44,104::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:27:44,104::task::1185::TaskManager.Task::(prepare) Task=`06ea9359-69e1-4f70-abc5-cb39afc83b34`::finished: {} >Thread-15::DEBUG::2014-07-24 08:27:44,104::task::595::TaskManager.Task::(_updateState) Task=`06ea9359-69e1-4f70-abc5-cb39afc83b34`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:27:44,104::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:27:44,104::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:27:44,105::task::990::TaskManager.Task::(_decref) Task=`06ea9359-69e1-4f70-abc5-cb39afc83b34`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:27:59,478::task::595::TaskManager.Task::(_updateState) Task=`0828e813-771d-4799-8fa7-5b5d78f677b4`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:27:59,478::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:27:59,478::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:27:59,478::task::1185::TaskManager.Task::(prepare) Task=`0828e813-771d-4799-8fa7-5b5d78f677b4`::finished: {} >Thread-15::DEBUG::2014-07-24 08:27:59,478::task::595::TaskManager.Task::(_updateState) Task=`0828e813-771d-4799-8fa7-5b5d78f677b4`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:27:59,479::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:27:59,479::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:27:59,479::task::990::TaskManager.Task::(_decref) Task=`0828e813-771d-4799-8fa7-5b5d78f677b4`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:28:14,771::task::595::TaskManager.Task::(_updateState) Task=`d8567efc-768b-4c39-86da-6862cebf8774`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:28:14,771::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:28:14,771::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:28:14,771::task::1185::TaskManager.Task::(prepare) Task=`d8567efc-768b-4c39-86da-6862cebf8774`::finished: {} >Thread-15::DEBUG::2014-07-24 08:28:14,771::task::595::TaskManager.Task::(_updateState) Task=`d8567efc-768b-4c39-86da-6862cebf8774`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:28:14,772::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:28:14,772::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:28:14,772::task::990::TaskManager.Task::(_decref) Task=`d8567efc-768b-4c39-86da-6862cebf8774`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:28:30,076::task::595::TaskManager.Task::(_updateState) Task=`61e4937e-3c05-407b-9375-23d8ea7496de`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:28:30,077::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:28:30,077::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:28:30,077::task::1185::TaskManager.Task::(prepare) Task=`61e4937e-3c05-407b-9375-23d8ea7496de`::finished: {} >Thread-15::DEBUG::2014-07-24 08:28:30,077::task::595::TaskManager.Task::(_updateState) Task=`61e4937e-3c05-407b-9375-23d8ea7496de`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:28:30,077::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:28:30,077::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:28:30,078::task::990::TaskManager.Task::(_decref) Task=`61e4937e-3c05-407b-9375-23d8ea7496de`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:28:45,405::task::595::TaskManager.Task::(_updateState) Task=`06476c14-417f-43e5-861e-ea0d30063c88`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:28:45,405::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:28:45,406::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:28:45,406::task::1185::TaskManager.Task::(prepare) Task=`06476c14-417f-43e5-861e-ea0d30063c88`::finished: {} >Thread-15::DEBUG::2014-07-24 08:28:45,406::task::595::TaskManager.Task::(_updateState) Task=`06476c14-417f-43e5-861e-ea0d30063c88`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:28:45,406::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:28:45,406::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:28:45,406::task::990::TaskManager.Task::(_decref) Task=`06476c14-417f-43e5-861e-ea0d30063c88`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:29:00,767::task::595::TaskManager.Task::(_updateState) Task=`934ed8f0-6307-4f7f-bfa0-563b07e93c0d`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:29:00,768::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:29:00,768::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:29:00,768::task::1185::TaskManager.Task::(prepare) Task=`934ed8f0-6307-4f7f-bfa0-563b07e93c0d`::finished: {} >Thread-15::DEBUG::2014-07-24 08:29:00,768::task::595::TaskManager.Task::(_updateState) Task=`934ed8f0-6307-4f7f-bfa0-563b07e93c0d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:29:00,768::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:29:00,768::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:29:00,769::task::990::TaskManager.Task::(_decref) Task=`934ed8f0-6307-4f7f-bfa0-563b07e93c0d`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:29:16,082::task::595::TaskManager.Task::(_updateState) Task=`15d9924c-a626-4978-9e41-361324329dc8`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:29:16,082::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:29:16,082::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:29:16,082::task::1185::TaskManager.Task::(prepare) Task=`15d9924c-a626-4978-9e41-361324329dc8`::finished: {} >Thread-15::DEBUG::2014-07-24 08:29:16,082::task::595::TaskManager.Task::(_updateState) Task=`15d9924c-a626-4978-9e41-361324329dc8`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:29:16,083::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:29:16,083::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:29:16,083::task::990::TaskManager.Task::(_decref) Task=`15d9924c-a626-4978-9e41-361324329dc8`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:29:32,043::task::595::TaskManager.Task::(_updateState) Task=`56a96d60-3255-4b33-a3ce-3a84f4feed84`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:29:32,043::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:29:32,043::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:29:32,043::task::1185::TaskManager.Task::(prepare) Task=`56a96d60-3255-4b33-a3ce-3a84f4feed84`::finished: {} >Thread-15::DEBUG::2014-07-24 08:29:32,044::task::595::TaskManager.Task::(_updateState) Task=`56a96d60-3255-4b33-a3ce-3a84f4feed84`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:29:32,044::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:29:32,044::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:29:32,044::task::990::TaskManager.Task::(_decref) Task=`56a96d60-3255-4b33-a3ce-3a84f4feed84`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:29:47,366::task::595::TaskManager.Task::(_updateState) Task=`8d928305-d630-4958-b8fc-90a125cf175e`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:29:47,367::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:29:47,367::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:29:47,367::task::1185::TaskManager.Task::(prepare) Task=`8d928305-d630-4958-b8fc-90a125cf175e`::finished: {} >Thread-15::DEBUG::2014-07-24 08:29:47,367::task::595::TaskManager.Task::(_updateState) Task=`8d928305-d630-4958-b8fc-90a125cf175e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:29:47,367::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:29:47,367::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:29:47,367::task::990::TaskManager.Task::(_decref) Task=`8d928305-d630-4958-b8fc-90a125cf175e`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:30:02,716::task::595::TaskManager.Task::(_updateState) Task=`84794f9a-112c-4fb4-b3f2-c17d12f4b812`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:30:02,716::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:30:02,716::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:30:02,716::task::1185::TaskManager.Task::(prepare) Task=`84794f9a-112c-4fb4-b3f2-c17d12f4b812`::finished: {} >Thread-15::DEBUG::2014-07-24 08:30:02,716::task::595::TaskManager.Task::(_updateState) Task=`84794f9a-112c-4fb4-b3f2-c17d12f4b812`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:30:02,717::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:30:02,717::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:30:02,717::task::990::TaskManager.Task::(_decref) Task=`84794f9a-112c-4fb4-b3f2-c17d12f4b812`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:30:18,038::task::595::TaskManager.Task::(_updateState) Task=`fb52ce14-ff75-446b-bba3-1fa6d8381e79`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:30:18,039::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:30:18,039::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:30:18,039::task::1185::TaskManager.Task::(prepare) Task=`fb52ce14-ff75-446b-bba3-1fa6d8381e79`::finished: {} >Thread-15::DEBUG::2014-07-24 08:30:18,039::task::595::TaskManager.Task::(_updateState) Task=`fb52ce14-ff75-446b-bba3-1fa6d8381e79`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:30:18,039::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:30:18,040::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:30:18,040::task::990::TaskManager.Task::(_decref) Task=`fb52ce14-ff75-446b-bba3-1fa6d8381e79`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:30:33,334::task::595::TaskManager.Task::(_updateState) Task=`cb3e0f8a-b570-47cd-a552-dbfd72d54142`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:30:33,334::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:30:33,334::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:30:33,334::task::1185::TaskManager.Task::(prepare) Task=`cb3e0f8a-b570-47cd-a552-dbfd72d54142`::finished: {} >Thread-15::DEBUG::2014-07-24 08:30:33,334::task::595::TaskManager.Task::(_updateState) Task=`cb3e0f8a-b570-47cd-a552-dbfd72d54142`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:30:33,335::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:30:33,335::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:30:33,335::task::990::TaskManager.Task::(_decref) Task=`cb3e0f8a-b570-47cd-a552-dbfd72d54142`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:30:48,636::task::595::TaskManager.Task::(_updateState) Task=`f115c097-3c55-42cf-9974-05f521de7578`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:30:48,636::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:30:48,636::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:30:48,636::task::1185::TaskManager.Task::(prepare) Task=`f115c097-3c55-42cf-9974-05f521de7578`::finished: {} >Thread-15::DEBUG::2014-07-24 08:30:48,636::task::595::TaskManager.Task::(_updateState) Task=`f115c097-3c55-42cf-9974-05f521de7578`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:30:48,637::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:30:48,637::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:30:48,637::task::990::TaskManager.Task::(_decref) Task=`f115c097-3c55-42cf-9974-05f521de7578`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:31:04,012::task::595::TaskManager.Task::(_updateState) Task=`ef6301c6-6896-44cc-bc7e-5c5ee041dc6b`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:31:04,012::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:31:04,012::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:31:04,012::task::1185::TaskManager.Task::(prepare) Task=`ef6301c6-6896-44cc-bc7e-5c5ee041dc6b`::finished: {} >Thread-15::DEBUG::2014-07-24 08:31:04,012::task::595::TaskManager.Task::(_updateState) Task=`ef6301c6-6896-44cc-bc7e-5c5ee041dc6b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:31:04,013::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:31:04,013::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:31:04,013::task::990::TaskManager.Task::(_decref) Task=`ef6301c6-6896-44cc-bc7e-5c5ee041dc6b`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:31:19,365::task::595::TaskManager.Task::(_updateState) Task=`fe76f307-9ac8-4dae-9168-7804c55faf4d`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:31:19,365::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:31:19,365::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:31:19,365::task::1185::TaskManager.Task::(prepare) Task=`fe76f307-9ac8-4dae-9168-7804c55faf4d`::finished: {} >Thread-15::DEBUG::2014-07-24 08:31:19,365::task::595::TaskManager.Task::(_updateState) Task=`fe76f307-9ac8-4dae-9168-7804c55faf4d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:31:19,366::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:31:19,366::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:31:19,366::task::990::TaskManager.Task::(_decref) Task=`fe76f307-9ac8-4dae-9168-7804c55faf4d`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:31:34,718::task::595::TaskManager.Task::(_updateState) Task=`a39cb441-24a5-4f1f-b29d-1d73bb273b75`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:31:34,718::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:31:34,718::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:31:34,718::task::1185::TaskManager.Task::(prepare) Task=`a39cb441-24a5-4f1f-b29d-1d73bb273b75`::finished: {} >Thread-15::DEBUG::2014-07-24 08:31:34,718::task::595::TaskManager.Task::(_updateState) Task=`a39cb441-24a5-4f1f-b29d-1d73bb273b75`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:31:34,719::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:31:34,719::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:31:34,719::task::990::TaskManager.Task::(_decref) Task=`a39cb441-24a5-4f1f-b29d-1d73bb273b75`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:31:50,035::task::595::TaskManager.Task::(_updateState) Task=`5fd6007e-29ef-4716-b301-04ac76831a95`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:31:50,035::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:31:50,036::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:31:50,036::task::1185::TaskManager.Task::(prepare) Task=`5fd6007e-29ef-4716-b301-04ac76831a95`::finished: {} >Thread-15::DEBUG::2014-07-24 08:31:50,036::task::595::TaskManager.Task::(_updateState) Task=`5fd6007e-29ef-4716-b301-04ac76831a95`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:31:50,036::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:31:50,036::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:31:50,036::task::990::TaskManager.Task::(_decref) Task=`5fd6007e-29ef-4716-b301-04ac76831a95`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:32:05,357::task::595::TaskManager.Task::(_updateState) Task=`7f777f75-d9e4-4e38-8479-43aa08babedf`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:32:05,358::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:32:05,358::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:32:05,358::task::1185::TaskManager.Task::(prepare) Task=`7f777f75-d9e4-4e38-8479-43aa08babedf`::finished: {} >Thread-15::DEBUG::2014-07-24 08:32:05,358::task::595::TaskManager.Task::(_updateState) Task=`7f777f75-d9e4-4e38-8479-43aa08babedf`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:32:05,358::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:32:05,358::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:32:05,359::task::990::TaskManager.Task::(_decref) Task=`7f777f75-d9e4-4e38-8479-43aa08babedf`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:32:20,662::task::595::TaskManager.Task::(_updateState) Task=`1a95d6dd-0b5d-4d9c-8796-1e1deaf41c20`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:32:20,663::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:32:20,663::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:32:20,663::task::1185::TaskManager.Task::(prepare) Task=`1a95d6dd-0b5d-4d9c-8796-1e1deaf41c20`::finished: {} >Thread-15::DEBUG::2014-07-24 08:32:20,663::task::595::TaskManager.Task::(_updateState) Task=`1a95d6dd-0b5d-4d9c-8796-1e1deaf41c20`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:32:20,663::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:32:20,664::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:32:20,664::task::990::TaskManager.Task::(_decref) Task=`1a95d6dd-0b5d-4d9c-8796-1e1deaf41c20`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:32:35,985::task::595::TaskManager.Task::(_updateState) Task=`7022cabe-ebab-48ce-bbd0-00f5c663a432`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:32:35,985::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:32:35,985::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:32:35,985::task::1185::TaskManager.Task::(prepare) Task=`7022cabe-ebab-48ce-bbd0-00f5c663a432`::finished: {} >Thread-15::DEBUG::2014-07-24 08:32:35,986::task::595::TaskManager.Task::(_updateState) Task=`7022cabe-ebab-48ce-bbd0-00f5c663a432`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:32:35,986::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:32:35,986::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:32:35,986::task::990::TaskManager.Task::(_decref) Task=`7022cabe-ebab-48ce-bbd0-00f5c663a432`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:32:51,354::task::595::TaskManager.Task::(_updateState) Task=`ec71ecd3-8171-4a8d-b249-0f22f7ff6a33`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:32:51,354::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:32:51,354::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:32:51,355::task::1185::TaskManager.Task::(prepare) Task=`ec71ecd3-8171-4a8d-b249-0f22f7ff6a33`::finished: {} >Thread-15::DEBUG::2014-07-24 08:32:51,355::task::595::TaskManager.Task::(_updateState) Task=`ec71ecd3-8171-4a8d-b249-0f22f7ff6a33`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:32:51,355::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:32:51,355::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:32:51,355::task::990::TaskManager.Task::(_decref) Task=`ec71ecd3-8171-4a8d-b249-0f22f7ff6a33`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:33:06,674::task::595::TaskManager.Task::(_updateState) Task=`786687bc-0270-4ce1-9d92-39f3d6f031d1`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:33:06,675::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:33:06,675::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:33:06,675::task::1185::TaskManager.Task::(prepare) Task=`786687bc-0270-4ce1-9d92-39f3d6f031d1`::finished: {} >Thread-15::DEBUG::2014-07-24 08:33:06,675::task::595::TaskManager.Task::(_updateState) Task=`786687bc-0270-4ce1-9d92-39f3d6f031d1`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:33:06,675::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:33:06,675::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:33:06,676::task::990::TaskManager.Task::(_decref) Task=`786687bc-0270-4ce1-9d92-39f3d6f031d1`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:33:21,979::task::595::TaskManager.Task::(_updateState) Task=`01ebf60d-dc26-4a32-a27c-2a5b8edb227a`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:33:21,979::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:33:21,979::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:33:21,979::task::1185::TaskManager.Task::(prepare) Task=`01ebf60d-dc26-4a32-a27c-2a5b8edb227a`::finished: {} >Thread-15::DEBUG::2014-07-24 08:33:21,980::task::595::TaskManager.Task::(_updateState) Task=`01ebf60d-dc26-4a32-a27c-2a5b8edb227a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:33:21,980::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:33:21,980::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:33:21,980::task::990::TaskManager.Task::(_decref) Task=`01ebf60d-dc26-4a32-a27c-2a5b8edb227a`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:33:37,317::task::595::TaskManager.Task::(_updateState) Task=`a2596884-31bd-433f-967b-90b2f797d044`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:33:37,318::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:33:37,318::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:33:37,318::task::1185::TaskManager.Task::(prepare) Task=`a2596884-31bd-433f-967b-90b2f797d044`::finished: {} >Thread-15::DEBUG::2014-07-24 08:33:37,318::task::595::TaskManager.Task::(_updateState) Task=`a2596884-31bd-433f-967b-90b2f797d044`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:33:37,319::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:33:37,319::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:33:37,319::task::990::TaskManager.Task::(_decref) Task=`a2596884-31bd-433f-967b-90b2f797d044`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:33:52,754::task::595::TaskManager.Task::(_updateState) Task=`9c0ffa12-cb1d-4f3d-bb2d-120df5bb6104`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:33:52,754::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:33:52,754::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:33:52,754::task::1185::TaskManager.Task::(prepare) Task=`9c0ffa12-cb1d-4f3d-bb2d-120df5bb6104`::finished: {} >Thread-15::DEBUG::2014-07-24 08:33:52,754::task::595::TaskManager.Task::(_updateState) Task=`9c0ffa12-cb1d-4f3d-bb2d-120df5bb6104`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:33:52,755::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:33:52,755::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:33:52,755::task::990::TaskManager.Task::(_decref) Task=`9c0ffa12-cb1d-4f3d-bb2d-120df5bb6104`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:34:08,054::task::595::TaskManager.Task::(_updateState) Task=`054b511a-8bba-4ce4-ae4b-78d1f2dc9d67`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:34:08,054::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:34:08,054::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:34:08,054::task::1185::TaskManager.Task::(prepare) Task=`054b511a-8bba-4ce4-ae4b-78d1f2dc9d67`::finished: {} >Thread-15::DEBUG::2014-07-24 08:34:08,054::task::595::TaskManager.Task::(_updateState) Task=`054b511a-8bba-4ce4-ae4b-78d1f2dc9d67`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:34:08,055::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:34:08,055::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:34:08,055::task::990::TaskManager.Task::(_decref) Task=`054b511a-8bba-4ce4-ae4b-78d1f2dc9d67`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:34:23,391::task::595::TaskManager.Task::(_updateState) Task=`b58715a9-347b-4e47-ad20-486f876aa53c`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:34:23,391::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:34:23,391::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:34:23,391::task::1185::TaskManager.Task::(prepare) Task=`b58715a9-347b-4e47-ad20-486f876aa53c`::finished: {} >Thread-15::DEBUG::2014-07-24 08:34:23,392::task::595::TaskManager.Task::(_updateState) Task=`b58715a9-347b-4e47-ad20-486f876aa53c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:34:23,392::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:34:23,392::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:34:23,392::task::990::TaskManager.Task::(_decref) Task=`b58715a9-347b-4e47-ad20-486f876aa53c`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:34:39,008::task::595::TaskManager.Task::(_updateState) Task=`46707440-bb5c-4247-a6ad-dbe028c8c3e9`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:34:39,008::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:34:39,009::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:34:39,009::task::1185::TaskManager.Task::(prepare) Task=`46707440-bb5c-4247-a6ad-dbe028c8c3e9`::finished: {} >Thread-15::DEBUG::2014-07-24 08:34:39,009::task::595::TaskManager.Task::(_updateState) Task=`46707440-bb5c-4247-a6ad-dbe028c8c3e9`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:34:39,009::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:34:39,009::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:34:39,009::task::990::TaskManager.Task::(_decref) Task=`46707440-bb5c-4247-a6ad-dbe028c8c3e9`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:34:54,318::task::595::TaskManager.Task::(_updateState) Task=`98ceb4ad-e053-4317-aa4e-a748a7e6ecee`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:34:54,319::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:34:54,319::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:34:54,319::task::1185::TaskManager.Task::(prepare) Task=`98ceb4ad-e053-4317-aa4e-a748a7e6ecee`::finished: {} >Thread-15::DEBUG::2014-07-24 08:34:54,319::task::595::TaskManager.Task::(_updateState) Task=`98ceb4ad-e053-4317-aa4e-a748a7e6ecee`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:34:54,319::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:34:54,320::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:34:54,320::task::990::TaskManager.Task::(_decref) Task=`98ceb4ad-e053-4317-aa4e-a748a7e6ecee`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:35:09,648::task::595::TaskManager.Task::(_updateState) Task=`568809cc-de44-49c6-ae1f-d873648be189`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:35:09,648::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:35:09,649::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:35:09,649::task::1185::TaskManager.Task::(prepare) Task=`568809cc-de44-49c6-ae1f-d873648be189`::finished: {} >Thread-15::DEBUG::2014-07-24 08:35:09,649::task::595::TaskManager.Task::(_updateState) Task=`568809cc-de44-49c6-ae1f-d873648be189`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:35:09,649::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:35:09,649::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:35:09,649::task::990::TaskManager.Task::(_decref) Task=`568809cc-de44-49c6-ae1f-d873648be189`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:35:25,038::task::595::TaskManager.Task::(_updateState) Task=`abf6d1b4-65f6-4d85-bf22-34603cc34ddd`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:35:25,038::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:35:25,038::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:35:25,038::task::1185::TaskManager.Task::(prepare) Task=`abf6d1b4-65f6-4d85-bf22-34603cc34ddd`::finished: {} >Thread-15::DEBUG::2014-07-24 08:35:25,038::task::595::TaskManager.Task::(_updateState) Task=`abf6d1b4-65f6-4d85-bf22-34603cc34ddd`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:35:25,039::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:35:25,039::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:35:25,039::task::990::TaskManager.Task::(_decref) Task=`abf6d1b4-65f6-4d85-bf22-34603cc34ddd`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:35:40,391::task::595::TaskManager.Task::(_updateState) Task=`3920e486-cd6e-4474-bd98-9bf6a4a1500b`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:35:40,391::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:35:40,391::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:35:40,392::task::1185::TaskManager.Task::(prepare) Task=`3920e486-cd6e-4474-bd98-9bf6a4a1500b`::finished: {} >Thread-15::DEBUG::2014-07-24 08:35:40,392::task::595::TaskManager.Task::(_updateState) Task=`3920e486-cd6e-4474-bd98-9bf6a4a1500b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:35:40,392::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:35:40,392::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:35:40,392::task::990::TaskManager.Task::(_decref) Task=`3920e486-cd6e-4474-bd98-9bf6a4a1500b`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:35:55,918::task::595::TaskManager.Task::(_updateState) Task=`9c15ce8c-4c4c-4d69-8625-e4449d6d94e9`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:35:55,918::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:35:55,919::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:35:55,919::task::1185::TaskManager.Task::(prepare) Task=`9c15ce8c-4c4c-4d69-8625-e4449d6d94e9`::finished: {} >Thread-15::DEBUG::2014-07-24 08:35:55,919::task::595::TaskManager.Task::(_updateState) Task=`9c15ce8c-4c4c-4d69-8625-e4449d6d94e9`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:35:55,919::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:35:55,919::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:35:55,919::task::990::TaskManager.Task::(_decref) Task=`9c15ce8c-4c4c-4d69-8625-e4449d6d94e9`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:36:11,375::task::595::TaskManager.Task::(_updateState) Task=`44cdc4d0-6462-4ec9-80ed-12a6772b297d`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:36:11,376::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:36:11,376::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:36:11,376::task::1185::TaskManager.Task::(prepare) Task=`44cdc4d0-6462-4ec9-80ed-12a6772b297d`::finished: {} >Thread-15::DEBUG::2014-07-24 08:36:11,376::task::595::TaskManager.Task::(_updateState) Task=`44cdc4d0-6462-4ec9-80ed-12a6772b297d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:36:11,376::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:36:11,376::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:36:11,376::task::990::TaskManager.Task::(_decref) Task=`44cdc4d0-6462-4ec9-80ed-12a6772b297d`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:36:26,854::task::595::TaskManager.Task::(_updateState) Task=`01769ff7-5020-4291-aed6-33c4c59b0a48`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:36:26,855::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:36:26,855::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:36:26,855::task::1185::TaskManager.Task::(prepare) Task=`01769ff7-5020-4291-aed6-33c4c59b0a48`::finished: {} >Thread-15::DEBUG::2014-07-24 08:36:26,855::task::595::TaskManager.Task::(_updateState) Task=`01769ff7-5020-4291-aed6-33c4c59b0a48`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:36:26,855::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:36:26,855::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:36:26,855::task::990::TaskManager.Task::(_decref) Task=`01769ff7-5020-4291-aed6-33c4c59b0a48`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:36:42,298::task::595::TaskManager.Task::(_updateState) Task=`d68a9060-b197-4f35-a0a8-4adca73847bf`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:36:42,298::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:36:42,298::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:36:42,298::task::1185::TaskManager.Task::(prepare) Task=`d68a9060-b197-4f35-a0a8-4adca73847bf`::finished: {} >Thread-15::DEBUG::2014-07-24 08:36:42,298::task::595::TaskManager.Task::(_updateState) Task=`d68a9060-b197-4f35-a0a8-4adca73847bf`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:36:42,298::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:36:42,299::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:36:42,299::task::990::TaskManager.Task::(_decref) Task=`d68a9060-b197-4f35-a0a8-4adca73847bf`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:36:57,788::task::595::TaskManager.Task::(_updateState) Task=`7280d57a-c544-42e8-abbb-552c0262f130`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:36:57,788::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:36:57,788::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:36:57,788::task::1185::TaskManager.Task::(prepare) Task=`7280d57a-c544-42e8-abbb-552c0262f130`::finished: {} >Thread-15::DEBUG::2014-07-24 08:36:57,789::task::595::TaskManager.Task::(_updateState) Task=`7280d57a-c544-42e8-abbb-552c0262f130`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:36:57,789::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:36:57,789::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:36:57,789::task::990::TaskManager.Task::(_decref) Task=`7280d57a-c544-42e8-abbb-552c0262f130`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:37:13,249::task::595::TaskManager.Task::(_updateState) Task=`21e43af0-6e8e-4b48-9a40-08f8ad0d6699`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:37:13,249::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:37:13,249::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:37:13,249::task::1185::TaskManager.Task::(prepare) Task=`21e43af0-6e8e-4b48-9a40-08f8ad0d6699`::finished: {} >Thread-15::DEBUG::2014-07-24 08:37:13,249::task::595::TaskManager.Task::(_updateState) Task=`21e43af0-6e8e-4b48-9a40-08f8ad0d6699`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:37:13,250::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:37:13,250::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:37:13,250::task::990::TaskManager.Task::(_decref) Task=`21e43af0-6e8e-4b48-9a40-08f8ad0d6699`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:37:28,598::task::595::TaskManager.Task::(_updateState) Task=`903d1cf1-86fd-42c6-b627-f893fd375fc3`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:37:28,599::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:37:28,599::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:37:28,599::task::1185::TaskManager.Task::(prepare) Task=`903d1cf1-86fd-42c6-b627-f893fd375fc3`::finished: {} >Thread-15::DEBUG::2014-07-24 08:37:28,599::task::595::TaskManager.Task::(_updateState) Task=`903d1cf1-86fd-42c6-b627-f893fd375fc3`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:37:28,599::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:37:28,600::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:37:28,600::task::990::TaskManager.Task::(_decref) Task=`903d1cf1-86fd-42c6-b627-f893fd375fc3`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:37:43,982::task::595::TaskManager.Task::(_updateState) Task=`4f3ca6b1-c620-4a59-85a4-ba6c00c46d1a`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:37:43,982::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:37:43,982::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:37:43,982::task::1185::TaskManager.Task::(prepare) Task=`4f3ca6b1-c620-4a59-85a4-ba6c00c46d1a`::finished: {} >Thread-15::DEBUG::2014-07-24 08:37:43,982::task::595::TaskManager.Task::(_updateState) Task=`4f3ca6b1-c620-4a59-85a4-ba6c00c46d1a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:37:43,983::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:37:43,983::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:37:43,983::task::990::TaskManager.Task::(_decref) Task=`4f3ca6b1-c620-4a59-85a4-ba6c00c46d1a`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:37:59,321::task::595::TaskManager.Task::(_updateState) Task=`bd4e3c79-f43e-4b7c-a82c-735821efc6c4`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:37:59,321::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:37:59,321::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:37:59,321::task::1185::TaskManager.Task::(prepare) Task=`bd4e3c79-f43e-4b7c-a82c-735821efc6c4`::finished: {} >Thread-15::DEBUG::2014-07-24 08:37:59,322::task::595::TaskManager.Task::(_updateState) Task=`bd4e3c79-f43e-4b7c-a82c-735821efc6c4`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:37:59,322::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:37:59,322::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:37:59,322::task::990::TaskManager.Task::(_decref) Task=`bd4e3c79-f43e-4b7c-a82c-735821efc6c4`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:38:14,639::task::595::TaskManager.Task::(_updateState) Task=`25d5da01-71a1-4c45-b00e-619a3f074c37`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:38:14,640::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:38:14,640::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:38:14,640::task::1185::TaskManager.Task::(prepare) Task=`25d5da01-71a1-4c45-b00e-619a3f074c37`::finished: {} >Thread-15::DEBUG::2014-07-24 08:38:14,640::task::595::TaskManager.Task::(_updateState) Task=`25d5da01-71a1-4c45-b00e-619a3f074c37`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:38:14,640::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:38:14,641::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:38:14,641::task::990::TaskManager.Task::(_decref) Task=`25d5da01-71a1-4c45-b00e-619a3f074c37`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:38:29,988::task::595::TaskManager.Task::(_updateState) Task=`ef550cf0-826f-4573-add3-0397acea5872`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:38:29,988::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:38:29,989::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:38:29,989::task::1185::TaskManager.Task::(prepare) Task=`ef550cf0-826f-4573-add3-0397acea5872`::finished: {} >Thread-15::DEBUG::2014-07-24 08:38:29,989::task::595::TaskManager.Task::(_updateState) Task=`ef550cf0-826f-4573-add3-0397acea5872`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:38:29,989::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:38:29,989::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:38:29,989::task::990::TaskManager.Task::(_decref) Task=`ef550cf0-826f-4573-add3-0397acea5872`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:38:45,311::task::595::TaskManager.Task::(_updateState) Task=`1fd212ed-e002-464f-b0b2-a2bfbcee9b83`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:38:45,312::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:38:45,312::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:38:45,312::task::1185::TaskManager.Task::(prepare) Task=`1fd212ed-e002-464f-b0b2-a2bfbcee9b83`::finished: {} >Thread-15::DEBUG::2014-07-24 08:38:45,312::task::595::TaskManager.Task::(_updateState) Task=`1fd212ed-e002-464f-b0b2-a2bfbcee9b83`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:38:45,312::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:38:45,313::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:38:45,313::task::990::TaskManager.Task::(_decref) Task=`1fd212ed-e002-464f-b0b2-a2bfbcee9b83`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:39:00,629::task::595::TaskManager.Task::(_updateState) Task=`a508f2e4-dd69-41db-8923-bc38036f6d33`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:39:00,629::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:39:00,629::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:39:00,630::task::1185::TaskManager.Task::(prepare) Task=`a508f2e4-dd69-41db-8923-bc38036f6d33`::finished: {} >Thread-15::DEBUG::2014-07-24 08:39:00,630::task::595::TaskManager.Task::(_updateState) Task=`a508f2e4-dd69-41db-8923-bc38036f6d33`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:39:00,630::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:39:00,630::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:39:00,630::task::990::TaskManager.Task::(_decref) Task=`a508f2e4-dd69-41db-8923-bc38036f6d33`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:39:15,935::task::595::TaskManager.Task::(_updateState) Task=`9d64921b-8072-4eea-a970-cbbe568534ea`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:39:15,935::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:39:15,936::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:39:15,936::task::1185::TaskManager.Task::(prepare) Task=`9d64921b-8072-4eea-a970-cbbe568534ea`::finished: {} >Thread-15::DEBUG::2014-07-24 08:39:15,936::task::595::TaskManager.Task::(_updateState) Task=`9d64921b-8072-4eea-a970-cbbe568534ea`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:39:15,936::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:39:15,936::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:39:15,936::task::990::TaskManager.Task::(_decref) Task=`9d64921b-8072-4eea-a970-cbbe568534ea`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:39:31,270::task::595::TaskManager.Task::(_updateState) Task=`78d01472-ff0d-4b68-94ab-658dcf2a9493`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:39:31,270::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:39:31,271::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:39:31,271::task::1185::TaskManager.Task::(prepare) Task=`78d01472-ff0d-4b68-94ab-658dcf2a9493`::finished: {} >Thread-15::DEBUG::2014-07-24 08:39:31,271::task::595::TaskManager.Task::(_updateState) Task=`78d01472-ff0d-4b68-94ab-658dcf2a9493`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:39:31,271::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:39:31,271::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:39:31,271::task::990::TaskManager.Task::(_decref) Task=`78d01472-ff0d-4b68-94ab-658dcf2a9493`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:39:46,584::task::595::TaskManager.Task::(_updateState) Task=`b7f5bd2f-a037-4a60-8850-1b2bd11199f7`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:39:46,584::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:39:46,585::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:39:46,585::task::1185::TaskManager.Task::(prepare) Task=`b7f5bd2f-a037-4a60-8850-1b2bd11199f7`::finished: {} >Thread-15::DEBUG::2014-07-24 08:39:46,585::task::595::TaskManager.Task::(_updateState) Task=`b7f5bd2f-a037-4a60-8850-1b2bd11199f7`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:39:46,585::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:39:46,585::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:39:46,585::task::990::TaskManager.Task::(_decref) Task=`b7f5bd2f-a037-4a60-8850-1b2bd11199f7`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:40:01,996::task::595::TaskManager.Task::(_updateState) Task=`f87656b7-c54a-441d-8f3d-8473bb85d763`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:40:01,997::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:40:01,997::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:40:01,997::task::1185::TaskManager.Task::(prepare) Task=`f87656b7-c54a-441d-8f3d-8473bb85d763`::finished: {} >Thread-15::DEBUG::2014-07-24 08:40:01,997::task::595::TaskManager.Task::(_updateState) Task=`f87656b7-c54a-441d-8f3d-8473bb85d763`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:40:01,997::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:40:01,998::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:40:01,998::task::990::TaskManager.Task::(_decref) Task=`f87656b7-c54a-441d-8f3d-8473bb85d763`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:40:17,665::task::595::TaskManager.Task::(_updateState) Task=`e2b0ec2a-374f-40c8-b5ae-2afa9456e693`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:40:17,665::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:40:17,666::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:40:17,666::task::1185::TaskManager.Task::(prepare) Task=`e2b0ec2a-374f-40c8-b5ae-2afa9456e693`::finished: {} >Thread-15::DEBUG::2014-07-24 08:40:17,666::task::595::TaskManager.Task::(_updateState) Task=`e2b0ec2a-374f-40c8-b5ae-2afa9456e693`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:40:17,666::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:40:17,666::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:40:17,666::task::990::TaskManager.Task::(_decref) Task=`e2b0ec2a-374f-40c8-b5ae-2afa9456e693`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:40:33,002::task::595::TaskManager.Task::(_updateState) Task=`7f70216c-75c6-484c-b0c0-ea18f241d3aa`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:40:33,002::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:40:33,002::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:40:33,002::task::1185::TaskManager.Task::(prepare) Task=`7f70216c-75c6-484c-b0c0-ea18f241d3aa`::finished: {} >Thread-15::DEBUG::2014-07-24 08:40:33,002::task::595::TaskManager.Task::(_updateState) Task=`7f70216c-75c6-484c-b0c0-ea18f241d3aa`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:40:33,003::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:40:33,003::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:40:33,003::task::990::TaskManager.Task::(_decref) Task=`7f70216c-75c6-484c-b0c0-ea18f241d3aa`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:40:48,318::task::595::TaskManager.Task::(_updateState) Task=`09ce9002-f1d3-42c3-abdd-c53c897f7c47`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:40:48,319::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:40:48,319::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:40:48,319::task::1185::TaskManager.Task::(prepare) Task=`09ce9002-f1d3-42c3-abdd-c53c897f7c47`::finished: {} >Thread-15::DEBUG::2014-07-24 08:40:48,319::task::595::TaskManager.Task::(_updateState) Task=`09ce9002-f1d3-42c3-abdd-c53c897f7c47`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:40:48,319::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:40:48,319::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:40:48,320::task::990::TaskManager.Task::(_decref) Task=`09ce9002-f1d3-42c3-abdd-c53c897f7c47`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:41:03,648::task::595::TaskManager.Task::(_updateState) Task=`b2859afd-f6b3-44f8-a092-3de18a388c5d`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:41:03,648::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:41:03,648::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:41:03,648::task::1185::TaskManager.Task::(prepare) Task=`b2859afd-f6b3-44f8-a092-3de18a388c5d`::finished: {} >Thread-15::DEBUG::2014-07-24 08:41:03,649::task::595::TaskManager.Task::(_updateState) Task=`b2859afd-f6b3-44f8-a092-3de18a388c5d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:41:03,649::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:41:03,649::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:41:03,649::task::990::TaskManager.Task::(_decref) Task=`b2859afd-f6b3-44f8-a092-3de18a388c5d`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:41:19,073::task::595::TaskManager.Task::(_updateState) Task=`25b7bd09-ea58-4c9b-b2dd-123481af92a2`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:41:19,073::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:41:19,073::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:41:19,074::task::1185::TaskManager.Task::(prepare) Task=`25b7bd09-ea58-4c9b-b2dd-123481af92a2`::finished: {} >Thread-15::DEBUG::2014-07-24 08:41:19,074::task::595::TaskManager.Task::(_updateState) Task=`25b7bd09-ea58-4c9b-b2dd-123481af92a2`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:41:19,074::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:41:19,074::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:41:19,074::task::990::TaskManager.Task::(_decref) Task=`25b7bd09-ea58-4c9b-b2dd-123481af92a2`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:41:34,398::task::595::TaskManager.Task::(_updateState) Task=`1663e4c9-6414-42fa-a5b9-4c589e0292c4`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:41:34,398::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:41:34,398::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:41:34,399::task::1185::TaskManager.Task::(prepare) Task=`1663e4c9-6414-42fa-a5b9-4c589e0292c4`::finished: {} >Thread-15::DEBUG::2014-07-24 08:41:34,399::task::595::TaskManager.Task::(_updateState) Task=`1663e4c9-6414-42fa-a5b9-4c589e0292c4`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:41:34,399::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:41:34,399::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:41:34,399::task::990::TaskManager.Task::(_decref) Task=`1663e4c9-6414-42fa-a5b9-4c589e0292c4`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:41:49,705::task::595::TaskManager.Task::(_updateState) Task=`479cb344-5f31-45f2-bbf1-9076df4d92d4`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:41:49,705::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:41:49,705::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:41:49,706::task::1185::TaskManager.Task::(prepare) Task=`479cb344-5f31-45f2-bbf1-9076df4d92d4`::finished: {} >Thread-15::DEBUG::2014-07-24 08:41:49,706::task::595::TaskManager.Task::(_updateState) Task=`479cb344-5f31-45f2-bbf1-9076df4d92d4`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:41:49,706::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:41:49,706::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:41:49,706::task::990::TaskManager.Task::(_decref) Task=`479cb344-5f31-45f2-bbf1-9076df4d92d4`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:42:05,010::task::595::TaskManager.Task::(_updateState) Task=`527d1c07-e0ee-49aa-b6f8-9ead1c3851ba`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:42:05,010::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:42:05,011::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:42:05,011::task::1185::TaskManager.Task::(prepare) Task=`527d1c07-e0ee-49aa-b6f8-9ead1c3851ba`::finished: {} >Thread-15::DEBUG::2014-07-24 08:42:05,011::task::595::TaskManager.Task::(_updateState) Task=`527d1c07-e0ee-49aa-b6f8-9ead1c3851ba`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:42:05,011::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:42:05,011::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:42:05,011::task::990::TaskManager.Task::(_decref) Task=`527d1c07-e0ee-49aa-b6f8-9ead1c3851ba`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:42:20,328::task::595::TaskManager.Task::(_updateState) Task=`d2089a29-27d7-43eb-9db1-7800bedac9dd`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:42:20,329::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:42:20,329::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:42:20,329::task::1185::TaskManager.Task::(prepare) Task=`d2089a29-27d7-43eb-9db1-7800bedac9dd`::finished: {} >Thread-15::DEBUG::2014-07-24 08:42:20,329::task::595::TaskManager.Task::(_updateState) Task=`d2089a29-27d7-43eb-9db1-7800bedac9dd`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:42:20,329::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:42:20,330::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:42:20,330::task::990::TaskManager.Task::(_decref) Task=`d2089a29-27d7-43eb-9db1-7800bedac9dd`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:42:35,648::task::595::TaskManager.Task::(_updateState) Task=`20139896-2b7e-4b5d-b173-8f3688a19c74`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:42:35,648::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:42:35,648::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:42:35,649::task::1185::TaskManager.Task::(prepare) Task=`20139896-2b7e-4b5d-b173-8f3688a19c74`::finished: {} >Thread-15::DEBUG::2014-07-24 08:42:35,649::task::595::TaskManager.Task::(_updateState) Task=`20139896-2b7e-4b5d-b173-8f3688a19c74`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:42:35,649::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:42:35,649::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:42:35,649::task::990::TaskManager.Task::(_decref) Task=`20139896-2b7e-4b5d-b173-8f3688a19c74`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:42:50,975::task::595::TaskManager.Task::(_updateState) Task=`f1588cfb-fa48-4e60-bf5c-1a36ae91e257`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:42:50,975::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:42:50,975::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:42:50,975::task::1185::TaskManager.Task::(prepare) Task=`f1588cfb-fa48-4e60-bf5c-1a36ae91e257`::finished: {} >Thread-15::DEBUG::2014-07-24 08:42:50,976::task::595::TaskManager.Task::(_updateState) Task=`f1588cfb-fa48-4e60-bf5c-1a36ae91e257`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:42:50,976::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:42:50,976::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:42:50,976::task::990::TaskManager.Task::(_decref) Task=`f1588cfb-fa48-4e60-bf5c-1a36ae91e257`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:43:06,314::task::595::TaskManager.Task::(_updateState) Task=`ba8f7e8f-57c3-4e29-bf27-afe423b216d1`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:43:06,314::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:43:06,315::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:43:06,315::task::1185::TaskManager.Task::(prepare) Task=`ba8f7e8f-57c3-4e29-bf27-afe423b216d1`::finished: {} >Thread-15::DEBUG::2014-07-24 08:43:06,315::task::595::TaskManager.Task::(_updateState) Task=`ba8f7e8f-57c3-4e29-bf27-afe423b216d1`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:43:06,315::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:43:06,315::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:43:06,315::task::990::TaskManager.Task::(_decref) Task=`ba8f7e8f-57c3-4e29-bf27-afe423b216d1`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:43:21,617::task::595::TaskManager.Task::(_updateState) Task=`59f4d5cd-e7ac-4d87-b296-49834285adc8`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:43:21,618::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:43:21,618::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:43:21,618::task::1185::TaskManager.Task::(prepare) Task=`59f4d5cd-e7ac-4d87-b296-49834285adc8`::finished: {} >Thread-15::DEBUG::2014-07-24 08:43:21,618::task::595::TaskManager.Task::(_updateState) Task=`59f4d5cd-e7ac-4d87-b296-49834285adc8`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:43:21,618::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:43:21,618::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:43:21,619::task::990::TaskManager.Task::(_decref) Task=`59f4d5cd-e7ac-4d87-b296-49834285adc8`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:43:36,982::task::595::TaskManager.Task::(_updateState) Task=`2ff70aeb-6d21-4544-9902-5c5e27c86616`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:43:36,983::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:43:36,983::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:43:36,983::task::1185::TaskManager.Task::(prepare) Task=`2ff70aeb-6d21-4544-9902-5c5e27c86616`::finished: {} >Thread-15::DEBUG::2014-07-24 08:43:36,983::task::595::TaskManager.Task::(_updateState) Task=`2ff70aeb-6d21-4544-9902-5c5e27c86616`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:43:36,983::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:43:36,984::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:43:36,984::task::990::TaskManager.Task::(_decref) Task=`2ff70aeb-6d21-4544-9902-5c5e27c86616`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:43:52,293::task::595::TaskManager.Task::(_updateState) Task=`bb16e863-6ff0-4b06-baae-4250af6c58b9`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:43:52,293::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:43:52,293::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:43:52,294::task::1185::TaskManager.Task::(prepare) Task=`bb16e863-6ff0-4b06-baae-4250af6c58b9`::finished: {} >Thread-15::DEBUG::2014-07-24 08:43:52,294::task::595::TaskManager.Task::(_updateState) Task=`bb16e863-6ff0-4b06-baae-4250af6c58b9`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:43:52,294::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:43:52,294::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:43:52,294::task::990::TaskManager.Task::(_decref) Task=`bb16e863-6ff0-4b06-baae-4250af6c58b9`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:44:07,593::task::595::TaskManager.Task::(_updateState) Task=`6fcd1303-009b-4c14-98a3-57bc8048c5a5`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:44:07,594::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:44:07,594::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:44:07,594::task::1185::TaskManager.Task::(prepare) Task=`6fcd1303-009b-4c14-98a3-57bc8048c5a5`::finished: {} >Thread-15::DEBUG::2014-07-24 08:44:07,594::task::595::TaskManager.Task::(_updateState) Task=`6fcd1303-009b-4c14-98a3-57bc8048c5a5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:44:07,594::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:44:07,595::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:44:07,595::task::990::TaskManager.Task::(_decref) Task=`6fcd1303-009b-4c14-98a3-57bc8048c5a5`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:44:22,910::task::595::TaskManager.Task::(_updateState) Task=`1d50f3f8-686d-47bd-b9f2-7d1309712892`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:44:22,910::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:44:22,910::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:44:22,910::task::1185::TaskManager.Task::(prepare) Task=`1d50f3f8-686d-47bd-b9f2-7d1309712892`::finished: {} >Thread-15::DEBUG::2014-07-24 08:44:22,910::task::595::TaskManager.Task::(_updateState) Task=`1d50f3f8-686d-47bd-b9f2-7d1309712892`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:44:22,911::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:44:22,911::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:44:22,911::task::990::TaskManager.Task::(_decref) Task=`1d50f3f8-686d-47bd-b9f2-7d1309712892`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:44:38,261::task::595::TaskManager.Task::(_updateState) Task=`dbb4eabb-c4f7-429c-b352-9302101b4a9f`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:44:38,261::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:44:38,261::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:44:38,261::task::1185::TaskManager.Task::(prepare) Task=`dbb4eabb-c4f7-429c-b352-9302101b4a9f`::finished: {} >Thread-15::DEBUG::2014-07-24 08:44:38,262::task::595::TaskManager.Task::(_updateState) Task=`dbb4eabb-c4f7-429c-b352-9302101b4a9f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:44:38,262::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:44:38,262::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:44:38,262::task::990::TaskManager.Task::(_decref) Task=`dbb4eabb-c4f7-429c-b352-9302101b4a9f`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:44:53,636::task::595::TaskManager.Task::(_updateState) Task=`3bd635ca-fa29-4623-8874-11750e682ed9`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:44:53,636::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:44:53,636::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:44:53,636::task::1185::TaskManager.Task::(prepare) Task=`3bd635ca-fa29-4623-8874-11750e682ed9`::finished: {} >Thread-15::DEBUG::2014-07-24 08:44:53,637::task::595::TaskManager.Task::(_updateState) Task=`3bd635ca-fa29-4623-8874-11750e682ed9`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:44:53,637::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:44:53,637::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:44:53,637::task::990::TaskManager.Task::(_decref) Task=`3bd635ca-fa29-4623-8874-11750e682ed9`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:45:09,392::task::595::TaskManager.Task::(_updateState) Task=`488f24f8-97a5-40f8-a9cf-194cebd79775`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:45:09,392::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:45:09,392::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:45:09,393::task::1185::TaskManager.Task::(prepare) Task=`488f24f8-97a5-40f8-a9cf-194cebd79775`::finished: {} >Thread-15::DEBUG::2014-07-24 08:45:09,393::task::595::TaskManager.Task::(_updateState) Task=`488f24f8-97a5-40f8-a9cf-194cebd79775`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:45:09,393::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:45:09,393::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:45:09,393::task::990::TaskManager.Task::(_decref) Task=`488f24f8-97a5-40f8-a9cf-194cebd79775`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:45:24,709::task::595::TaskManager.Task::(_updateState) Task=`b91fa514-dc76-4373-bc0c-b95abcb8688b`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:45:24,710::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:45:24,710::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:45:24,710::task::1185::TaskManager.Task::(prepare) Task=`b91fa514-dc76-4373-bc0c-b95abcb8688b`::finished: {} >Thread-15::DEBUG::2014-07-24 08:45:24,710::task::595::TaskManager.Task::(_updateState) Task=`b91fa514-dc76-4373-bc0c-b95abcb8688b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:45:24,710::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:45:24,710::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:45:24,711::task::990::TaskManager.Task::(_decref) Task=`b91fa514-dc76-4373-bc0c-b95abcb8688b`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:45:40,018::task::595::TaskManager.Task::(_updateState) Task=`36d950fc-957b-41c7-8fe5-71e7eafaf267`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:45:40,019::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:45:40,019::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:45:40,019::task::1185::TaskManager.Task::(prepare) Task=`36d950fc-957b-41c7-8fe5-71e7eafaf267`::finished: {} >Thread-15::DEBUG::2014-07-24 08:45:40,019::task::595::TaskManager.Task::(_updateState) Task=`36d950fc-957b-41c7-8fe5-71e7eafaf267`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:45:40,019::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:45:40,019::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:45:40,020::task::990::TaskManager.Task::(_decref) Task=`36d950fc-957b-41c7-8fe5-71e7eafaf267`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:45:55,333::task::595::TaskManager.Task::(_updateState) Task=`47c795ae-45d2-4d0f-8506-ed746fb5c7e7`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:45:55,334::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:45:55,334::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:45:55,334::task::1185::TaskManager.Task::(prepare) Task=`47c795ae-45d2-4d0f-8506-ed746fb5c7e7`::finished: {} >Thread-15::DEBUG::2014-07-24 08:45:55,334::task::595::TaskManager.Task::(_updateState) Task=`47c795ae-45d2-4d0f-8506-ed746fb5c7e7`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:45:55,334::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:45:55,334::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:45:55,334::task::990::TaskManager.Task::(_decref) Task=`47c795ae-45d2-4d0f-8506-ed746fb5c7e7`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:46:10,687::task::595::TaskManager.Task::(_updateState) Task=`0a35bf0a-c14d-4f85-8ec1-58add3674ddb`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:46:10,687::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:46:10,687::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:46:10,688::task::1185::TaskManager.Task::(prepare) Task=`0a35bf0a-c14d-4f85-8ec1-58add3674ddb`::finished: {} >Thread-15::DEBUG::2014-07-24 08:46:10,688::task::595::TaskManager.Task::(_updateState) Task=`0a35bf0a-c14d-4f85-8ec1-58add3674ddb`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:46:10,688::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:46:10,688::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:46:10,688::task::990::TaskManager.Task::(_decref) Task=`0a35bf0a-c14d-4f85-8ec1-58add3674ddb`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:46:26,093::task::595::TaskManager.Task::(_updateState) Task=`d6921f5a-d24d-4d53-bec0-06e22265c9e0`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:46:26,094::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:46:26,094::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:46:26,094::task::1185::TaskManager.Task::(prepare) Task=`d6921f5a-d24d-4d53-bec0-06e22265c9e0`::finished: {} >Thread-15::DEBUG::2014-07-24 08:46:26,094::task::595::TaskManager.Task::(_updateState) Task=`d6921f5a-d24d-4d53-bec0-06e22265c9e0`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:46:26,094::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:46:26,094::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:46:26,095::task::990::TaskManager.Task::(_decref) Task=`d6921f5a-d24d-4d53-bec0-06e22265c9e0`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:46:41,410::task::595::TaskManager.Task::(_updateState) Task=`cca7b206-6197-462a-b7be-5d8446cec7a3`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:46:41,410::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:46:41,411::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:46:41,411::task::1185::TaskManager.Task::(prepare) Task=`cca7b206-6197-462a-b7be-5d8446cec7a3`::finished: {} >Thread-15::DEBUG::2014-07-24 08:46:41,411::task::595::TaskManager.Task::(_updateState) Task=`cca7b206-6197-462a-b7be-5d8446cec7a3`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:46:41,411::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:46:41,411::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:46:41,411::task::990::TaskManager.Task::(_decref) Task=`cca7b206-6197-462a-b7be-5d8446cec7a3`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:46:56,711::task::595::TaskManager.Task::(_updateState) Task=`4a71a48f-766b-421b-a4fb-e2f84103cecb`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:46:56,711::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:46:56,711::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:46:56,712::task::1185::TaskManager.Task::(prepare) Task=`4a71a48f-766b-421b-a4fb-e2f84103cecb`::finished: {} >Thread-15::DEBUG::2014-07-24 08:46:56,712::task::595::TaskManager.Task::(_updateState) Task=`4a71a48f-766b-421b-a4fb-e2f84103cecb`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:46:56,712::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:46:56,712::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:46:56,712::task::990::TaskManager.Task::(_decref) Task=`4a71a48f-766b-421b-a4fb-e2f84103cecb`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:47:12,023::task::595::TaskManager.Task::(_updateState) Task=`4f0356e9-e0d9-4cd7-992f-03bedd20e6fd`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:47:12,023::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:47:12,023::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:47:12,023::task::1185::TaskManager.Task::(prepare) Task=`4f0356e9-e0d9-4cd7-992f-03bedd20e6fd`::finished: {} >Thread-15::DEBUG::2014-07-24 08:47:12,023::task::595::TaskManager.Task::(_updateState) Task=`4f0356e9-e0d9-4cd7-992f-03bedd20e6fd`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:47:12,024::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:47:12,024::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:47:12,024::task::990::TaskManager.Task::(_decref) Task=`4f0356e9-e0d9-4cd7-992f-03bedd20e6fd`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:47:27,378::task::595::TaskManager.Task::(_updateState) Task=`16b166a0-07d2-476d-a9f0-a87c4a26704e`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:47:27,378::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:47:27,378::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:47:27,378::task::1185::TaskManager.Task::(prepare) Task=`16b166a0-07d2-476d-a9f0-a87c4a26704e`::finished: {} >Thread-15::DEBUG::2014-07-24 08:47:27,379::task::595::TaskManager.Task::(_updateState) Task=`16b166a0-07d2-476d-a9f0-a87c4a26704e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:47:27,379::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:47:27,379::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:47:27,379::task::990::TaskManager.Task::(_decref) Task=`16b166a0-07d2-476d-a9f0-a87c4a26704e`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:47:42,705::task::595::TaskManager.Task::(_updateState) Task=`d4384bd4-84d8-4da3-8ac8-ad90f5c5e284`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:47:42,705::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:47:42,706::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:47:42,706::task::1185::TaskManager.Task::(prepare) Task=`d4384bd4-84d8-4da3-8ac8-ad90f5c5e284`::finished: {} >Thread-15::DEBUG::2014-07-24 08:47:42,706::task::595::TaskManager.Task::(_updateState) Task=`d4384bd4-84d8-4da3-8ac8-ad90f5c5e284`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:47:42,706::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:47:42,706::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:47:42,706::task::990::TaskManager.Task::(_decref) Task=`d4384bd4-84d8-4da3-8ac8-ad90f5c5e284`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:47:58,020::task::595::TaskManager.Task::(_updateState) Task=`ca7bf558-252a-4423-9cef-3f6c1575d89b`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:47:58,021::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:47:58,021::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:47:58,021::task::1185::TaskManager.Task::(prepare) Task=`ca7bf558-252a-4423-9cef-3f6c1575d89b`::finished: {} >Thread-15::DEBUG::2014-07-24 08:47:58,021::task::595::TaskManager.Task::(_updateState) Task=`ca7bf558-252a-4423-9cef-3f6c1575d89b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:47:58,021::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:47:58,022::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:47:58,022::task::990::TaskManager.Task::(_decref) Task=`ca7bf558-252a-4423-9cef-3f6c1575d89b`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:48:13,386::task::595::TaskManager.Task::(_updateState) Task=`6a74d3d6-fec5-4534-bf0a-0da913617f8f`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:48:13,386::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:48:13,387::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:48:13,387::task::1185::TaskManager.Task::(prepare) Task=`6a74d3d6-fec5-4534-bf0a-0da913617f8f`::finished: {} >Thread-15::DEBUG::2014-07-24 08:48:13,387::task::595::TaskManager.Task::(_updateState) Task=`6a74d3d6-fec5-4534-bf0a-0da913617f8f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:48:13,387::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:48:13,387::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:48:13,387::task::990::TaskManager.Task::(_decref) Task=`6a74d3d6-fec5-4534-bf0a-0da913617f8f`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:48:28,734::task::595::TaskManager.Task::(_updateState) Task=`647514c9-8585-46db-9727-49e51116d533`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:48:28,735::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:48:28,735::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:48:28,735::task::1185::TaskManager.Task::(prepare) Task=`647514c9-8585-46db-9727-49e51116d533`::finished: {} >Thread-15::DEBUG::2014-07-24 08:48:28,735::task::595::TaskManager.Task::(_updateState) Task=`647514c9-8585-46db-9727-49e51116d533`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:48:28,735::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:48:28,735::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:48:28,736::task::990::TaskManager.Task::(_decref) Task=`647514c9-8585-46db-9727-49e51116d533`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:48:44,109::task::595::TaskManager.Task::(_updateState) Task=`b1369592-7555-4ed4-8da9-1cdcdd6d0cff`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:48:44,110::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:48:44,110::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:48:44,110::task::1185::TaskManager.Task::(prepare) Task=`b1369592-7555-4ed4-8da9-1cdcdd6d0cff`::finished: {} >Thread-15::DEBUG::2014-07-24 08:48:44,110::task::595::TaskManager.Task::(_updateState) Task=`b1369592-7555-4ed4-8da9-1cdcdd6d0cff`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:48:44,110::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:48:44,111::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:48:44,111::task::990::TaskManager.Task::(_decref) Task=`b1369592-7555-4ed4-8da9-1cdcdd6d0cff`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:48:59,596::task::595::TaskManager.Task::(_updateState) Task=`f28dd9ed-5f8f-4615-89dc-aa0ec7264997`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:48:59,596::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:48:59,597::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:48:59,597::task::1185::TaskManager.Task::(prepare) Task=`f28dd9ed-5f8f-4615-89dc-aa0ec7264997`::finished: {} >Thread-15::DEBUG::2014-07-24 08:48:59,597::task::595::TaskManager.Task::(_updateState) Task=`f28dd9ed-5f8f-4615-89dc-aa0ec7264997`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:48:59,597::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:48:59,597::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:48:59,597::task::990::TaskManager.Task::(_decref) Task=`f28dd9ed-5f8f-4615-89dc-aa0ec7264997`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:49:15,070::task::595::TaskManager.Task::(_updateState) Task=`513fe167-e3ba-44d5-912c-eefa5ddb588c`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:49:15,071::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:49:15,071::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:49:15,071::task::1185::TaskManager.Task::(prepare) Task=`513fe167-e3ba-44d5-912c-eefa5ddb588c`::finished: {} >Thread-15::DEBUG::2014-07-24 08:49:15,071::task::595::TaskManager.Task::(_updateState) Task=`513fe167-e3ba-44d5-912c-eefa5ddb588c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:49:15,071::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:49:15,072::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:49:15,072::task::990::TaskManager.Task::(_decref) Task=`513fe167-e3ba-44d5-912c-eefa5ddb588c`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:49:30,558::task::595::TaskManager.Task::(_updateState) Task=`82daa487-45e8-497d-9c92-533ca91a7ac7`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:49:30,558::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:49:30,558::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:49:30,558::task::1185::TaskManager.Task::(prepare) Task=`82daa487-45e8-497d-9c92-533ca91a7ac7`::finished: {} >Thread-15::DEBUG::2014-07-24 08:49:30,558::task::595::TaskManager.Task::(_updateState) Task=`82daa487-45e8-497d-9c92-533ca91a7ac7`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:49:30,559::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:49:30,559::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:49:30,559::task::990::TaskManager.Task::(_decref) Task=`82daa487-45e8-497d-9c92-533ca91a7ac7`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:49:46,043::task::595::TaskManager.Task::(_updateState) Task=`467fad21-278f-4885-8120-13a5fe762758`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:49:46,043::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:49:46,043::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:49:46,044::task::1185::TaskManager.Task::(prepare) Task=`467fad21-278f-4885-8120-13a5fe762758`::finished: {} >Thread-15::DEBUG::2014-07-24 08:49:46,044::task::595::TaskManager.Task::(_updateState) Task=`467fad21-278f-4885-8120-13a5fe762758`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:49:46,044::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:49:46,044::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:49:46,044::task::990::TaskManager.Task::(_decref) Task=`467fad21-278f-4885-8120-13a5fe762758`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:50:01,554::task::595::TaskManager.Task::(_updateState) Task=`c94fcb71-e76a-4158-a476-2ded8fd44cc8`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:50:01,555::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:50:01,555::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:50:01,555::task::1185::TaskManager.Task::(prepare) Task=`c94fcb71-e76a-4158-a476-2ded8fd44cc8`::finished: {} >Thread-15::DEBUG::2014-07-24 08:50:01,555::task::595::TaskManager.Task::(_updateState) Task=`c94fcb71-e76a-4158-a476-2ded8fd44cc8`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:50:01,555::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:50:01,555::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:50:01,556::task::990::TaskManager.Task::(_decref) Task=`c94fcb71-e76a-4158-a476-2ded8fd44cc8`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:50:17,337::task::595::TaskManager.Task::(_updateState) Task=`cf148ba4-a6a6-486b-a117-b191a17b9294`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:50:17,337::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:50:17,338::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:50:17,338::task::1185::TaskManager.Task::(prepare) Task=`cf148ba4-a6a6-486b-a117-b191a17b9294`::finished: {} >Thread-15::DEBUG::2014-07-24 08:50:17,338::task::595::TaskManager.Task::(_updateState) Task=`cf148ba4-a6a6-486b-a117-b191a17b9294`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:50:17,338::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:50:17,338::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:50:17,338::task::990::TaskManager.Task::(_decref) Task=`cf148ba4-a6a6-486b-a117-b191a17b9294`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:50:32,759::task::595::TaskManager.Task::(_updateState) Task=`2cfafb42-fefc-4c29-9ab1-2dce5350c1a2`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:50:32,760::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:50:32,760::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:50:32,760::task::1185::TaskManager.Task::(prepare) Task=`2cfafb42-fefc-4c29-9ab1-2dce5350c1a2`::finished: {} >Thread-15::DEBUG::2014-07-24 08:50:32,760::task::595::TaskManager.Task::(_updateState) Task=`2cfafb42-fefc-4c29-9ab1-2dce5350c1a2`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:50:32,760::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:50:32,761::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:50:32,761::task::990::TaskManager.Task::(_decref) Task=`2cfafb42-fefc-4c29-9ab1-2dce5350c1a2`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:50:48,083::task::595::TaskManager.Task::(_updateState) Task=`b6df392b-96d3-482f-b5bf-159c679b8b79`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:50:48,083::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:50:48,083::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:50:48,083::task::1185::TaskManager.Task::(prepare) Task=`b6df392b-96d3-482f-b5bf-159c679b8b79`::finished: {} >Thread-15::DEBUG::2014-07-24 08:50:48,083::task::595::TaskManager.Task::(_updateState) Task=`b6df392b-96d3-482f-b5bf-159c679b8b79`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:50:48,084::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:50:48,084::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:50:48,084::task::990::TaskManager.Task::(_decref) Task=`b6df392b-96d3-482f-b5bf-159c679b8b79`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:51:03,399::task::595::TaskManager.Task::(_updateState) Task=`8b84b360-c7e2-4b02-a18d-2256886c9a2e`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:51:03,399::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:51:03,399::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:51:03,399::task::1185::TaskManager.Task::(prepare) Task=`8b84b360-c7e2-4b02-a18d-2256886c9a2e`::finished: {} >Thread-15::DEBUG::2014-07-24 08:51:03,400::task::595::TaskManager.Task::(_updateState) Task=`8b84b360-c7e2-4b02-a18d-2256886c9a2e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:51:03,400::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:51:03,400::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:51:03,400::task::990::TaskManager.Task::(_decref) Task=`8b84b360-c7e2-4b02-a18d-2256886c9a2e`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:51:18,714::task::595::TaskManager.Task::(_updateState) Task=`439d4787-e605-4fc2-b6ab-6998e1f36fc9`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:51:18,714::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:51:18,714::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:51:18,715::task::1185::TaskManager.Task::(prepare) Task=`439d4787-e605-4fc2-b6ab-6998e1f36fc9`::finished: {} >Thread-15::DEBUG::2014-07-24 08:51:18,715::task::595::TaskManager.Task::(_updateState) Task=`439d4787-e605-4fc2-b6ab-6998e1f36fc9`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:51:18,715::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:51:18,715::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:51:18,715::task::990::TaskManager.Task::(_decref) Task=`439d4787-e605-4fc2-b6ab-6998e1f36fc9`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:51:34,013::task::595::TaskManager.Task::(_updateState) Task=`6a0b20ed-ec7d-49b9-8b7e-b58bb037e496`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:51:34,013::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:51:34,014::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:51:34,014::task::1185::TaskManager.Task::(prepare) Task=`6a0b20ed-ec7d-49b9-8b7e-b58bb037e496`::finished: {} >Thread-15::DEBUG::2014-07-24 08:51:34,014::task::595::TaskManager.Task::(_updateState) Task=`6a0b20ed-ec7d-49b9-8b7e-b58bb037e496`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:51:34,014::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:51:34,014::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:51:34,014::task::990::TaskManager.Task::(_decref) Task=`6a0b20ed-ec7d-49b9-8b7e-b58bb037e496`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:51:49,309::task::595::TaskManager.Task::(_updateState) Task=`f35c290d-59ab-4797-afd4-3e5b58cee9ce`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:51:49,309::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:51:49,309::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:51:49,309::task::1185::TaskManager.Task::(prepare) Task=`f35c290d-59ab-4797-afd4-3e5b58cee9ce`::finished: {} >Thread-15::DEBUG::2014-07-24 08:51:49,310::task::595::TaskManager.Task::(_updateState) Task=`f35c290d-59ab-4797-afd4-3e5b58cee9ce`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:51:49,310::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:51:49,310::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:51:49,310::task::990::TaskManager.Task::(_decref) Task=`f35c290d-59ab-4797-afd4-3e5b58cee9ce`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:52:04,691::task::595::TaskManager.Task::(_updateState) Task=`1fcf3e74-bed0-4ea6-ba63-c16544437bbb`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:52:04,691::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:52:04,692::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:52:04,692::task::1185::TaskManager.Task::(prepare) Task=`1fcf3e74-bed0-4ea6-ba63-c16544437bbb`::finished: {} >Thread-15::DEBUG::2014-07-24 08:52:04,692::task::595::TaskManager.Task::(_updateState) Task=`1fcf3e74-bed0-4ea6-ba63-c16544437bbb`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:52:04,692::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:52:04,692::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:52:04,692::task::990::TaskManager.Task::(_decref) Task=`1fcf3e74-bed0-4ea6-ba63-c16544437bbb`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:52:19,988::task::595::TaskManager.Task::(_updateState) Task=`08fe053d-3c3d-4cd4-84dd-535c08994391`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:52:19,988::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:52:19,989::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:52:19,989::task::1185::TaskManager.Task::(prepare) Task=`08fe053d-3c3d-4cd4-84dd-535c08994391`::finished: {} >Thread-15::DEBUG::2014-07-24 08:52:19,989::task::595::TaskManager.Task::(_updateState) Task=`08fe053d-3c3d-4cd4-84dd-535c08994391`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:52:19,989::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:52:19,989::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:52:19,989::task::990::TaskManager.Task::(_decref) Task=`08fe053d-3c3d-4cd4-84dd-535c08994391`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:52:35,319::task::595::TaskManager.Task::(_updateState) Task=`81909254-da2c-4864-ba55-d0be1e1fd10c`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:52:35,319::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:52:35,319::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:52:35,319::task::1185::TaskManager.Task::(prepare) Task=`81909254-da2c-4864-ba55-d0be1e1fd10c`::finished: {} >Thread-15::DEBUG::2014-07-24 08:52:35,319::task::595::TaskManager.Task::(_updateState) Task=`81909254-da2c-4864-ba55-d0be1e1fd10c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:52:35,320::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:52:35,320::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:52:35,320::task::990::TaskManager.Task::(_decref) Task=`81909254-da2c-4864-ba55-d0be1e1fd10c`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:52:50,624::task::595::TaskManager.Task::(_updateState) Task=`09d5f5af-6367-4010-b8dd-a35ba95ae79d`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:52:50,625::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:52:50,625::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:52:50,625::task::1185::TaskManager.Task::(prepare) Task=`09d5f5af-6367-4010-b8dd-a35ba95ae79d`::finished: {} >Thread-15::DEBUG::2014-07-24 08:52:50,625::task::595::TaskManager.Task::(_updateState) Task=`09d5f5af-6367-4010-b8dd-a35ba95ae79d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:52:50,625::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:52:50,625::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:52:50,626::task::990::TaskManager.Task::(_decref) Task=`09d5f5af-6367-4010-b8dd-a35ba95ae79d`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:53:05,938::task::595::TaskManager.Task::(_updateState) Task=`09a134f3-a69f-4e92-bd1c-b63aaa2ba67c`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:53:05,938::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:53:05,938::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:53:05,939::task::1185::TaskManager.Task::(prepare) Task=`09a134f3-a69f-4e92-bd1c-b63aaa2ba67c`::finished: {} >Thread-15::DEBUG::2014-07-24 08:53:05,939::task::595::TaskManager.Task::(_updateState) Task=`09a134f3-a69f-4e92-bd1c-b63aaa2ba67c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:53:05,939::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:53:05,939::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:53:05,939::task::990::TaskManager.Task::(_decref) Task=`09a134f3-a69f-4e92-bd1c-b63aaa2ba67c`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:53:21,236::task::595::TaskManager.Task::(_updateState) Task=`5c6b4064-f02e-4fe0-b0d8-65f1e5657f1f`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:53:21,237::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:53:21,237::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:53:21,237::task::1185::TaskManager.Task::(prepare) Task=`5c6b4064-f02e-4fe0-b0d8-65f1e5657f1f`::finished: {} >Thread-15::DEBUG::2014-07-24 08:53:21,237::task::595::TaskManager.Task::(_updateState) Task=`5c6b4064-f02e-4fe0-b0d8-65f1e5657f1f`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:53:21,237::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:53:21,237::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:53:21,238::task::990::TaskManager.Task::(_decref) Task=`5c6b4064-f02e-4fe0-b0d8-65f1e5657f1f`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:53:36,567::task::595::TaskManager.Task::(_updateState) Task=`d60bd7a0-8382-4d43-b4c0-d8acc9cd213a`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:53:36,567::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:53:36,567::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:53:36,568::task::1185::TaskManager.Task::(prepare) Task=`d60bd7a0-8382-4d43-b4c0-d8acc9cd213a`::finished: {} >Thread-15::DEBUG::2014-07-24 08:53:36,568::task::595::TaskManager.Task::(_updateState) Task=`d60bd7a0-8382-4d43-b4c0-d8acc9cd213a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:53:36,568::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:53:36,568::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:53:36,568::task::990::TaskManager.Task::(_decref) Task=`d60bd7a0-8382-4d43-b4c0-d8acc9cd213a`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:53:51,883::task::595::TaskManager.Task::(_updateState) Task=`c0830103-15ed-49e8-960e-9b7545eb34cb`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:53:51,883::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:53:51,883::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:53:51,883::task::1185::TaskManager.Task::(prepare) Task=`c0830103-15ed-49e8-960e-9b7545eb34cb`::finished: {} >Thread-15::DEBUG::2014-07-24 08:53:51,883::task::595::TaskManager.Task::(_updateState) Task=`c0830103-15ed-49e8-960e-9b7545eb34cb`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:53:51,883::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:53:51,884::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:53:51,884::task::990::TaskManager.Task::(_decref) Task=`c0830103-15ed-49e8-960e-9b7545eb34cb`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:54:07,180::task::595::TaskManager.Task::(_updateState) Task=`36c4f2f3-ed00-4230-9136-b15a4d3d42b8`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:54:07,180::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:54:07,180::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:54:07,180::task::1185::TaskManager.Task::(prepare) Task=`36c4f2f3-ed00-4230-9136-b15a4d3d42b8`::finished: {} >Thread-15::DEBUG::2014-07-24 08:54:07,181::task::595::TaskManager.Task::(_updateState) Task=`36c4f2f3-ed00-4230-9136-b15a4d3d42b8`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:54:07,181::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:54:07,181::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:54:07,181::task::990::TaskManager.Task::(_decref) Task=`36c4f2f3-ed00-4230-9136-b15a4d3d42b8`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:54:22,506::task::595::TaskManager.Task::(_updateState) Task=`a761c004-d781-4651-bcb7-2ef37ad768bf`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:54:22,507::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:54:22,507::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:54:22,507::task::1185::TaskManager.Task::(prepare) Task=`a761c004-d781-4651-bcb7-2ef37ad768bf`::finished: {} >Thread-15::DEBUG::2014-07-24 08:54:22,507::task::595::TaskManager.Task::(_updateState) Task=`a761c004-d781-4651-bcb7-2ef37ad768bf`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:54:22,507::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:54:22,507::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:54:22,508::task::990::TaskManager.Task::(_decref) Task=`a761c004-d781-4651-bcb7-2ef37ad768bf`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:54:37,804::task::595::TaskManager.Task::(_updateState) Task=`13ab388b-b282-4ce4-a51a-f667eb220466`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:54:37,804::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:54:37,804::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:54:37,804::task::1185::TaskManager.Task::(prepare) Task=`13ab388b-b282-4ce4-a51a-f667eb220466`::finished: {} >Thread-15::DEBUG::2014-07-24 08:54:37,804::task::595::TaskManager.Task::(_updateState) Task=`13ab388b-b282-4ce4-a51a-f667eb220466`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:54:37,805::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:54:37,805::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:54:37,805::task::990::TaskManager.Task::(_decref) Task=`13ab388b-b282-4ce4-a51a-f667eb220466`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:54:53,117::task::595::TaskManager.Task::(_updateState) Task=`5913c023-0532-48f2-a1c5-43081c1f31c5`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:54:53,117::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:54:53,117::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:54:53,117::task::1185::TaskManager.Task::(prepare) Task=`5913c023-0532-48f2-a1c5-43081c1f31c5`::finished: {} >Thread-15::DEBUG::2014-07-24 08:54:53,117::task::595::TaskManager.Task::(_updateState) Task=`5913c023-0532-48f2-a1c5-43081c1f31c5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:54:53,118::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:54:53,118::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:54:53,118::task::990::TaskManager.Task::(_decref) Task=`5913c023-0532-48f2-a1c5-43081c1f31c5`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:55:08,746::task::595::TaskManager.Task::(_updateState) Task=`2f815f8e-dbdd-4650-b4b1-d413c420c56c`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:55:08,746::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:55:08,746::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:55:08,746::task::1185::TaskManager.Task::(prepare) Task=`2f815f8e-dbdd-4650-b4b1-d413c420c56c`::finished: {} >Thread-15::DEBUG::2014-07-24 08:55:08,746::task::595::TaskManager.Task::(_updateState) Task=`2f815f8e-dbdd-4650-b4b1-d413c420c56c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:55:08,747::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:55:08,747::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:55:08,747::task::990::TaskManager.Task::(_decref) Task=`2f815f8e-dbdd-4650-b4b1-d413c420c56c`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:55:24,084::task::595::TaskManager.Task::(_updateState) Task=`25bd7201-cb90-497d-ab2d-81876cc2939a`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:55:24,084::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:55:24,085::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:55:24,085::task::1185::TaskManager.Task::(prepare) Task=`25bd7201-cb90-497d-ab2d-81876cc2939a`::finished: {} >Thread-15::DEBUG::2014-07-24 08:55:24,085::task::595::TaskManager.Task::(_updateState) Task=`25bd7201-cb90-497d-ab2d-81876cc2939a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:55:24,085::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:55:24,085::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:55:24,085::task::990::TaskManager.Task::(_decref) Task=`25bd7201-cb90-497d-ab2d-81876cc2939a`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:55:39,379::task::595::TaskManager.Task::(_updateState) Task=`d39200c7-cafe-45bb-8c85-053404f731ae`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:55:39,380::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:55:39,380::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:55:39,380::task::1185::TaskManager.Task::(prepare) Task=`d39200c7-cafe-45bb-8c85-053404f731ae`::finished: {} >Thread-15::DEBUG::2014-07-24 08:55:39,380::task::595::TaskManager.Task::(_updateState) Task=`d39200c7-cafe-45bb-8c85-053404f731ae`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:55:39,380::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:55:39,380::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:55:39,381::task::990::TaskManager.Task::(_decref) Task=`d39200c7-cafe-45bb-8c85-053404f731ae`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:55:54,685::task::595::TaskManager.Task::(_updateState) Task=`788eec10-4e83-474b-9d0d-f22af361628a`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:55:54,685::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:55:54,685::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:55:54,686::task::1185::TaskManager.Task::(prepare) Task=`788eec10-4e83-474b-9d0d-f22af361628a`::finished: {} >Thread-15::DEBUG::2014-07-24 08:55:54,686::task::595::TaskManager.Task::(_updateState) Task=`788eec10-4e83-474b-9d0d-f22af361628a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:55:54,686::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:55:54,686::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:55:54,686::task::990::TaskManager.Task::(_decref) Task=`788eec10-4e83-474b-9d0d-f22af361628a`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:56:10,012::task::595::TaskManager.Task::(_updateState) Task=`05e01eac-93c8-42c8-84fa-2f13a30d30de`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:56:10,012::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:56:10,012::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:56:10,012::task::1185::TaskManager.Task::(prepare) Task=`05e01eac-93c8-42c8-84fa-2f13a30d30de`::finished: {} >Thread-15::DEBUG::2014-07-24 08:56:10,012::task::595::TaskManager.Task::(_updateState) Task=`05e01eac-93c8-42c8-84fa-2f13a30d30de`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:56:10,013::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:56:10,013::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:56:10,013::task::990::TaskManager.Task::(_decref) Task=`05e01eac-93c8-42c8-84fa-2f13a30d30de`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:56:25,347::task::595::TaskManager.Task::(_updateState) Task=`82b07cc5-0954-4fdf-b336-147bf0d92b55`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:56:25,347::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:56:25,347::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:56:25,348::task::1185::TaskManager.Task::(prepare) Task=`82b07cc5-0954-4fdf-b336-147bf0d92b55`::finished: {} >Thread-15::DEBUG::2014-07-24 08:56:25,348::task::595::TaskManager.Task::(_updateState) Task=`82b07cc5-0954-4fdf-b336-147bf0d92b55`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:56:25,348::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:56:25,348::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:56:25,348::task::990::TaskManager.Task::(_decref) Task=`82b07cc5-0954-4fdf-b336-147bf0d92b55`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:56:40,721::task::595::TaskManager.Task::(_updateState) Task=`5d29eda4-ccce-447b-aa2f-353dcec0f24a`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:56:40,722::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:56:40,722::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:56:40,722::task::1185::TaskManager.Task::(prepare) Task=`5d29eda4-ccce-447b-aa2f-353dcec0f24a`::finished: {} >Thread-15::DEBUG::2014-07-24 08:56:40,722::task::595::TaskManager.Task::(_updateState) Task=`5d29eda4-ccce-447b-aa2f-353dcec0f24a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:56:40,722::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:56:40,723::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:56:40,723::task::990::TaskManager.Task::(_decref) Task=`5d29eda4-ccce-447b-aa2f-353dcec0f24a`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:56:56,008::task::595::TaskManager.Task::(_updateState) Task=`69a42294-a64b-482f-b8fd-c7c507bfadd0`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:56:56,009::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:56:56,009::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:56:56,009::task::1185::TaskManager.Task::(prepare) Task=`69a42294-a64b-482f-b8fd-c7c507bfadd0`::finished: {} >Thread-15::DEBUG::2014-07-24 08:56:56,009::task::595::TaskManager.Task::(_updateState) Task=`69a42294-a64b-482f-b8fd-c7c507bfadd0`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:56:56,009::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:56:56,009::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:56:56,010::task::990::TaskManager.Task::(_decref) Task=`69a42294-a64b-482f-b8fd-c7c507bfadd0`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:57:11,315::task::595::TaskManager.Task::(_updateState) Task=`b0157e6c-12bb-4fdc-9186-afe441dd575b`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:57:11,315::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:57:11,316::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:57:11,316::task::1185::TaskManager.Task::(prepare) Task=`b0157e6c-12bb-4fdc-9186-afe441dd575b`::finished: {} >Thread-15::DEBUG::2014-07-24 08:57:11,316::task::595::TaskManager.Task::(_updateState) Task=`b0157e6c-12bb-4fdc-9186-afe441dd575b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:57:11,316::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:57:11,316::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:57:11,316::task::990::TaskManager.Task::(_decref) Task=`b0157e6c-12bb-4fdc-9186-afe441dd575b`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:57:26,647::task::595::TaskManager.Task::(_updateState) Task=`c4cf90bd-e630-4c21-8ea8-d3704b1490b4`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:57:26,647::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:57:26,647::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:57:26,647::task::1185::TaskManager.Task::(prepare) Task=`c4cf90bd-e630-4c21-8ea8-d3704b1490b4`::finished: {} >Thread-15::DEBUG::2014-07-24 08:57:26,648::task::595::TaskManager.Task::(_updateState) Task=`c4cf90bd-e630-4c21-8ea8-d3704b1490b4`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:57:26,648::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:57:26,648::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:57:26,648::task::990::TaskManager.Task::(_decref) Task=`c4cf90bd-e630-4c21-8ea8-d3704b1490b4`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:57:41,999::task::595::TaskManager.Task::(_updateState) Task=`795c8ae3-9746-43ea-a0c1-2f2198331b4e`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:57:42,000::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:57:42,000::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:57:42,000::task::1185::TaskManager.Task::(prepare) Task=`795c8ae3-9746-43ea-a0c1-2f2198331b4e`::finished: {} >Thread-15::DEBUG::2014-07-24 08:57:42,000::task::595::TaskManager.Task::(_updateState) Task=`795c8ae3-9746-43ea-a0c1-2f2198331b4e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:57:42,000::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:57:42,001::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:57:42,001::task::990::TaskManager.Task::(_decref) Task=`795c8ae3-9746-43ea-a0c1-2f2198331b4e`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:57:57,304::task::595::TaskManager.Task::(_updateState) Task=`df16f0af-a202-4fa6-b68a-fc9d47ffa1eb`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:57:57,304::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:57:57,305::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:57:57,305::task::1185::TaskManager.Task::(prepare) Task=`df16f0af-a202-4fa6-b68a-fc9d47ffa1eb`::finished: {} >Thread-15::DEBUG::2014-07-24 08:57:57,305::task::595::TaskManager.Task::(_updateState) Task=`df16f0af-a202-4fa6-b68a-fc9d47ffa1eb`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:57:57,305::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:57:57,305::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:57:57,305::task::990::TaskManager.Task::(_decref) Task=`df16f0af-a202-4fa6-b68a-fc9d47ffa1eb`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:58:12,660::task::595::TaskManager.Task::(_updateState) Task=`5e91e8ce-d78e-42c2-ab59-9f545ea4afd2`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:58:12,660::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:58:12,660::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:58:12,661::task::1185::TaskManager.Task::(prepare) Task=`5e91e8ce-d78e-42c2-ab59-9f545ea4afd2`::finished: {} >Thread-15::DEBUG::2014-07-24 08:58:12,661::task::595::TaskManager.Task::(_updateState) Task=`5e91e8ce-d78e-42c2-ab59-9f545ea4afd2`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:58:12,661::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:58:12,661::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:58:12,661::task::990::TaskManager.Task::(_decref) Task=`5e91e8ce-d78e-42c2-ab59-9f545ea4afd2`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:58:27,965::task::595::TaskManager.Task::(_updateState) Task=`f2c22a46-4841-4b2f-a8ad-d22b81002bb0`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:58:27,965::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:58:27,965::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:58:27,966::task::1185::TaskManager.Task::(prepare) Task=`f2c22a46-4841-4b2f-a8ad-d22b81002bb0`::finished: {} >Thread-15::DEBUG::2014-07-24 08:58:27,966::task::595::TaskManager.Task::(_updateState) Task=`f2c22a46-4841-4b2f-a8ad-d22b81002bb0`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:58:27,966::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:58:27,966::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:58:27,966::task::990::TaskManager.Task::(_decref) Task=`f2c22a46-4841-4b2f-a8ad-d22b81002bb0`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:58:43,267::task::595::TaskManager.Task::(_updateState) Task=`1deb73a1-68b0-4771-a2b9-c507f4c90644`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:58:43,267::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:58:43,268::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:58:43,268::task::1185::TaskManager.Task::(prepare) Task=`1deb73a1-68b0-4771-a2b9-c507f4c90644`::finished: {} >Thread-15::DEBUG::2014-07-24 08:58:43,268::task::595::TaskManager.Task::(_updateState) Task=`1deb73a1-68b0-4771-a2b9-c507f4c90644`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:58:43,268::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:58:43,268::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:58:43,268::task::990::TaskManager.Task::(_decref) Task=`1deb73a1-68b0-4771-a2b9-c507f4c90644`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:58:58,576::task::595::TaskManager.Task::(_updateState) Task=`cc9a0275-7b2e-43ee-a70d-f5d93cfeed96`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:58:58,576::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:58:58,576::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:58:58,577::task::1185::TaskManager.Task::(prepare) Task=`cc9a0275-7b2e-43ee-a70d-f5d93cfeed96`::finished: {} >Thread-15::DEBUG::2014-07-24 08:58:58,577::task::595::TaskManager.Task::(_updateState) Task=`cc9a0275-7b2e-43ee-a70d-f5d93cfeed96`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:58:58,577::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:58:58,577::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:58:58,577::task::990::TaskManager.Task::(_decref) Task=`cc9a0275-7b2e-43ee-a70d-f5d93cfeed96`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:59:13,872::task::595::TaskManager.Task::(_updateState) Task=`85420761-cee8-4c53-90df-d5652c3b99c5`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:59:13,872::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:59:13,873::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:59:13,873::task::1185::TaskManager.Task::(prepare) Task=`85420761-cee8-4c53-90df-d5652c3b99c5`::finished: {} >Thread-15::DEBUG::2014-07-24 08:59:13,873::task::595::TaskManager.Task::(_updateState) Task=`85420761-cee8-4c53-90df-d5652c3b99c5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:59:13,873::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:59:13,873::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:59:13,873::task::990::TaskManager.Task::(_decref) Task=`85420761-cee8-4c53-90df-d5652c3b99c5`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:59:29,170::task::595::TaskManager.Task::(_updateState) Task=`45abd060-22cf-4f31-98eb-fe5b5c538786`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:59:29,171::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:59:29,171::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:59:29,171::task::1185::TaskManager.Task::(prepare) Task=`45abd060-22cf-4f31-98eb-fe5b5c538786`::finished: {} >Thread-15::DEBUG::2014-07-24 08:59:29,171::task::595::TaskManager.Task::(_updateState) Task=`45abd060-22cf-4f31-98eb-fe5b5c538786`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:59:29,171::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:59:29,172::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:59:29,172::task::990::TaskManager.Task::(_decref) Task=`45abd060-22cf-4f31-98eb-fe5b5c538786`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:59:44,521::task::595::TaskManager.Task::(_updateState) Task=`e868c6b9-4cb6-4f51-a1fc-552e4b261312`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:59:44,522::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:59:44,522::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:59:44,522::task::1185::TaskManager.Task::(prepare) Task=`e868c6b9-4cb6-4f51-a1fc-552e4b261312`::finished: {} >Thread-15::DEBUG::2014-07-24 08:59:44,522::task::595::TaskManager.Task::(_updateState) Task=`e868c6b9-4cb6-4f51-a1fc-552e4b261312`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:59:44,522::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:59:44,522::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:59:44,523::task::990::TaskManager.Task::(_decref) Task=`e868c6b9-4cb6-4f51-a1fc-552e4b261312`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 08:59:59,827::task::595::TaskManager.Task::(_updateState) Task=`abd48ef6-ae5c-4e2a-9808-76c81cef7b41`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 08:59:59,827::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 08:59:59,828::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 08:59:59,828::task::1185::TaskManager.Task::(prepare) Task=`abd48ef6-ae5c-4e2a-9808-76c81cef7b41`::finished: {} >Thread-15::DEBUG::2014-07-24 08:59:59,828::task::595::TaskManager.Task::(_updateState) Task=`abd48ef6-ae5c-4e2a-9808-76c81cef7b41`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 08:59:59,828::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 08:59:59,828::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 08:59:59,828::task::990::TaskManager.Task::(_decref) Task=`abd48ef6-ae5c-4e2a-9808-76c81cef7b41`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 09:00:15,529::task::595::TaskManager.Task::(_updateState) Task=`a6e25132-0912-4de6-a8b7-ef03fc29cea0`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 09:00:15,530::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 09:00:15,530::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 09:00:15,530::task::1185::TaskManager.Task::(prepare) Task=`a6e25132-0912-4de6-a8b7-ef03fc29cea0`::finished: {} >Thread-15::DEBUG::2014-07-24 09:00:15,530::task::595::TaskManager.Task::(_updateState) Task=`a6e25132-0912-4de6-a8b7-ef03fc29cea0`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 09:00:15,530::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 09:00:15,530::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 09:00:15,531::task::990::TaskManager.Task::(_decref) Task=`a6e25132-0912-4de6-a8b7-ef03fc29cea0`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 09:00:30,833::task::595::TaskManager.Task::(_updateState) Task=`c2999708-33e0-4baa-8395-2be181f990c9`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 09:00:30,833::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 09:00:30,834::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 09:00:30,834::task::1185::TaskManager.Task::(prepare) Task=`c2999708-33e0-4baa-8395-2be181f990c9`::finished: {} >Thread-15::DEBUG::2014-07-24 09:00:30,834::task::595::TaskManager.Task::(_updateState) Task=`c2999708-33e0-4baa-8395-2be181f990c9`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 09:00:30,834::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 09:00:30,834::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 09:00:30,834::task::990::TaskManager.Task::(_decref) Task=`c2999708-33e0-4baa-8395-2be181f990c9`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 09:00:46,128::task::595::TaskManager.Task::(_updateState) Task=`351531f0-b695-490e-870a-da905493313e`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 09:00:46,128::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 09:00:46,128::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 09:00:46,128::task::1185::TaskManager.Task::(prepare) Task=`351531f0-b695-490e-870a-da905493313e`::finished: {} >Thread-15::DEBUG::2014-07-24 09:00:46,129::task::595::TaskManager.Task::(_updateState) Task=`351531f0-b695-490e-870a-da905493313e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 09:00:46,129::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 09:00:46,129::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 09:00:46,129::task::990::TaskManager.Task::(_decref) Task=`351531f0-b695-490e-870a-da905493313e`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 09:01:01,435::task::595::TaskManager.Task::(_updateState) Task=`2f4e4e94-2ac3-41b2-801b-d3e3068e0ed9`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 09:01:01,435::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 09:01:01,436::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 09:01:01,436::task::1185::TaskManager.Task::(prepare) Task=`2f4e4e94-2ac3-41b2-801b-d3e3068e0ed9`::finished: {} >Thread-15::DEBUG::2014-07-24 09:01:01,436::task::595::TaskManager.Task::(_updateState) Task=`2f4e4e94-2ac3-41b2-801b-d3e3068e0ed9`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 09:01:01,436::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 09:01:01,436::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 09:01:01,436::task::990::TaskManager.Task::(_decref) Task=`2f4e4e94-2ac3-41b2-801b-d3e3068e0ed9`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 09:01:16,794::task::595::TaskManager.Task::(_updateState) Task=`8e056886-da7e-4436-b327-e5f3eb831564`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 09:01:16,794::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 09:01:16,794::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 09:01:16,795::task::1185::TaskManager.Task::(prepare) Task=`8e056886-da7e-4436-b327-e5f3eb831564`::finished: {} >Thread-15::DEBUG::2014-07-24 09:01:16,795::task::595::TaskManager.Task::(_updateState) Task=`8e056886-da7e-4436-b327-e5f3eb831564`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 09:01:16,795::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 09:01:16,795::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 09:01:16,795::task::990::TaskManager.Task::(_decref) Task=`8e056886-da7e-4436-b327-e5f3eb831564`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 09:01:32,103::task::595::TaskManager.Task::(_updateState) Task=`2fb7a0fd-c137-45bc-8435-e996551f6412`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 09:01:32,103::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 09:01:32,103::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 09:01:32,104::task::1185::TaskManager.Task::(prepare) Task=`2fb7a0fd-c137-45bc-8435-e996551f6412`::finished: {} >Thread-15::DEBUG::2014-07-24 09:01:32,104::task::595::TaskManager.Task::(_updateState) Task=`2fb7a0fd-c137-45bc-8435-e996551f6412`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 09:01:32,104::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 09:01:32,104::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 09:01:32,104::task::990::TaskManager.Task::(_decref) Task=`2fb7a0fd-c137-45bc-8435-e996551f6412`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 09:01:47,429::task::595::TaskManager.Task::(_updateState) Task=`0a554435-7912-467e-bb1f-a2a23bb8c13d`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 09:01:47,429::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 09:01:47,430::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 09:01:47,430::task::1185::TaskManager.Task::(prepare) Task=`0a554435-7912-467e-bb1f-a2a23bb8c13d`::finished: {} >Thread-15::DEBUG::2014-07-24 09:01:47,430::task::595::TaskManager.Task::(_updateState) Task=`0a554435-7912-467e-bb1f-a2a23bb8c13d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 09:01:47,430::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 09:01:47,430::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 09:01:47,430::task::990::TaskManager.Task::(_decref) Task=`0a554435-7912-467e-bb1f-a2a23bb8c13d`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 09:02:02,758::task::595::TaskManager.Task::(_updateState) Task=`66b23bfc-dbbc-4340-b06e-3c0d8e1e95c9`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 09:02:02,758::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 09:02:02,758::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 09:02:02,759::task::1185::TaskManager.Task::(prepare) Task=`66b23bfc-dbbc-4340-b06e-3c0d8e1e95c9`::finished: {} >Thread-15::DEBUG::2014-07-24 09:02:02,759::task::595::TaskManager.Task::(_updateState) Task=`66b23bfc-dbbc-4340-b06e-3c0d8e1e95c9`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 09:02:02,759::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 09:02:02,759::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 09:02:02,759::task::990::TaskManager.Task::(_decref) Task=`66b23bfc-dbbc-4340-b06e-3c0d8e1e95c9`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 09:02:18,080::task::595::TaskManager.Task::(_updateState) Task=`890fc380-fbf3-4689-a320-f74005541e01`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 09:02:18,081::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 09:02:18,081::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 09:02:18,081::task::1185::TaskManager.Task::(prepare) Task=`890fc380-fbf3-4689-a320-f74005541e01`::finished: {} >Thread-15::DEBUG::2014-07-24 09:02:18,081::task::595::TaskManager.Task::(_updateState) Task=`890fc380-fbf3-4689-a320-f74005541e01`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 09:02:18,081::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 09:02:18,081::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 09:02:18,082::task::990::TaskManager.Task::(_decref) Task=`890fc380-fbf3-4689-a320-f74005541e01`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 09:02:33,451::task::595::TaskManager.Task::(_updateState) Task=`3f40c7e8-8e46-44d7-a955-db69a17493cf`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 09:02:33,451::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 09:02:33,451::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 09:02:33,451::task::1185::TaskManager.Task::(prepare) Task=`3f40c7e8-8e46-44d7-a955-db69a17493cf`::finished: {} >Thread-15::DEBUG::2014-07-24 09:02:33,452::task::595::TaskManager.Task::(_updateState) Task=`3f40c7e8-8e46-44d7-a955-db69a17493cf`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 09:02:33,452::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 09:02:33,452::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 09:02:33,452::task::990::TaskManager.Task::(_decref) Task=`3f40c7e8-8e46-44d7-a955-db69a17493cf`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 09:02:48,926::task::595::TaskManager.Task::(_updateState) Task=`72293518-6c0f-4674-b431-156ac3a5c9c8`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 09:02:48,926::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 09:02:48,927::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 09:02:48,927::task::1185::TaskManager.Task::(prepare) Task=`72293518-6c0f-4674-b431-156ac3a5c9c8`::finished: {} >Thread-15::DEBUG::2014-07-24 09:02:48,927::task::595::TaskManager.Task::(_updateState) Task=`72293518-6c0f-4674-b431-156ac3a5c9c8`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 09:02:48,927::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 09:02:48,927::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 09:02:48,927::task::990::TaskManager.Task::(_decref) Task=`72293518-6c0f-4674-b431-156ac3a5c9c8`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 09:03:04,391::task::595::TaskManager.Task::(_updateState) Task=`dd0e548d-37c2-40f3-9717-be0aa5256a87`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 09:03:04,392::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 09:03:04,392::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 09:03:04,392::task::1185::TaskManager.Task::(prepare) Task=`dd0e548d-37c2-40f3-9717-be0aa5256a87`::finished: {} >Thread-15::DEBUG::2014-07-24 09:03:04,392::task::595::TaskManager.Task::(_updateState) Task=`dd0e548d-37c2-40f3-9717-be0aa5256a87`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 09:03:04,392::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 09:03:04,392::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 09:03:04,393::task::990::TaskManager.Task::(_decref) Task=`dd0e548d-37c2-40f3-9717-be0aa5256a87`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 09:03:19,862::task::595::TaskManager.Task::(_updateState) Task=`3dd2c369-8912-4f09-b1a3-433c96f18da5`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 09:03:19,863::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 09:03:19,863::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 09:03:19,863::task::1185::TaskManager.Task::(prepare) Task=`3dd2c369-8912-4f09-b1a3-433c96f18da5`::finished: {} >Thread-15::DEBUG::2014-07-24 09:03:19,863::task::595::TaskManager.Task::(_updateState) Task=`3dd2c369-8912-4f09-b1a3-433c96f18da5`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 09:03:19,863::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 09:03:19,863::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 09:03:19,864::task::990::TaskManager.Task::(_decref) Task=`3dd2c369-8912-4f09-b1a3-433c96f18da5`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 09:03:35,319::task::595::TaskManager.Task::(_updateState) Task=`33f1bb5e-32aa-4d94-b30b-a34b28789f88`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 09:03:35,320::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 09:03:35,320::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 09:03:35,320::task::1185::TaskManager.Task::(prepare) Task=`33f1bb5e-32aa-4d94-b30b-a34b28789f88`::finished: {} >Thread-15::DEBUG::2014-07-24 09:03:35,320::task::595::TaskManager.Task::(_updateState) Task=`33f1bb5e-32aa-4d94-b30b-a34b28789f88`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 09:03:35,320::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 09:03:35,320::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 09:03:35,320::task::990::TaskManager.Task::(_decref) Task=`33f1bb5e-32aa-4d94-b30b-a34b28789f88`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 09:03:50,736::task::595::TaskManager.Task::(_updateState) Task=`68b2c07c-990d-45cb-b7b5-b6300201c93b`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 09:03:50,736::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 09:03:50,736::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 09:03:50,736::task::1185::TaskManager.Task::(prepare) Task=`68b2c07c-990d-45cb-b7b5-b6300201c93b`::finished: {} >Thread-15::DEBUG::2014-07-24 09:03:50,737::task::595::TaskManager.Task::(_updateState) Task=`68b2c07c-990d-45cb-b7b5-b6300201c93b`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 09:03:50,737::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 09:03:50,737::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 09:03:50,737::task::990::TaskManager.Task::(_decref) Task=`68b2c07c-990d-45cb-b7b5-b6300201c93b`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 09:04:06,179::task::595::TaskManager.Task::(_updateState) Task=`076c381b-9a85-42c4-b5b8-bbf0231ee48d`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 09:04:06,179::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 09:04:06,180::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 09:04:06,180::task::1185::TaskManager.Task::(prepare) Task=`076c381b-9a85-42c4-b5b8-bbf0231ee48d`::finished: {} >Thread-15::DEBUG::2014-07-24 09:04:06,180::task::595::TaskManager.Task::(_updateState) Task=`076c381b-9a85-42c4-b5b8-bbf0231ee48d`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 09:04:06,180::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 09:04:06,180::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 09:04:06,180::task::990::TaskManager.Task::(_decref) Task=`076c381b-9a85-42c4-b5b8-bbf0231ee48d`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 09:04:21,511::task::595::TaskManager.Task::(_updateState) Task=`c97ca9ec-bd95-41f6-b4ef-cc7b5f979e7e`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 09:04:21,511::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 09:04:21,511::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 09:04:21,511::task::1185::TaskManager.Task::(prepare) Task=`c97ca9ec-bd95-41f6-b4ef-cc7b5f979e7e`::finished: {} >Thread-15::DEBUG::2014-07-24 09:04:21,512::task::595::TaskManager.Task::(_updateState) Task=`c97ca9ec-bd95-41f6-b4ef-cc7b5f979e7e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 09:04:21,512::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 09:04:21,512::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 09:04:21,512::task::990::TaskManager.Task::(_decref) Task=`c97ca9ec-bd95-41f6-b4ef-cc7b5f979e7e`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 09:04:36,852::task::595::TaskManager.Task::(_updateState) Task=`c6ed7fd9-ce92-49bb-abcf-e15dd283a996`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 09:04:36,853::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 09:04:36,853::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 09:04:36,853::task::1185::TaskManager.Task::(prepare) Task=`c6ed7fd9-ce92-49bb-abcf-e15dd283a996`::finished: {} >Thread-15::DEBUG::2014-07-24 09:04:36,853::task::595::TaskManager.Task::(_updateState) Task=`c6ed7fd9-ce92-49bb-abcf-e15dd283a996`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 09:04:36,853::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 09:04:36,853::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 09:04:36,854::task::990::TaskManager.Task::(_decref) Task=`c6ed7fd9-ce92-49bb-abcf-e15dd283a996`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 09:04:52,146::task::595::TaskManager.Task::(_updateState) Task=`b1d3548c-1d3e-432e-966a-7c6f450e08ed`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 09:04:52,147::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 09:04:52,147::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 09:04:52,147::task::1185::TaskManager.Task::(prepare) Task=`b1d3548c-1d3e-432e-966a-7c6f450e08ed`::finished: {} >Thread-15::DEBUG::2014-07-24 09:04:52,147::task::595::TaskManager.Task::(_updateState) Task=`b1d3548c-1d3e-432e-966a-7c6f450e08ed`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 09:04:52,147::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 09:04:52,147::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 09:04:52,148::task::990::TaskManager.Task::(_decref) Task=`b1d3548c-1d3e-432e-966a-7c6f450e08ed`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 09:05:07,529::task::595::TaskManager.Task::(_updateState) Task=`a41f75c1-02a3-43e9-bac2-f48f4575de98`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 09:05:07,529::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 09:05:07,529::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 09:05:07,530::task::1185::TaskManager.Task::(prepare) Task=`a41f75c1-02a3-43e9-bac2-f48f4575de98`::finished: {} >Thread-15::DEBUG::2014-07-24 09:05:07,530::task::595::TaskManager.Task::(_updateState) Task=`a41f75c1-02a3-43e9-bac2-f48f4575de98`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 09:05:07,530::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 09:05:07,530::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 09:05:07,530::task::990::TaskManager.Task::(_decref) Task=`a41f75c1-02a3-43e9-bac2-f48f4575de98`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 09:05:23,333::task::595::TaskManager.Task::(_updateState) Task=`c27dd372-50dd-46e2-a1cb-7ed916128115`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 09:05:23,333::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 09:05:23,333::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 09:05:23,334::task::1185::TaskManager.Task::(prepare) Task=`c27dd372-50dd-46e2-a1cb-7ed916128115`::finished: {} >Thread-15::DEBUG::2014-07-24 09:05:23,334::task::595::TaskManager.Task::(_updateState) Task=`c27dd372-50dd-46e2-a1cb-7ed916128115`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 09:05:23,334::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 09:05:23,334::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 09:05:23,335::task::990::TaskManager.Task::(_decref) Task=`c27dd372-50dd-46e2-a1cb-7ed916128115`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 09:05:38,648::task::595::TaskManager.Task::(_updateState) Task=`76b37785-a4fe-45c5-81b9-bef543c0644e`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 09:05:38,648::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 09:05:38,648::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 09:05:38,648::task::1185::TaskManager.Task::(prepare) Task=`76b37785-a4fe-45c5-81b9-bef543c0644e`::finished: {} >Thread-15::DEBUG::2014-07-24 09:05:38,649::task::595::TaskManager.Task::(_updateState) Task=`76b37785-a4fe-45c5-81b9-bef543c0644e`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 09:05:38,649::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 09:05:38,649::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 09:05:38,649::task::990::TaskManager.Task::(_decref) Task=`76b37785-a4fe-45c5-81b9-bef543c0644e`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 09:05:53,953::task::595::TaskManager.Task::(_updateState) Task=`ecff7d73-ed55-4ced-8bf8-acb9e202a2ed`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 09:05:53,953::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 09:05:53,953::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 09:05:53,953::task::1185::TaskManager.Task::(prepare) Task=`ecff7d73-ed55-4ced-8bf8-acb9e202a2ed`::finished: {} >Thread-15::DEBUG::2014-07-24 09:05:53,953::task::595::TaskManager.Task::(_updateState) Task=`ecff7d73-ed55-4ced-8bf8-acb9e202a2ed`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 09:05:53,954::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 09:05:53,954::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 09:05:53,954::task::990::TaskManager.Task::(_decref) Task=`ecff7d73-ed55-4ced-8bf8-acb9e202a2ed`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 09:06:09,264::task::595::TaskManager.Task::(_updateState) Task=`9f1f10b9-d790-4d6e-8dc3-86fa25ac03b2`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 09:06:09,264::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 09:06:09,265::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 09:06:09,265::task::1185::TaskManager.Task::(prepare) Task=`9f1f10b9-d790-4d6e-8dc3-86fa25ac03b2`::finished: {} >Thread-15::DEBUG::2014-07-24 09:06:09,265::task::595::TaskManager.Task::(_updateState) Task=`9f1f10b9-d790-4d6e-8dc3-86fa25ac03b2`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 09:06:09,265::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 09:06:09,265::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 09:06:09,265::task::990::TaskManager.Task::(_decref) Task=`9f1f10b9-d790-4d6e-8dc3-86fa25ac03b2`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 09:06:24,602::task::595::TaskManager.Task::(_updateState) Task=`46b407a5-747e-4aee-9bdf-d2ea576c778a`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 09:06:24,602::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 09:06:24,602::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 09:06:24,602::task::1185::TaskManager.Task::(prepare) Task=`46b407a5-747e-4aee-9bdf-d2ea576c778a`::finished: {} >Thread-15::DEBUG::2014-07-24 09:06:24,602::task::595::TaskManager.Task::(_updateState) Task=`46b407a5-747e-4aee-9bdf-d2ea576c778a`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 09:06:24,603::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 09:06:24,603::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 09:06:24,603::task::990::TaskManager.Task::(_decref) Task=`46b407a5-747e-4aee-9bdf-d2ea576c778a`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 09:06:39,916::task::595::TaskManager.Task::(_updateState) Task=`2e8622fd-4374-4ae1-81fc-e321b3c5dab8`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 09:06:39,916::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 09:06:39,916::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 09:06:39,916::task::1185::TaskManager.Task::(prepare) Task=`2e8622fd-4374-4ae1-81fc-e321b3c5dab8`::finished: {} >Thread-15::DEBUG::2014-07-24 09:06:39,917::task::595::TaskManager.Task::(_updateState) Task=`2e8622fd-4374-4ae1-81fc-e321b3c5dab8`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 09:06:39,917::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 09:06:39,917::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 09:06:39,917::task::990::TaskManager.Task::(_decref) Task=`2e8622fd-4374-4ae1-81fc-e321b3c5dab8`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 09:06:55,263::task::595::TaskManager.Task::(_updateState) Task=`77e2a7a9-468e-412c-9c4b-ddc15b4d2d62`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 09:06:55,263::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 09:06:55,263::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 09:06:55,263::task::1185::TaskManager.Task::(prepare) Task=`77e2a7a9-468e-412c-9c4b-ddc15b4d2d62`::finished: {} >Thread-15::DEBUG::2014-07-24 09:06:55,264::task::595::TaskManager.Task::(_updateState) Task=`77e2a7a9-468e-412c-9c4b-ddc15b4d2d62`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 09:06:55,264::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 09:06:55,264::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 09:06:55,264::task::990::TaskManager.Task::(_decref) Task=`77e2a7a9-468e-412c-9c4b-ddc15b4d2d62`::ref 0 aborting False >Thread-15::DEBUG::2014-07-24 09:07:04,536::task::595::TaskManager.Task::(_updateState) Task=`75e92913-b05d-44ce-b546-b7b56c304722`::moving from state init -> state preparing >Thread-15::INFO::2014-07-24 09:07:04,536::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-15::INFO::2014-07-24 09:07:04,536::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-15::DEBUG::2014-07-24 09:07:04,536::task::1185::TaskManager.Task::(prepare) Task=`75e92913-b05d-44ce-b546-b7b56c304722`::finished: {} >Thread-15::DEBUG::2014-07-24 09:07:04,537::task::595::TaskManager.Task::(_updateState) Task=`75e92913-b05d-44ce-b546-b7b56c304722`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-07-24 09:07:04,537::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-07-24 09:07:04,537::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-07-24 09:07:04,537::task::990::TaskManager.Task::(_decref) Task=`75e92913-b05d-44ce-b546-b7b56c304722`::ref 0 aborting False >MainThread::DEBUG::2014-07-24 09:17:41,752::vdsm::56::vds::(sigtermHandler) Received signal 15 >MainThread::INFO::2014-07-24 09:17:42,568::vmChannels::187::vds::(stop) VM channels listener was stopped. >MainThread::INFO::2014-07-24 09:17:42,569::momIF::91::MOM::(stop) Shutting down MOM >MainThread::DEBUG::2014-07-24 09:17:42,569::task::595::TaskManager.Task::(_updateState) Task=`bbbc2285-198d-48d4-99e0-6afe938eb4c1`::moving from state init -> state preparing >MainThread::INFO::2014-07-24 09:17:42,570::logUtils::44::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None) >Thread-11::DEBUG::2014-07-24 09:17:42,571::storageServer::698::ConnectionMonitor::(_monitorConnections) Monitoring stopped >VM Channels Listener::INFO::2014-07-24 09:17:43,087::vmChannels::182::vds::(run) VM channels listener thread has ended. >MainThread::INFO::2014-07-24 09:17:43,587::domainMonitor::125::Storage.DomainMonitor::(close) Stopping domain monitors >MainThread::DEBUG::2014-07-24 09:17:43,588::taskManager::80::TaskManager::(prepareForShutdown) Request to stop all tasks >MainThread::INFO::2014-07-24 09:17:43,588::logUtils::47::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None >MainThread::DEBUG::2014-07-24 09:17:43,588::task::1185::TaskManager.Task::(prepare) Task=`bbbc2285-198d-48d4-99e0-6afe938eb4c1`::finished: None >MainThread::DEBUG::2014-07-24 09:17:43,588::task::595::TaskManager.Task::(_updateState) Task=`bbbc2285-198d-48d4-99e0-6afe938eb4c1`::moving from state preparing -> state finished >MainThread::DEBUG::2014-07-24 09:17:43,588::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2014-07-24 09:17:43,588::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2014-07-24 09:17:43,588::task::990::TaskManager.Task::(_decref) Task=`bbbc2285-198d-48d4-99e0-6afe938eb4c1`::ref 0 aborting False >MainThread::INFO::2014-07-24 09:17:43,589::vdsm::135::vds::(run) VDSM main thread ended. Waiting for 15 other threads... >MainThread::INFO::2014-07-24 09:17:43,589::vdsm::139::vds::(run) <_MainThread(MainThread, started 139956889732864)> >MainThread::INFO::2014-07-24 09:17:43,589::vdsm::139::vds::(run) <Thread(libvirtEventLoop, started daemon 139956667860736)> >MainThread::INFO::2014-07-24 09:17:43,589::momIF::91::MOM::(stop) Shutting down MOM >MainThread::INFO::2014-07-24 09:17:43,589::vdsm::139::vds::(run) <MomThread(MOM, started 139955839944448)> >MainThread::INFO::2014-07-24 09:17:43,589::vdsm::139::vds::(run) <GuestManager(GuestManager, started daemon 139955367925504)> >MainThread::INFO::2014-07-24 09:17:43,589::vdsm::139::vds::(run) <HostMonitor(HostMonitor, started daemon 139955378415360)> >MainThread::INFO::2014-07-24 09:17:43,589::vdsm::139::vds::(run) <WorkerThread(Thread-9, started daemon 139956232107776)> >MainThread::INFO::2014-07-24 09:17:43,590::vdsm::139::vds::(run) <PolicyEngine(PolicyEngine, started daemon 139955829454592)> >MainThread::INFO::2014-07-24 09:17:43,590::vdsm::139::vds::(run) <WorkerThread(Thread-6, started daemon 139956263577344)> >MainThread::INFO::2014-07-24 09:17:43,590::vdsm::139::vds::(run) <WorkerThread(Thread-8, started daemon 139956242597632)> >MainThread::INFO::2014-07-24 09:17:43,590::vdsm::139::vds::(run) <WorkerThread(Thread-7, started daemon 139956253087488)> >MainThread::INFO::2014-07-24 09:17:43,590::vdsm::139::vds::(run) <WorkerThread(Thread-2, started daemon 139956646881024)> >MainThread::INFO::2014-07-24 09:17:43,590::vdsm::139::vds::(run) <WorkerThread(Thread-5, started daemon 139956274067200)> >MainThread::INFO::2014-07-24 09:17:43,590::vdsm::139::vds::(run) <WorkerThread(Thread-4, started daemon 139956625901312)> >MainThread::INFO::2014-07-24 09:17:43,590::vdsm::139::vds::(run) <WorkerThread(Thread-10, started daemon 139956221617920)> >MainThread::INFO::2014-07-24 09:17:43,590::vdsm::139::vds::(run) <WorkerThread(Thread-1, started daemon 139956657370880)> >MainThread::INFO::2014-07-24 09:17:43,591::vdsm::139::vds::(run) <WorkerThread(Thread-3, started daemon 139956636391168)> >MainThread::INFO::2014-07-24 09:17:57,958::vdsm::129::vds::(run) (PID: 14261) I am the actual vdsm 4.14.11-1.el6ev master-vds13.qa.lab.tlv.redhat.com (2.6.32-431.el6.x86_64) >MainThread::DEBUG::2014-07-24 09:17:57,959::resourceManager::421::ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2014-07-24 09:17:57,959::threadPool::35::Misc.ThreadPool::(__init__) Enter - numThreads: 10.0, waitTimeout: 3, maxTasks: 500.0 >MainThread::WARNING::2014-07-24 09:17:57,963::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2014-07-24 09:17:59,132::supervdsm::77::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::DEBUG::2014-07-24 09:17:59,152::multipath::141::Storage.Multipath::(isEnabled) Current revision of multipath.conf detected, preserving >MainThread::DEBUG::2014-07-24 09:17:59,153::hsm::434::Storage.Misc.excCmd::(__validateLvmLockingType) '/usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type' (cwd None) >MainThread::DEBUG::2014-07-24 09:17:59,305::hsm::434::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2014-07-24 09:17:59,306::hsm::458::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2014-07-24 09:17:59,309::hsm::490::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2014-07-24 09:17:59,309::hsm::491::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2014-07-24 09:17:59,309::hsm::493::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2014-07-24 09:17:59,310::hsm::536::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >storageRefresh::DEBUG::2014-07-24 09:17:59,311::misc::738::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >MainThread::INFO::2014-07-24 09:17:59,312::dispatcher::97::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >storageRefresh::DEBUG::2014-07-24 09:17:59,326::misc::740::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2014-07-24 09:17:59,332::misc::738::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >storageRefresh::DEBUG::2014-07-24 09:17:59,339::misc::740::SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2014-07-24 09:17:59,342::iscsi::407::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >MainThread::DEBUG::2014-07-24 09:17:59,343::task::595::TaskManager.Task::(_updateState) Task=`5c3be706-b70a-4ea3-9c1d-4a0776a8ad9a`::moving from state init -> state preparing >storageRefresh::DEBUG::2014-07-24 09:17:59,343::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >MainThread::INFO::2014-07-24 09:17:59,343::logUtils::44::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback(callbackFunc=<bound method clientIF.contEIOVms of <clientIF.clientIF instance at 0x156f488>>) >MainThread::INFO::2014-07-24 09:17:59,348::logUtils::47::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback, Return response: None >MainThread::DEBUG::2014-07-24 09:17:59,348::task::1185::TaskManager.Task::(prepare) Task=`5c3be706-b70a-4ea3-9c1d-4a0776a8ad9a`::finished: None >MainThread::DEBUG::2014-07-24 09:17:59,348::task::595::TaskManager.Task::(_updateState) Task=`5c3be706-b70a-4ea3-9c1d-4a0776a8ad9a`::moving from state preparing -> state finished >MainThread::DEBUG::2014-07-24 09:17:59,348::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2014-07-24 09:17:59,348::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2014-07-24 09:17:59,348::task::990::TaskManager.Task::(_decref) Task=`5c3be706-b70a-4ea3-9c1d-4a0776a8ad9a`::ref 0 aborting False >MainThread::INFO::2014-07-24 09:17:59,349::momIF::49::MOM::(__init__) Starting up MOM >MainThread::INFO::2014-07-24 09:17:59,352::vmChannels::191::vds::(settimeout) Setting channels' timeout to 30 seconds. >VM Channels Listener::INFO::2014-07-24 09:17:59,354::vmChannels::174::vds::(run) Starting VM channels listener thread. >clientIFinit::DEBUG::2014-07-24 09:17:59,366::libvirtconnection::145::root::(get) trying to connect libvirt >storageRefresh::DEBUG::2014-07-24 09:17:59,370::misc::748::SamplingMethod::(__call__) Returning last result >storageRefresh::DEBUG::2014-07-24 09:17:59,371::multipath::109::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >storageRefresh::DEBUG::2014-07-24 09:17:59,452::multipath::109::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-07-24 09:17:59,457::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-07-24 09:17:59,466::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-07-24 09:17:59,470::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-07-24 09:17:59,473::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-07-24 09:17:59,477::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-07-24 09:17:59,480::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-07-24 09:17:59,483::misc::748::SamplingMethod::(__call__) Returning last result >storageRefresh::DEBUG::2014-07-24 09:17:59,487::lvm::325::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2014-07-24 09:17:59,497::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >storageRefresh::DEBUG::2014-07-24 09:17:59,665::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-07-24 09:17:59,665::lvm::350::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2014-07-24 09:17:59,665::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2014-07-24 09:17:59,666::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >storageRefresh::DEBUG::2014-07-24 09:17:59,796::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2014-07-24 09:17:59,796::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2014-07-24 09:17:59,796::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags' (cwd None) >Thread-13::DEBUG::2014-07-24 09:17:59,838::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call ping with () {} flowID [647e7510] >Thread-13::DEBUG::2014-07-24 09:17:59,838::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >storageRefresh::DEBUG::2014-07-24 09:17:59,923::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2014-07-24 09:17:59,923::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2014-07-24 09:17:59,924::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >storageRefresh::DEBUG::2014-07-24 09:18:00,051::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2014-07-24 09:18:00,051::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::WARNING::2014-07-24 09:18:00,052::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/hsm-tasks already exists >storageRefresh::DEBUG::2014-07-24 09:18:00,053::hsm::393::Storage.HSM::(storageRefresh) HSM is ready >Thread-13::DEBUG::2014-07-24 09:18:00,413::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call ping with () {} flowID [647e7510] >Thread-13::DEBUG::2014-07-24 09:18:00,413::BindingXMLRPC::1074::vds::(wrapper) return ping with {'status': {'message': 'Done', 'code': 0}} >Thread-13::DEBUG::2014-07-24 09:18:00,438::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call getCapabilities with () {} flowID [647e7510] >Thread-13::DEBUG::2014-07-24 09:18:00,499::utils::642::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-13::DEBUG::2014-07-24 09:18:00,507::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 09:18:00,545::BindingXMLRPC::1074::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:d2432ea2ceb0'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.el6.x86_64', 'buildtime': 1384114794.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1401730350L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1405619266L, 'version': '4.14.11'}, 'qemu-kvm': {'release': '2.415.el6_5.12', 'buildtime': 1404777941L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.9', 'buildtime': 1401355377L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.12', 'buildtime': 1404777941L, 'version': '0.12.1.2'}, 'mom': {'release': '2.el6', 'buildtime': 1403794344L, 'version': '0.4.1'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5649 @ 2.53GHz', 'hooks': {}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.64.88', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::5ef3:fcff:fe78:eff0/64'], 'gateway': '10.35.64.254', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {';vdsmdummy;': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '', 'ports': []}, 'rhevm': {'addr': '10.35.64.88', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::5ef3:fcff:fe78:eff0/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.35.64.254', 'ports': ['eth0']}}, 'uuid': 'EDB5DCEA-C28B-11E0-A3A8-5CF3FC78EFF0', 'lastClientIface': 'rhevm', 'nics': {'eth1': {'netmask': '', 'addr': '', 'hwaddr': '5c:f3:fc:78:ef:f2', 'cfg': {'UUID': '151f07ed-f286-4376-b894-70ac70ed0eab', 'NM_CONTROLLED': 'yes', 'HWADDR': '5C:F3:FC:78:EF:F2', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'speed': 0, 'mtu': '1500'}, 'eth0': {'netmask': '', 'addr': '', 'hwaddr': '5c:f3:fc:78:ef:f0', 'cfg': {'BRIDGE': 'rhevm', 'NM_CONTROLLED': 'no', 'HWADDR': '5c:f3:fc:78:ef:f0', 'STP': 'no', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::5ef3:fcff:fe78:eff0/64'], 'speed': 1000, 'mtu': '1500'}}, 'software_revision': '1', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,ida,arat,epb,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:d2432ea2ceb0', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.14', 'memSize': '24017', 'cpuSpeed': '2660.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '12', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '24', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.5.0.1.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.163.76'}} >Thread-13::DEBUG::2014-07-24 09:18:02,808::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call getCapabilities with () {} >Thread-13::DEBUG::2014-07-24 09:18:02,810::utils::642::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-13::DEBUG::2014-07-24 09:18:02,816::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 09:18:02,842::BindingXMLRPC::1074::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:d2432ea2ceb0'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.el6.x86_64', 'buildtime': 1384114794.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1401730350L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1405619266L, 'version': '4.14.11'}, 'qemu-kvm': {'release': '2.415.el6_5.12', 'buildtime': 1404777941L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.9', 'buildtime': 1401355377L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.12', 'buildtime': 1404777941L, 'version': '0.12.1.2'}, 'mom': {'release': '2.el6', 'buildtime': 1403794344L, 'version': '0.4.1'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5649 @ 2.53GHz', 'hooks': {}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.64.88', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::5ef3:fcff:fe78:eff0/64'], 'gateway': '10.35.64.254', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {';vdsmdummy;': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '', 'ports': []}, 'rhevm': {'addr': '10.35.64.88', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::5ef3:fcff:fe78:eff0/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.35.64.254', 'ports': ['eth0']}}, 'uuid': 'EDB5DCEA-C28B-11E0-A3A8-5CF3FC78EFF0', 'lastClientIface': 'rhevm', 'nics': {'eth1': {'netmask': '', 'addr': '', 'hwaddr': '5c:f3:fc:78:ef:f2', 'cfg': {'UUID': '151f07ed-f286-4376-b894-70ac70ed0eab', 'NM_CONTROLLED': 'yes', 'HWADDR': '5C:F3:FC:78:EF:F2', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'speed': 0, 'mtu': '1500'}, 'eth0': {'netmask': '', 'addr': '', 'hwaddr': '5c:f3:fc:78:ef:f0', 'cfg': {'BRIDGE': 'rhevm', 'NM_CONTROLLED': 'no', 'HWADDR': '5c:f3:fc:78:ef:f0', 'STP': 'no', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::5ef3:fcff:fe78:eff0/64'], 'speed': 1000, 'mtu': '1500'}}, 'software_revision': '1', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,ida,arat,epb,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:d2432ea2ceb0', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.14', 'memSize': '24017', 'cpuSpeed': '2660.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '12', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '24', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.5.0.1.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.163.76'}} >Thread-13::DEBUG::2014-07-24 09:18:03,015::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call getHardwareInfo with () {} >Thread-13::DEBUG::2014-07-24 09:18:03,074::BindingXMLRPC::1074::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'BladeCenter HS22 -[7870A7G]-', 'systemSerialNumber': '06EXY53', 'systemFamily': 'System x', 'systemVersion': '07', 'systemUUID': 'edb5dcea-c28b-11e0-a3a8-5cf3fc78eff0', 'systemManufacturer': 'IBM'}} >Thread-13::DEBUG::2014-07-24 09:18:03,162::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call getCapabilities with () {} flowID [648302c] >Thread-13::DEBUG::2014-07-24 09:18:03,164::utils::642::root::(execCmd) '/sbin/ip route show to 0.0.0.0/0 table all' (cwd None) >Thread-13::DEBUG::2014-07-24 09:18:03,170::utils::662::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 09:18:03,191::BindingXMLRPC::1074::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:d2432ea2ceb0'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.el6.x86_64', 'buildtime': 1384114794.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1401730350L, 'version': '0.12.4'}, 'vdsm': {'release': '1.el6ev', 'buildtime': 1405619266L, 'version': '4.14.11'}, 'qemu-kvm': {'release': '2.415.el6_5.12', 'buildtime': 1404777941L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.9', 'buildtime': 1401355377L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.12', 'buildtime': 1404777941L, 'version': '0.12.1.2'}, 'mom': {'release': '2.el6', 'buildtime': 1403794344L, 'version': '0.4.1'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU E5649 @ 2.53GHz', 'hooks': {}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.35.64.88', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::5ef3:fcff:fe78:eff0/64'], 'gateway': '10.35.64.254', 'netmask': '255.255.255.0', 'stp': 'off', 'bridged': True, 'mtu': '1500', 'ipv6gateway': '::', 'ports': ['eth0']}}, 'bridges': {';vdsmdummy;': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '', 'ports': []}, 'rhevm': {'addr': '10.35.64.88', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'no', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::5ef3:fcff:fe78:eff0/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '10.35.64.254', 'ports': ['eth0']}}, 'uuid': 'EDB5DCEA-C28B-11E0-A3A8-5CF3FC78EFF0', 'lastClientIface': 'rhevm', 'nics': {'eth1': {'netmask': '', 'addr': '', 'hwaddr': '5c:f3:fc:78:ef:f2', 'cfg': {'UUID': '151f07ed-f286-4376-b894-70ac70ed0eab', 'NM_CONTROLLED': 'yes', 'HWADDR': '5C:F3:FC:78:EF:F2', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth1', 'TYPE': 'Ethernet', 'ONBOOT': 'no'}, 'ipv6addrs': [], 'speed': 0, 'mtu': '1500'}, 'eth0': {'netmask': '', 'addr': '', 'hwaddr': '5c:f3:fc:78:ef:f0', 'cfg': {'BRIDGE': 'rhevm', 'NM_CONTROLLED': 'no', 'HWADDR': '5c:f3:fc:78:ef:f0', 'STP': 'no', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::5ef3:fcff:fe78:eff0/64'], 'speed': 1000, 'mtu': '1500'}}, 'software_revision': '1', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,aes,lahf_lm,ida,arat,epb,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_Westmere,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:d2432ea2ceb0', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.14', 'memSize': '24017', 'cpuSpeed': '2660.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '12', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '24', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.5.0.1.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.35.163.76'}} >Thread-13::DEBUG::2014-07-24 09:18:03,322::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call getHardwareInfo with () {} flowID [648302c] >Thread-13::DEBUG::2014-07-24 09:18:03,322::BindingXMLRPC::1074::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'BladeCenter HS22 -[7870A7G]-', 'systemSerialNumber': '06EXY53', 'systemFamily': 'System x', 'systemVersion': '07', 'systemUUID': 'edb5dcea-c28b-11e0-a3a8-5cf3fc78eff0', 'systemManufacturer': 'IBM'}} >Thread-13::DEBUG::2014-07-24 09:18:03,471::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call setMOMPolicyParameters with ({'balloonEnabled': False, 'ksmEnabled': False},) {} flowID [214ffdc5] >Thread-13::DEBUG::2014-07-24 09:18:03,531::BindingXMLRPC::1074::vds::(wrapper) return setMOMPolicyParameters with {'status': {'message': 'Done', 'code': 0}} >Thread-13::DEBUG::2014-07-24 09:18:15,738::task::595::TaskManager.Task::(_updateState) Task=`57c7db60-0d18-4cac-96a0-768236e8ac8c`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:18:15,739::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:18:15,739::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:18:15,739::task::1185::TaskManager.Task::(prepare) Task=`57c7db60-0d18-4cac-96a0-768236e8ac8c`::finished: {} >Thread-13::DEBUG::2014-07-24 09:18:15,739::task::595::TaskManager.Task::(_updateState) Task=`57c7db60-0d18-4cac-96a0-768236e8ac8c`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:18:15,739::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:18:15,739::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:18:15,740::task::990::TaskManager.Task::(_decref) Task=`57c7db60-0d18-4cac-96a0-768236e8ac8c`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:18:31,052::task::595::TaskManager.Task::(_updateState) Task=`437e6d15-7b23-4c17-9ebf-353a168942e8`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:18:31,053::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:18:31,053::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:18:31,053::task::1185::TaskManager.Task::(prepare) Task=`437e6d15-7b23-4c17-9ebf-353a168942e8`::finished: {} >Thread-13::DEBUG::2014-07-24 09:18:31,053::task::595::TaskManager.Task::(_updateState) Task=`437e6d15-7b23-4c17-9ebf-353a168942e8`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:18:31,053::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:18:31,053::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:18:31,054::task::990::TaskManager.Task::(_decref) Task=`437e6d15-7b23-4c17-9ebf-353a168942e8`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:18:46,370::task::595::TaskManager.Task::(_updateState) Task=`72dc5c59-c50a-42eb-ae4e-1611e9e8b4e9`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:18:46,370::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:18:46,370::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:18:46,370::task::1185::TaskManager.Task::(prepare) Task=`72dc5c59-c50a-42eb-ae4e-1611e9e8b4e9`::finished: {} >Thread-13::DEBUG::2014-07-24 09:18:46,370::task::595::TaskManager.Task::(_updateState) Task=`72dc5c59-c50a-42eb-ae4e-1611e9e8b4e9`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:18:46,370::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:18:46,371::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:18:46,371::task::990::TaskManager.Task::(_decref) Task=`72dc5c59-c50a-42eb-ae4e-1611e9e8b4e9`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:19:01,668::task::595::TaskManager.Task::(_updateState) Task=`ce9c7e4d-a9cc-46a1-918c-85a82abfaefa`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:19:01,668::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:19:01,668::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:19:01,669::task::1185::TaskManager.Task::(prepare) Task=`ce9c7e4d-a9cc-46a1-918c-85a82abfaefa`::finished: {} >Thread-13::DEBUG::2014-07-24 09:19:01,669::task::595::TaskManager.Task::(_updateState) Task=`ce9c7e4d-a9cc-46a1-918c-85a82abfaefa`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:19:01,669::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:19:01,669::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:19:01,669::task::990::TaskManager.Task::(_decref) Task=`ce9c7e4d-a9cc-46a1-918c-85a82abfaefa`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:19:16,998::task::595::TaskManager.Task::(_updateState) Task=`81f3c74f-f373-40ad-baa5-1f08377efe48`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:19:16,999::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:19:16,999::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:19:16,999::task::1185::TaskManager.Task::(prepare) Task=`81f3c74f-f373-40ad-baa5-1f08377efe48`::finished: {} >Thread-13::DEBUG::2014-07-24 09:19:16,999::task::595::TaskManager.Task::(_updateState) Task=`81f3c74f-f373-40ad-baa5-1f08377efe48`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:19:16,999::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:19:17,000::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:19:17,000::task::990::TaskManager.Task::(_decref) Task=`81f3c74f-f373-40ad-baa5-1f08377efe48`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:19:32,292::task::595::TaskManager.Task::(_updateState) Task=`6c1ad89e-daa3-4062-889c-88d5c2532d2e`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:19:32,292::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:19:32,292::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:19:32,293::task::1185::TaskManager.Task::(prepare) Task=`6c1ad89e-daa3-4062-889c-88d5c2532d2e`::finished: {} >Thread-13::DEBUG::2014-07-24 09:19:32,293::task::595::TaskManager.Task::(_updateState) Task=`6c1ad89e-daa3-4062-889c-88d5c2532d2e`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:19:32,293::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:19:32,293::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:19:32,293::task::990::TaskManager.Task::(_decref) Task=`6c1ad89e-daa3-4062-889c-88d5c2532d2e`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:19:47,637::task::595::TaskManager.Task::(_updateState) Task=`febaa47d-b6f4-4703-b559-87f5eb17e63a`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:19:47,638::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:19:47,638::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:19:47,638::task::1185::TaskManager.Task::(prepare) Task=`febaa47d-b6f4-4703-b559-87f5eb17e63a`::finished: {} >Thread-13::DEBUG::2014-07-24 09:19:47,638::task::595::TaskManager.Task::(_updateState) Task=`febaa47d-b6f4-4703-b559-87f5eb17e63a`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:19:47,638::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:19:47,638::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:19:47,639::task::990::TaskManager.Task::(_decref) Task=`febaa47d-b6f4-4703-b559-87f5eb17e63a`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:20:02,975::task::595::TaskManager.Task::(_updateState) Task=`59286dda-9495-445d-be88-6439b62f79e2`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:20:02,975::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:20:02,975::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:20:02,976::task::1185::TaskManager.Task::(prepare) Task=`59286dda-9495-445d-be88-6439b62f79e2`::finished: {} >Thread-13::DEBUG::2014-07-24 09:20:02,976::task::595::TaskManager.Task::(_updateState) Task=`59286dda-9495-445d-be88-6439b62f79e2`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:20:02,976::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:20:02,976::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:20:02,976::task::990::TaskManager.Task::(_decref) Task=`59286dda-9495-445d-be88-6439b62f79e2`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:20:18,599::task::595::TaskManager.Task::(_updateState) Task=`56500f8e-02ea-4e84-b951-79d043dfc135`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:20:18,599::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:20:18,599::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:20:18,599::task::1185::TaskManager.Task::(prepare) Task=`56500f8e-02ea-4e84-b951-79d043dfc135`::finished: {} >Thread-13::DEBUG::2014-07-24 09:20:18,599::task::595::TaskManager.Task::(_updateState) Task=`56500f8e-02ea-4e84-b951-79d043dfc135`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:20:18,600::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:20:18,600::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:20:18,600::task::990::TaskManager.Task::(_decref) Task=`56500f8e-02ea-4e84-b951-79d043dfc135`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:20:32,392::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 09:20:32,392::task::595::TaskManager.Task::(_updateState) Task=`8e3e7046-949f-4c96-9ea1-607d9c38b6cf`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:20:32,392::logUtils::44::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=3, options={}) >Thread-13::DEBUG::2014-07-24 09:20:32,393::misc::738::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-13::DEBUG::2014-07-24 09:20:32,393::misc::740::SamplingMethod::(__call__) Got in to sampling method >Thread-13::DEBUG::2014-07-24 09:20:32,393::misc::738::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-13::DEBUG::2014-07-24 09:20:32,393::misc::740::SamplingMethod::(__call__) Got in to sampling method >Thread-13::DEBUG::2014-07-24 09:20:32,393::iscsi::407::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-13::DEBUG::2014-07-24 09:20:32,393::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-13::DEBUG::2014-07-24 09:20:32,425::misc::748::SamplingMethod::(__call__) Returning last result >Thread-13::DEBUG::2014-07-24 09:20:32,425::multipath::109::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-13::DEBUG::2014-07-24 09:20:32,510::multipath::109::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 09:20:32,511::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 09:20:32,511::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 09:20:32,511::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 09:20:32,511::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 09:20:32,511::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 09:20:32,512::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 09:20:32,512::misc::748::SamplingMethod::(__call__) Returning last result >Thread-13::DEBUG::2014-07-24 09:20:32,512::lvm::325::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 09:20:32,514::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-13::DEBUG::2014-07-24 09:20:32,681::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 09:20:32,682::lvm::350::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 09:20:32,708::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --test --metadatasize 128m --metadatacopies 2 --metadataignore y' (cwd None) >Thread-13::DEBUG::2014-07-24 09:20:32,841::lvm::296::Storage.Misc.excCmd::(cmd) FAILED: <err> = " TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.\n Please enter a physical volume path\n Run `pvcreate --help' for more information.\n"; <rc> = 3 >Thread-13::DEBUG::2014-07-24 09:20:32,875::lvm::860::Storage.LVM::(testPVCreate) rc: 3, out: [], err: [' TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.', ' Please enter a physical volume path', " Run `pvcreate --help' for more information."], unusedDevs: set([]), usedDevs: set([]) >Thread-13::INFO::2014-07-24 09:20:32,875::logUtils::47::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList': []} >Thread-13::DEBUG::2014-07-24 09:20:32,876::task::1185::TaskManager.Task::(prepare) Task=`8e3e7046-949f-4c96-9ea1-607d9c38b6cf`::finished: {'devList': []} >Thread-13::DEBUG::2014-07-24 09:20:32,876::task::595::TaskManager.Task::(_updateState) Task=`8e3e7046-949f-4c96-9ea1-607d9c38b6cf`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:20:32,876::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:20:32,876::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:20:32,876::task::990::TaskManager.Task::(_decref) Task=`8e3e7046-949f-4c96-9ea1-607d9c38b6cf`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:20:33,901::task::595::TaskManager.Task::(_updateState) Task=`69ba0ba9-0ce4-4293-8242-425895fcfb66`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:20:33,901::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:20:33,902::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:20:33,902::task::1185::TaskManager.Task::(prepare) Task=`69ba0ba9-0ce4-4293-8242-425895fcfb66`::finished: {} >Thread-13::DEBUG::2014-07-24 09:20:33,902::task::595::TaskManager.Task::(_updateState) Task=`69ba0ba9-0ce4-4293-8242-425895fcfb66`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:20:33,902::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:20:33,902::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:20:33,902::task::990::TaskManager.Task::(_decref) Task=`69ba0ba9-0ce4-4293-8242-425895fcfb66`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:20:39,907::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 09:20:39,907::task::595::TaskManager.Task::(_updateState) Task=`d37828d2-abcd-4c73-b3af-0e14b5d56ba3`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:20:39,908::logUtils::44::dispatcher::(wrapper) Run and protect: discoverSendTargets(con={'connection': '10.35.160.104', 'password': '******', 'port': '3260', 'user': ''}, options=None) >Thread-13::DEBUG::2014-07-24 09:20:39,908::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.104:3260 --op=new' (cwd None) >Thread-13::DEBUG::2014-07-24 09:20:39,925::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 09:20:39,925::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.104:3260 --discover' (cwd None) >Thread-13::DEBUG::2014-07-24 09:20:39,945::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 09:20:39,946::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.104:3260 --op=delete' (cwd None) >Thread-13::DEBUG::2014-07-24 09:20:39,959::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::INFO::2014-07-24 09:20:39,959::logUtils::47::dispatcher::(wrapper) Run and protect: discoverSendTargets, Return response: {'fullTargets': ['10.35.160.104:3260,1 iqn.1992-04.com.emc:cx.ckm00121000438.a6', '10.35.160.105:3260,2 iqn.1992-04.com.emc:cx.ckm00121000438.a7', '10.35.160.106:3260,3 iqn.1992-04.com.emc:cx.ckm00121000438.b6', '10.35.160.107:3260,4 iqn.1992-04.com.emc:cx.ckm00121000438.b7'], 'targets': ['iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'iqn.1992-04.com.emc:cx.ckm00121000438.b7']} >Thread-13::DEBUG::2014-07-24 09:20:39,960::task::1185::TaskManager.Task::(prepare) Task=`d37828d2-abcd-4c73-b3af-0e14b5d56ba3`::finished: {'fullTargets': ['10.35.160.104:3260,1 iqn.1992-04.com.emc:cx.ckm00121000438.a6', '10.35.160.105:3260,2 iqn.1992-04.com.emc:cx.ckm00121000438.a7', '10.35.160.106:3260,3 iqn.1992-04.com.emc:cx.ckm00121000438.b6', '10.35.160.107:3260,4 iqn.1992-04.com.emc:cx.ckm00121000438.b7'], 'targets': ['iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'iqn.1992-04.com.emc:cx.ckm00121000438.b7']} >Thread-13::DEBUG::2014-07-24 09:20:39,960::task::595::TaskManager.Task::(_updateState) Task=`d37828d2-abcd-4c73-b3af-0e14b5d56ba3`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:20:39,960::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:20:39,960::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:20:39,960::task::990::TaskManager.Task::(_decref) Task=`d37828d2-abcd-4c73-b3af-0e14b5d56ba3`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:20:42,186::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [4b8587d7] >Thread-13::DEBUG::2014-07-24 09:20:42,186::task::595::TaskManager.Task::(_updateState) Task=`39d3364d-900a-4584-a111-98eba5b5f5e4`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:20:42,186::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'user': '', 'tpgt': '1', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-13::DEBUG::2014-07-24 09:20:42,187::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a6 -I default -p 10.35.160.104:3260,1 --op=new' (cwd None) >Thread-13::DEBUG::2014-07-24 09:20:42,201::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 09:20:42,202::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a6 -I default -p 10.35.160.104:3260,1 -l' (cwd None) >Thread-13::DEBUG::2014-07-24 09:20:42,227::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 09:20:42,227::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a6 -I default -p 10.35.160.104:3260,1 -n node.startup -v manual --op=update' (cwd None) >Thread-13::DEBUG::2014-07-24 09:20:42,240::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 09:20:42,241::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 09:20:42,241::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >Thread-13::DEBUG::2014-07-24 09:20:42,369::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 09:20:42,369::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 09:20:42,370::hsm::2352::Storage.HSM::(__prefetchDomains) Found SD uuids: () >Thread-13::DEBUG::2014-07-24 09:20:42,370::hsm::2408::Storage.HSM::(connectStorageServer) knownSDs: {} >Thread-13::INFO::2014-07-24 09:20:42,370::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-13::DEBUG::2014-07-24 09:20:42,370::task::1185::TaskManager.Task::(prepare) Task=`39d3364d-900a-4584-a111-98eba5b5f5e4`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-13::DEBUG::2014-07-24 09:20:42,370::task::595::TaskManager.Task::(_updateState) Task=`39d3364d-900a-4584-a111-98eba5b5f5e4`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:20:42,370::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:20:42,371::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:20:42,371::task::990::TaskManager.Task::(_decref) Task=`39d3364d-900a-4584-a111-98eba5b5f5e4`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:20:42,639::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [371161cd] >Thread-13::DEBUG::2014-07-24 09:20:42,640::task::595::TaskManager.Task::(_updateState) Task=`5152e464-6d28-4584-84e9-19073d96a76a`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:20:42,640::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'user': '', 'tpgt': '1', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-13::DEBUG::2014-07-24 09:20:42,641::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a7 -I default -p 10.35.160.105:3260,1 --op=new' (cwd None) >Thread-13::DEBUG::2014-07-24 09:20:42,664::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 09:20:42,664::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a7 -I default -p 10.35.160.105:3260,1 -l' (cwd None) >Thread-13::DEBUG::2014-07-24 09:20:42,697::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 09:20:42,698::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a7 -I default -p 10.35.160.105:3260,1 -n node.startup -v manual --op=update' (cwd None) >Thread-13::DEBUG::2014-07-24 09:20:42,715::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 09:20:42,716::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 09:20:42,717::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >Thread-13::DEBUG::2014-07-24 09:20:42,873::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 09:20:42,874::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 09:20:42,874::hsm::2352::Storage.HSM::(__prefetchDomains) Found SD uuids: () >Thread-13::DEBUG::2014-07-24 09:20:42,875::hsm::2408::Storage.HSM::(connectStorageServer) knownSDs: {} >Thread-13::INFO::2014-07-24 09:20:42,875::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-13::DEBUG::2014-07-24 09:20:42,875::task::1185::TaskManager.Task::(prepare) Task=`5152e464-6d28-4584-84e9-19073d96a76a`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-13::DEBUG::2014-07-24 09:20:42,876::task::595::TaskManager.Task::(_updateState) Task=`5152e464-6d28-4584-84e9-19073d96a76a`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:20:42,876::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:20:42,876::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:20:42,876::task::990::TaskManager.Task::(_decref) Task=`5152e464-6d28-4584-84e9-19073d96a76a`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:20:43,131::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [63dccde9] >Thread-13::DEBUG::2014-07-24 09:20:43,131::task::595::TaskManager.Task::(_updateState) Task=`2182b178-3038-4858-b1dd-38d7f042df07`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:20:43,132::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'user': '', 'tpgt': '1', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-13::DEBUG::2014-07-24 09:20:43,132::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b6 -I default -p 10.35.160.106:3260,1 --op=new' (cwd None) >Thread-13::DEBUG::2014-07-24 09:20:43,147::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 09:20:43,148::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b6 -I default -p 10.35.160.106:3260,1 -l' (cwd None) >Thread-13::DEBUG::2014-07-24 09:20:43,177::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 09:20:43,179::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b6 -I default -p 10.35.160.106:3260,1 -n node.startup -v manual --op=update' (cwd None) >Thread-13::DEBUG::2014-07-24 09:20:43,193::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 09:20:43,193::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 09:20:43,194::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >Thread-13::DEBUG::2014-07-24 09:20:43,326::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 09:20:43,327::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 09:20:43,327::hsm::2352::Storage.HSM::(__prefetchDomains) Found SD uuids: () >Thread-13::DEBUG::2014-07-24 09:20:43,327::hsm::2408::Storage.HSM::(connectStorageServer) knownSDs: {} >Thread-13::INFO::2014-07-24 09:20:43,327::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-13::DEBUG::2014-07-24 09:20:43,328::task::1185::TaskManager.Task::(prepare) Task=`2182b178-3038-4858-b1dd-38d7f042df07`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-13::DEBUG::2014-07-24 09:20:43,328::task::595::TaskManager.Task::(_updateState) Task=`2182b178-3038-4858-b1dd-38d7f042df07`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:20:43,328::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:20:43,328::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:20:43,328::task::990::TaskManager.Task::(_decref) Task=`2182b178-3038-4858-b1dd-38d7f042df07`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:20:43,588::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [d363aac] >Thread-13::DEBUG::2014-07-24 09:20:43,589::task::595::TaskManager.Task::(_updateState) Task=`8e69d2bc-a16b-49d4-80de-ec8718e60aa8`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:20:43,589::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'user': '', 'tpgt': '1', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-13::DEBUG::2014-07-24 09:20:43,589::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b7 -I default -p 10.35.160.107:3260,1 --op=new' (cwd None) >Thread-13::DEBUG::2014-07-24 09:20:43,604::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 09:20:43,604::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b7 -I default -p 10.35.160.107:3260,1 -l' (cwd None) >Thread-13::DEBUG::2014-07-24 09:20:43,627::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 09:20:43,627::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b7 -I default -p 10.35.160.107:3260,1 -n node.startup -v manual --op=update' (cwd None) >Thread-13::DEBUG::2014-07-24 09:20:43,640::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 09:20:43,641::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 09:20:43,641::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >Thread-13::DEBUG::2014-07-24 09:20:43,766::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 09:20:43,767::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 09:20:43,767::hsm::2352::Storage.HSM::(__prefetchDomains) Found SD uuids: () >Thread-13::DEBUG::2014-07-24 09:20:43,767::hsm::2408::Storage.HSM::(connectStorageServer) knownSDs: {} >Thread-13::INFO::2014-07-24 09:20:43,767::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-13::DEBUG::2014-07-24 09:20:43,768::task::1185::TaskManager.Task::(prepare) Task=`8e69d2bc-a16b-49d4-80de-ec8718e60aa8`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-13::DEBUG::2014-07-24 09:20:43,768::task::595::TaskManager.Task::(_updateState) Task=`8e69d2bc-a16b-49d4-80de-ec8718e60aa8`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:20:43,768::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:20:43,768::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:20:43,768::task::990::TaskManager.Task::(_decref) Task=`8e69d2bc-a16b-49d4-80de-ec8718e60aa8`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:20:43,847::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 09:20:43,847::task::595::TaskManager.Task::(_updateState) Task=`38de4990-5fa0-48e6-a888-d3dafa2fda5b`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:20:43,847::logUtils::44::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=3, options={}) >Thread-13::DEBUG::2014-07-24 09:20:43,847::misc::738::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-13::DEBUG::2014-07-24 09:20:43,848::misc::740::SamplingMethod::(__call__) Got in to sampling method >Thread-13::DEBUG::2014-07-24 09:20:43,848::misc::738::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-13::DEBUG::2014-07-24 09:20:43,848::misc::740::SamplingMethod::(__call__) Got in to sampling method >Thread-13::DEBUG::2014-07-24 09:20:43,848::iscsi::407::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-13::DEBUG::2014-07-24 09:20:43,848::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-13::DEBUG::2014-07-24 09:20:43,868::misc::748::SamplingMethod::(__call__) Returning last result >Thread-13::DEBUG::2014-07-24 09:20:43,868::multipath::109::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-13::DEBUG::2014-07-24 09:20:43,959::multipath::109::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 09:20:43,960::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 09:20:43,960::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 09:20:43,960::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 09:20:43,961::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 09:20:43,961::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 09:20:43,961::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 09:20:43,961::misc::748::SamplingMethod::(__call__) Returning last result >Thread-13::DEBUG::2014-07-24 09:20:43,962::lvm::325::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 09:20:43,964::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-13::DEBUG::2014-07-24 09:20:44,103::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 09:20:44,103::lvm::350::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 09:20:44,125::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --test --metadatasize 128m --metadatacopies 2 --metadataignore y' (cwd None) >Thread-13::DEBUG::2014-07-24 09:20:44,254::lvm::296::Storage.Misc.excCmd::(cmd) FAILED: <err> = " TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.\n Please enter a physical volume path\n Run `pvcreate --help' for more information.\n"; <rc> = 3 >Thread-13::DEBUG::2014-07-24 09:20:44,255::lvm::860::Storage.LVM::(testPVCreate) rc: 3, out: [], err: [' TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.', ' Please enter a physical volume path', " Run `pvcreate --help' for more information."], unusedDevs: set([]), usedDevs: set([]) >Thread-13::INFO::2014-07-24 09:20:44,256::logUtils::47::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList': []} >Thread-13::DEBUG::2014-07-24 09:20:44,256::task::1185::TaskManager.Task::(prepare) Task=`38de4990-5fa0-48e6-a888-d3dafa2fda5b`::finished: {'devList': []} >Thread-13::DEBUG::2014-07-24 09:20:44,256::task::595::TaskManager.Task::(_updateState) Task=`38de4990-5fa0-48e6-a888-d3dafa2fda5b`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:20:44,256::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:20:44,256::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:20:44,257::task::990::TaskManager.Task::(_decref) Task=`38de4990-5fa0-48e6-a888-d3dafa2fda5b`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:20:49,286::task::595::TaskManager.Task::(_updateState) Task=`f5eb0d54-d41c-4097-be81-582744e76a66`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:20:49,287::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:20:49,287::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:20:49,287::task::1185::TaskManager.Task::(prepare) Task=`f5eb0d54-d41c-4097-be81-582744e76a66`::finished: {} >Thread-13::DEBUG::2014-07-24 09:20:49,287::task::595::TaskManager.Task::(_updateState) Task=`f5eb0d54-d41c-4097-be81-582744e76a66`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:20:49,287::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:20:49,288::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:20:49,288::task::990::TaskManager.Task::(_decref) Task=`f5eb0d54-d41c-4097-be81-582744e76a66`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:21:04,596::task::595::TaskManager.Task::(_updateState) Task=`c5a80af5-bd0a-47f4-bce5-c337167a6aae`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:21:04,596::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:21:04,596::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:21:04,597::task::1185::TaskManager.Task::(prepare) Task=`c5a80af5-bd0a-47f4-bce5-c337167a6aae`::finished: {} >Thread-13::DEBUG::2014-07-24 09:21:04,597::task::595::TaskManager.Task::(_updateState) Task=`c5a80af5-bd0a-47f4-bce5-c337167a6aae`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:21:04,597::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:21:04,597::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:21:04,597::task::990::TaskManager.Task::(_decref) Task=`c5a80af5-bd0a-47f4-bce5-c337167a6aae`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:21:19,891::task::595::TaskManager.Task::(_updateState) Task=`e08ef322-5d0c-42f4-be4d-d6f2187abbb9`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:21:19,891::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:21:19,891::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:21:19,891::task::1185::TaskManager.Task::(prepare) Task=`e08ef322-5d0c-42f4-be4d-d6f2187abbb9`::finished: {} >Thread-13::DEBUG::2014-07-24 09:21:19,892::task::595::TaskManager.Task::(_updateState) Task=`e08ef322-5d0c-42f4-be4d-d6f2187abbb9`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:21:19,892::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:21:19,892::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:21:19,892::task::990::TaskManager.Task::(_decref) Task=`e08ef322-5d0c-42f4-be4d-d6f2187abbb9`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:21:35,241::task::595::TaskManager.Task::(_updateState) Task=`fa009aa2-187f-4170-a0d4-3e85ff51c173`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:21:35,241::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:21:35,242::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:21:35,242::task::1185::TaskManager.Task::(prepare) Task=`fa009aa2-187f-4170-a0d4-3e85ff51c173`::finished: {} >Thread-13::DEBUG::2014-07-24 09:21:35,242::task::595::TaskManager.Task::(_updateState) Task=`fa009aa2-187f-4170-a0d4-3e85ff51c173`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:21:35,242::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:21:35,242::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:21:35,242::task::990::TaskManager.Task::(_decref) Task=`fa009aa2-187f-4170-a0d4-3e85ff51c173`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:21:50,583::task::595::TaskManager.Task::(_updateState) Task=`a8b2d164-cfad-4797-8af9-062b06e89c4f`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:21:50,584::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:21:50,584::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:21:50,584::task::1185::TaskManager.Task::(prepare) Task=`a8b2d164-cfad-4797-8af9-062b06e89c4f`::finished: {} >Thread-13::DEBUG::2014-07-24 09:21:50,584::task::595::TaskManager.Task::(_updateState) Task=`a8b2d164-cfad-4797-8af9-062b06e89c4f`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:21:50,584::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:21:50,584::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:21:50,584::task::990::TaskManager.Task::(_decref) Task=`a8b2d164-cfad-4797-8af9-062b06e89c4f`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:22:05,902::task::595::TaskManager.Task::(_updateState) Task=`18f10f03-6fd5-487d-9ffc-8e921b9e95b6`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:22:05,902::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:22:05,902::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:22:05,903::task::1185::TaskManager.Task::(prepare) Task=`18f10f03-6fd5-487d-9ffc-8e921b9e95b6`::finished: {} >Thread-13::DEBUG::2014-07-24 09:22:05,903::task::595::TaskManager.Task::(_updateState) Task=`18f10f03-6fd5-487d-9ffc-8e921b9e95b6`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:22:05,903::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:22:05,903::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:22:05,903::task::990::TaskManager.Task::(_decref) Task=`18f10f03-6fd5-487d-9ffc-8e921b9e95b6`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:22:21,226::task::595::TaskManager.Task::(_updateState) Task=`e9b8cb6d-8018-480b-9f30-c008a7d9ad0d`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:22:21,226::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:22:21,226::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:22:21,226::task::1185::TaskManager.Task::(prepare) Task=`e9b8cb6d-8018-480b-9f30-c008a7d9ad0d`::finished: {} >Thread-13::DEBUG::2014-07-24 09:22:21,227::task::595::TaskManager.Task::(_updateState) Task=`e9b8cb6d-8018-480b-9f30-c008a7d9ad0d`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:22:21,227::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:22:21,227::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:22:21,227::task::990::TaskManager.Task::(_decref) Task=`e9b8cb6d-8018-480b-9f30-c008a7d9ad0d`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:22:36,539::task::595::TaskManager.Task::(_updateState) Task=`971a1ef8-4fe5-49dc-b53f-3ef50a4cd0b7`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:22:36,540::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:22:36,540::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:22:36,540::task::1185::TaskManager.Task::(prepare) Task=`971a1ef8-4fe5-49dc-b53f-3ef50a4cd0b7`::finished: {} >Thread-13::DEBUG::2014-07-24 09:22:36,540::task::595::TaskManager.Task::(_updateState) Task=`971a1ef8-4fe5-49dc-b53f-3ef50a4cd0b7`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:22:36,540::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:22:36,541::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:22:36,541::task::990::TaskManager.Task::(_decref) Task=`971a1ef8-4fe5-49dc-b53f-3ef50a4cd0b7`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:22:51,833::task::595::TaskManager.Task::(_updateState) Task=`19c84fbe-f5a7-4b0c-a81d-be6f3cf0c542`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:22:51,834::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:22:51,834::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:22:51,834::task::1185::TaskManager.Task::(prepare) Task=`19c84fbe-f5a7-4b0c-a81d-be6f3cf0c542`::finished: {} >Thread-13::DEBUG::2014-07-24 09:22:51,834::task::595::TaskManager.Task::(_updateState) Task=`19c84fbe-f5a7-4b0c-a81d-be6f3cf0c542`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:22:51,834::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:22:51,834::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:22:51,834::task::990::TaskManager.Task::(_decref) Task=`19c84fbe-f5a7-4b0c-a81d-be6f3cf0c542`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:23:07,200::task::595::TaskManager.Task::(_updateState) Task=`cdf24256-056f-41f2-bd75-2e91afa52c9b`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:23:07,201::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:23:07,201::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:23:07,201::task::1185::TaskManager.Task::(prepare) Task=`cdf24256-056f-41f2-bd75-2e91afa52c9b`::finished: {} >Thread-13::DEBUG::2014-07-24 09:23:07,201::task::595::TaskManager.Task::(_updateState) Task=`cdf24256-056f-41f2-bd75-2e91afa52c9b`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:23:07,201::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:23:07,202::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:23:07,202::task::990::TaskManager.Task::(_decref) Task=`cdf24256-056f-41f2-bd75-2e91afa52c9b`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:23:22,967::task::595::TaskManager.Task::(_updateState) Task=`6c8203cb-d96a-435f-8401-b5eb6121d548`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:23:22,968::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:23:22,968::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:23:22,968::task::1185::TaskManager.Task::(prepare) Task=`6c8203cb-d96a-435f-8401-b5eb6121d548`::finished: {} >Thread-13::DEBUG::2014-07-24 09:23:22,968::task::595::TaskManager.Task::(_updateState) Task=`6c8203cb-d96a-435f-8401-b5eb6121d548`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:23:22,968::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:23:22,968::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:23:22,969::task::990::TaskManager.Task::(_decref) Task=`6c8203cb-d96a-435f-8401-b5eb6121d548`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:23:38,294::task::595::TaskManager.Task::(_updateState) Task=`bc4531fd-c620-4c26-b2f5-a0a7b446c006`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:23:38,294::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:23:38,294::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:23:38,294::task::1185::TaskManager.Task::(prepare) Task=`bc4531fd-c620-4c26-b2f5-a0a7b446c006`::finished: {} >Thread-13::DEBUG::2014-07-24 09:23:38,294::task::595::TaskManager.Task::(_updateState) Task=`bc4531fd-c620-4c26-b2f5-a0a7b446c006`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:23:38,295::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:23:38,295::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:23:38,295::task::990::TaskManager.Task::(_decref) Task=`bc4531fd-c620-4c26-b2f5-a0a7b446c006`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:23:53,609::task::595::TaskManager.Task::(_updateState) Task=`4aac5654-a71c-4696-b797-d1624b59aaa8`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:23:53,609::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:23:53,609::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:23:53,609::task::1185::TaskManager.Task::(prepare) Task=`4aac5654-a71c-4696-b797-d1624b59aaa8`::finished: {} >Thread-13::DEBUG::2014-07-24 09:23:53,609::task::595::TaskManager.Task::(_updateState) Task=`4aac5654-a71c-4696-b797-d1624b59aaa8`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:23:53,610::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:23:53,610::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:23:53,610::task::990::TaskManager.Task::(_decref) Task=`4aac5654-a71c-4696-b797-d1624b59aaa8`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:24:08,903::task::595::TaskManager.Task::(_updateState) Task=`ab6f958d-225c-46c3-a852-ef0e22ae3039`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:24:08,903::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:24:08,903::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:24:08,903::task::1185::TaskManager.Task::(prepare) Task=`ab6f958d-225c-46c3-a852-ef0e22ae3039`::finished: {} >Thread-13::DEBUG::2014-07-24 09:24:08,904::task::595::TaskManager.Task::(_updateState) Task=`ab6f958d-225c-46c3-a852-ef0e22ae3039`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:24:08,904::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:24:08,904::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:24:08,904::task::990::TaskManager.Task::(_decref) Task=`ab6f958d-225c-46c3-a852-ef0e22ae3039`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:24:24,313::task::595::TaskManager.Task::(_updateState) Task=`e3c84e24-bf42-4f5c-a727-d53422ac527a`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:24:24,313::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:24:24,313::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:24:24,313::task::1185::TaskManager.Task::(prepare) Task=`e3c84e24-bf42-4f5c-a727-d53422ac527a`::finished: {} >Thread-13::DEBUG::2014-07-24 09:24:24,314::task::595::TaskManager.Task::(_updateState) Task=`e3c84e24-bf42-4f5c-a727-d53422ac527a`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:24:24,314::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:24:24,314::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:24:24,314::task::990::TaskManager.Task::(_decref) Task=`e3c84e24-bf42-4f5c-a727-d53422ac527a`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:24:39,618::task::595::TaskManager.Task::(_updateState) Task=`8c373a68-438d-4536-99a3-331c024dd460`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:24:39,618::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:24:39,618::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:24:39,618::task::1185::TaskManager.Task::(prepare) Task=`8c373a68-438d-4536-99a3-331c024dd460`::finished: {} >Thread-13::DEBUG::2014-07-24 09:24:39,618::task::595::TaskManager.Task::(_updateState) Task=`8c373a68-438d-4536-99a3-331c024dd460`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:24:39,619::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:24:39,619::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:24:39,619::task::990::TaskManager.Task::(_decref) Task=`8c373a68-438d-4536-99a3-331c024dd460`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:24:54,979::task::595::TaskManager.Task::(_updateState) Task=`848d52fc-1e80-486a-bc4c-0eb2028bee8f`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:24:54,979::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:24:54,979::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:24:54,980::task::1185::TaskManager.Task::(prepare) Task=`848d52fc-1e80-486a-bc4c-0eb2028bee8f`::finished: {} >Thread-13::DEBUG::2014-07-24 09:24:54,980::task::595::TaskManager.Task::(_updateState) Task=`848d52fc-1e80-486a-bc4c-0eb2028bee8f`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:24:54,980::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:24:54,980::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:24:54,980::task::990::TaskManager.Task::(_decref) Task=`848d52fc-1e80-486a-bc4c-0eb2028bee8f`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:25:10,285::task::595::TaskManager.Task::(_updateState) Task=`24a3c9ce-9412-49ba-a2e8-36b7578250c5`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:25:10,285::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:25:10,286::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:25:10,286::task::1185::TaskManager.Task::(prepare) Task=`24a3c9ce-9412-49ba-a2e8-36b7578250c5`::finished: {} >Thread-13::DEBUG::2014-07-24 09:25:10,286::task::595::TaskManager.Task::(_updateState) Task=`24a3c9ce-9412-49ba-a2e8-36b7578250c5`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:25:10,286::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:25:10,286::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:25:10,286::task::990::TaskManager.Task::(_decref) Task=`24a3c9ce-9412-49ba-a2e8-36b7578250c5`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:25:25,898::task::595::TaskManager.Task::(_updateState) Task=`9aee1c31-611c-4b44-87d3-b7c38cb81f4f`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:25:25,898::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:25:25,898::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:25:25,899::task::1185::TaskManager.Task::(prepare) Task=`9aee1c31-611c-4b44-87d3-b7c38cb81f4f`::finished: {} >Thread-13::DEBUG::2014-07-24 09:25:25,899::task::595::TaskManager.Task::(_updateState) Task=`9aee1c31-611c-4b44-87d3-b7c38cb81f4f`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:25:25,899::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:25:25,899::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:25:25,899::task::990::TaskManager.Task::(_decref) Task=`9aee1c31-611c-4b44-87d3-b7c38cb81f4f`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:25:41,242::task::595::TaskManager.Task::(_updateState) Task=`0edcc46b-30cf-4aad-9cb0-5d1822991bf9`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:25:41,242::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:25:41,242::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:25:41,243::task::1185::TaskManager.Task::(prepare) Task=`0edcc46b-30cf-4aad-9cb0-5d1822991bf9`::finished: {} >Thread-13::DEBUG::2014-07-24 09:25:41,243::task::595::TaskManager.Task::(_updateState) Task=`0edcc46b-30cf-4aad-9cb0-5d1822991bf9`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:25:41,243::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:25:41,243::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:25:41,243::task::990::TaskManager.Task::(_decref) Task=`0edcc46b-30cf-4aad-9cb0-5d1822991bf9`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:25:56,608::task::595::TaskManager.Task::(_updateState) Task=`b94b249a-095a-44c8-b736-0300cedc7b43`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:25:56,609::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:25:56,609::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:25:56,609::task::1185::TaskManager.Task::(prepare) Task=`b94b249a-095a-44c8-b736-0300cedc7b43`::finished: {} >Thread-13::DEBUG::2014-07-24 09:25:56,609::task::595::TaskManager.Task::(_updateState) Task=`b94b249a-095a-44c8-b736-0300cedc7b43`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:25:56,609::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:25:56,609::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:25:56,610::task::990::TaskManager.Task::(_decref) Task=`b94b249a-095a-44c8-b736-0300cedc7b43`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:26:11,983::task::595::TaskManager.Task::(_updateState) Task=`e32a8895-9099-4616-ad05-cc692f7934d8`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:26:11,983::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:26:11,983::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:26:11,983::task::1185::TaskManager.Task::(prepare) Task=`e32a8895-9099-4616-ad05-cc692f7934d8`::finished: {} >Thread-13::DEBUG::2014-07-24 09:26:11,983::task::595::TaskManager.Task::(_updateState) Task=`e32a8895-9099-4616-ad05-cc692f7934d8`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:26:11,984::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:26:11,984::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:26:11,984::task::990::TaskManager.Task::(_decref) Task=`e32a8895-9099-4616-ad05-cc692f7934d8`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:26:27,287::task::595::TaskManager.Task::(_updateState) Task=`7d79a6dc-84c5-4778-b4d4-8376a8bee07d`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:26:27,288::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:26:27,288::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:26:27,288::task::1185::TaskManager.Task::(prepare) Task=`7d79a6dc-84c5-4778-b4d4-8376a8bee07d`::finished: {} >Thread-13::DEBUG::2014-07-24 09:26:27,288::task::595::TaskManager.Task::(_updateState) Task=`7d79a6dc-84c5-4778-b4d4-8376a8bee07d`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:26:27,288::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:26:27,289::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:26:27,289::task::990::TaskManager.Task::(_decref) Task=`7d79a6dc-84c5-4778-b4d4-8376a8bee07d`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:26:42,708::task::595::TaskManager.Task::(_updateState) Task=`7ca4bd8d-2b63-49c1-9fd6-5c43b4342d4b`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:26:42,709::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:26:42,709::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:26:42,709::task::1185::TaskManager.Task::(prepare) Task=`7ca4bd8d-2b63-49c1-9fd6-5c43b4342d4b`::finished: {} >Thread-13::DEBUG::2014-07-24 09:26:42,709::task::595::TaskManager.Task::(_updateState) Task=`7ca4bd8d-2b63-49c1-9fd6-5c43b4342d4b`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:26:42,709::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:26:42,709::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:26:42,709::task::990::TaskManager.Task::(_decref) Task=`7ca4bd8d-2b63-49c1-9fd6-5c43b4342d4b`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:26:58,016::task::595::TaskManager.Task::(_updateState) Task=`06841a0d-f04f-414b-a883-b557287b6703`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:26:58,016::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:26:58,016::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:26:58,017::task::1185::TaskManager.Task::(prepare) Task=`06841a0d-f04f-414b-a883-b557287b6703`::finished: {} >Thread-13::DEBUG::2014-07-24 09:26:58,017::task::595::TaskManager.Task::(_updateState) Task=`06841a0d-f04f-414b-a883-b557287b6703`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:26:58,017::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:26:58,017::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:26:58,017::task::990::TaskManager.Task::(_decref) Task=`06841a0d-f04f-414b-a883-b557287b6703`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:27:13,351::task::595::TaskManager.Task::(_updateState) Task=`ca6a5dff-ada5-4d8d-b932-386f87a76d96`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:27:13,352::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:27:13,352::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:27:13,352::task::1185::TaskManager.Task::(prepare) Task=`ca6a5dff-ada5-4d8d-b932-386f87a76d96`::finished: {} >Thread-13::DEBUG::2014-07-24 09:27:13,352::task::595::TaskManager.Task::(_updateState) Task=`ca6a5dff-ada5-4d8d-b932-386f87a76d96`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:27:13,352::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:27:13,352::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:27:13,353::task::990::TaskManager.Task::(_decref) Task=`ca6a5dff-ada5-4d8d-b932-386f87a76d96`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:27:28,657::task::595::TaskManager.Task::(_updateState) Task=`2d4a23b8-3b8f-4410-9c57-b38433a88a86`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:27:28,657::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:27:28,657::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:27:28,658::task::1185::TaskManager.Task::(prepare) Task=`2d4a23b8-3b8f-4410-9c57-b38433a88a86`::finished: {} >Thread-13::DEBUG::2014-07-24 09:27:28,658::task::595::TaskManager.Task::(_updateState) Task=`2d4a23b8-3b8f-4410-9c57-b38433a88a86`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:27:28,658::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:27:28,658::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:27:28,658::task::990::TaskManager.Task::(_decref) Task=`2d4a23b8-3b8f-4410-9c57-b38433a88a86`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:27:44,018::task::595::TaskManager.Task::(_updateState) Task=`5d72cfda-3395-45fb-815b-54b9196c2ac8`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:27:44,018::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:27:44,018::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:27:44,019::task::1185::TaskManager.Task::(prepare) Task=`5d72cfda-3395-45fb-815b-54b9196c2ac8`::finished: {} >Thread-13::DEBUG::2014-07-24 09:27:44,019::task::595::TaskManager.Task::(_updateState) Task=`5d72cfda-3395-45fb-815b-54b9196c2ac8`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:27:44,019::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:27:44,019::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:27:44,019::task::990::TaskManager.Task::(_decref) Task=`5d72cfda-3395-45fb-815b-54b9196c2ac8`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:27:59,336::task::595::TaskManager.Task::(_updateState) Task=`7b85407a-1058-43b7-8d67-9ab117a5ad8d`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:27:59,337::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:27:59,337::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:27:59,337::task::1185::TaskManager.Task::(prepare) Task=`7b85407a-1058-43b7-8d67-9ab117a5ad8d`::finished: {} >Thread-13::DEBUG::2014-07-24 09:27:59,337::task::595::TaskManager.Task::(_updateState) Task=`7b85407a-1058-43b7-8d67-9ab117a5ad8d`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:27:59,337::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:27:59,337::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:27:59,338::task::990::TaskManager.Task::(_decref) Task=`7b85407a-1058-43b7-8d67-9ab117a5ad8d`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:28:14,646::task::595::TaskManager.Task::(_updateState) Task=`ca57d7e2-4309-4c07-be72-d00259e1b21b`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:28:14,646::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:28:14,646::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:28:14,647::task::1185::TaskManager.Task::(prepare) Task=`ca57d7e2-4309-4c07-be72-d00259e1b21b`::finished: {} >Thread-13::DEBUG::2014-07-24 09:28:14,647::task::595::TaskManager.Task::(_updateState) Task=`ca57d7e2-4309-4c07-be72-d00259e1b21b`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:28:14,647::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:28:14,647::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:28:14,647::task::990::TaskManager.Task::(_decref) Task=`ca57d7e2-4309-4c07-be72-d00259e1b21b`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:28:29,946::task::595::TaskManager.Task::(_updateState) Task=`3c277450-b31d-4805-b3c9-aaa3ffff26d2`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:28:29,946::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:28:29,946::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:28:29,946::task::1185::TaskManager.Task::(prepare) Task=`3c277450-b31d-4805-b3c9-aaa3ffff26d2`::finished: {} >Thread-13::DEBUG::2014-07-24 09:28:29,946::task::595::TaskManager.Task::(_updateState) Task=`3c277450-b31d-4805-b3c9-aaa3ffff26d2`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:28:29,947::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:28:29,947::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:28:29,947::task::990::TaskManager.Task::(_decref) Task=`3c277450-b31d-4805-b3c9-aaa3ffff26d2`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:28:45,277::task::595::TaskManager.Task::(_updateState) Task=`3a0fbf80-13a8-45eb-8fc9-b2514ba4b4a6`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:28:45,277::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:28:45,278::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:28:45,278::task::1185::TaskManager.Task::(prepare) Task=`3a0fbf80-13a8-45eb-8fc9-b2514ba4b4a6`::finished: {} >Thread-13::DEBUG::2014-07-24 09:28:45,278::task::595::TaskManager.Task::(_updateState) Task=`3a0fbf80-13a8-45eb-8fc9-b2514ba4b4a6`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:28:45,278::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:28:45,278::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:28:45,278::task::990::TaskManager.Task::(_decref) Task=`3a0fbf80-13a8-45eb-8fc9-b2514ba4b4a6`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:29:00,645::task::595::TaskManager.Task::(_updateState) Task=`46c00335-3efd-4370-921d-249dd92dde52`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:29:00,645::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:29:00,646::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:29:00,646::task::1185::TaskManager.Task::(prepare) Task=`46c00335-3efd-4370-921d-249dd92dde52`::finished: {} >Thread-13::DEBUG::2014-07-24 09:29:00,646::task::595::TaskManager.Task::(_updateState) Task=`46c00335-3efd-4370-921d-249dd92dde52`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:29:00,646::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:29:00,646::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:29:00,646::task::990::TaskManager.Task::(_decref) Task=`46c00335-3efd-4370-921d-249dd92dde52`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:29:15,988::task::595::TaskManager.Task::(_updateState) Task=`212b5d63-aa87-4765-8e2c-5e936e5be155`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:29:15,989::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:29:15,989::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:29:15,989::task::1185::TaskManager.Task::(prepare) Task=`212b5d63-aa87-4765-8e2c-5e936e5be155`::finished: {} >Thread-13::DEBUG::2014-07-24 09:29:15,989::task::595::TaskManager.Task::(_updateState) Task=`212b5d63-aa87-4765-8e2c-5e936e5be155`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:29:15,990::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:29:15,990::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:29:15,991::task::990::TaskManager.Task::(_decref) Task=`212b5d63-aa87-4765-8e2c-5e936e5be155`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:29:31,361::task::595::TaskManager.Task::(_updateState) Task=`aaad1bd5-d969-425e-a3ed-1248cefc2c4b`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:29:31,361::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:29:31,362::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:29:31,362::task::1185::TaskManager.Task::(prepare) Task=`aaad1bd5-d969-425e-a3ed-1248cefc2c4b`::finished: {} >Thread-13::DEBUG::2014-07-24 09:29:31,362::task::595::TaskManager.Task::(_updateState) Task=`aaad1bd5-d969-425e-a3ed-1248cefc2c4b`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:29:31,362::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:29:31,362::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:29:31,362::task::990::TaskManager.Task::(_decref) Task=`aaad1bd5-d969-425e-a3ed-1248cefc2c4b`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:29:46,800::task::595::TaskManager.Task::(_updateState) Task=`5e9c08aa-f2fb-446e-a122-b1d6aaa3632c`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:29:46,800::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:29:46,800::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:29:46,800::task::1185::TaskManager.Task::(prepare) Task=`5e9c08aa-f2fb-446e-a122-b1d6aaa3632c`::finished: {} >Thread-13::DEBUG::2014-07-24 09:29:46,801::task::595::TaskManager.Task::(_updateState) Task=`5e9c08aa-f2fb-446e-a122-b1d6aaa3632c`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:29:46,801::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:29:46,801::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:29:46,801::task::990::TaskManager.Task::(_decref) Task=`5e9c08aa-f2fb-446e-a122-b1d6aaa3632c`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:30:02,319::task::595::TaskManager.Task::(_updateState) Task=`2797256c-4923-41e8-8487-0e6ff29a6a2b`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:30:02,319::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:30:02,320::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:30:02,320::task::1185::TaskManager.Task::(prepare) Task=`2797256c-4923-41e8-8487-0e6ff29a6a2b`::finished: {} >Thread-13::DEBUG::2014-07-24 09:30:02,320::task::595::TaskManager.Task::(_updateState) Task=`2797256c-4923-41e8-8487-0e6ff29a6a2b`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:30:02,320::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:30:02,320::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:30:02,320::task::990::TaskManager.Task::(_decref) Task=`2797256c-4923-41e8-8487-0e6ff29a6a2b`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:30:17,774::task::595::TaskManager.Task::(_updateState) Task=`c332fce3-bba7-4cbc-a75b-d8cf5d7de50c`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:30:17,775::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:30:17,775::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:30:17,775::task::1185::TaskManager.Task::(prepare) Task=`c332fce3-bba7-4cbc-a75b-d8cf5d7de50c`::finished: {} >Thread-13::DEBUG::2014-07-24 09:30:17,775::task::595::TaskManager.Task::(_updateState) Task=`c332fce3-bba7-4cbc-a75b-d8cf5d7de50c`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:30:17,775::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:30:17,776::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:30:17,776::task::990::TaskManager.Task::(_decref) Task=`c332fce3-bba7-4cbc-a75b-d8cf5d7de50c`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:30:33,579::task::595::TaskManager.Task::(_updateState) Task=`3026cc19-40fd-466e-87e4-2fcfeb266ea9`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:30:33,580::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:30:33,580::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:30:33,580::task::1185::TaskManager.Task::(prepare) Task=`3026cc19-40fd-466e-87e4-2fcfeb266ea9`::finished: {} >Thread-13::DEBUG::2014-07-24 09:30:33,580::task::595::TaskManager.Task::(_updateState) Task=`3026cc19-40fd-466e-87e4-2fcfeb266ea9`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:30:33,580::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:30:33,580::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:30:33,581::task::990::TaskManager.Task::(_decref) Task=`3026cc19-40fd-466e-87e4-2fcfeb266ea9`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:30:49,015::task::595::TaskManager.Task::(_updateState) Task=`6b2e2dc5-00c9-4dc9-8b12-b32330bec3bf`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:30:49,016::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:30:49,016::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:30:49,016::task::1185::TaskManager.Task::(prepare) Task=`6b2e2dc5-00c9-4dc9-8b12-b32330bec3bf`::finished: {} >Thread-13::DEBUG::2014-07-24 09:30:49,016::task::595::TaskManager.Task::(_updateState) Task=`6b2e2dc5-00c9-4dc9-8b12-b32330bec3bf`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:30:49,016::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:30:49,017::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:30:49,017::task::990::TaskManager.Task::(_decref) Task=`6b2e2dc5-00c9-4dc9-8b12-b32330bec3bf`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:31:04,369::task::595::TaskManager.Task::(_updateState) Task=`033c423f-dc7f-417c-a22b-5352efbe65aa`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:31:04,369::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:31:04,369::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:31:04,370::task::1185::TaskManager.Task::(prepare) Task=`033c423f-dc7f-417c-a22b-5352efbe65aa`::finished: {} >Thread-13::DEBUG::2014-07-24 09:31:04,370::task::595::TaskManager.Task::(_updateState) Task=`033c423f-dc7f-417c-a22b-5352efbe65aa`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:31:04,370::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:31:04,370::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:31:04,370::task::990::TaskManager.Task::(_decref) Task=`033c423f-dc7f-417c-a22b-5352efbe65aa`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:31:19,692::task::595::TaskManager.Task::(_updateState) Task=`38ef430e-7218-4855-8fe1-df6617ce5480`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:31:19,693::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:31:19,693::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:31:19,693::task::1185::TaskManager.Task::(prepare) Task=`38ef430e-7218-4855-8fe1-df6617ce5480`::finished: {} >Thread-13::DEBUG::2014-07-24 09:31:19,693::task::595::TaskManager.Task::(_updateState) Task=`38ef430e-7218-4855-8fe1-df6617ce5480`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:31:19,693::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:31:19,693::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:31:19,694::task::990::TaskManager.Task::(_decref) Task=`38ef430e-7218-4855-8fe1-df6617ce5480`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:31:34,999::task::595::TaskManager.Task::(_updateState) Task=`a70881af-6070-4f33-8706-dd1b8daad6d5`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:31:34,999::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:31:34,999::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:31:35,000::task::1185::TaskManager.Task::(prepare) Task=`a70881af-6070-4f33-8706-dd1b8daad6d5`::finished: {} >Thread-13::DEBUG::2014-07-24 09:31:35,000::task::595::TaskManager.Task::(_updateState) Task=`a70881af-6070-4f33-8706-dd1b8daad6d5`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:31:35,000::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:31:35,000::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:31:35,000::task::990::TaskManager.Task::(_decref) Task=`a70881af-6070-4f33-8706-dd1b8daad6d5`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:31:50,293::task::595::TaskManager.Task::(_updateState) Task=`5bfdb472-7c6f-49bb-bfc2-d023baa9163a`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:31:50,293::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:31:50,293::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:31:50,293::task::1185::TaskManager.Task::(prepare) Task=`5bfdb472-7c6f-49bb-bfc2-d023baa9163a`::finished: {} >Thread-13::DEBUG::2014-07-24 09:31:50,294::task::595::TaskManager.Task::(_updateState) Task=`5bfdb472-7c6f-49bb-bfc2-d023baa9163a`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:31:50,294::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:31:50,294::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:31:50,294::task::990::TaskManager.Task::(_decref) Task=`5bfdb472-7c6f-49bb-bfc2-d023baa9163a`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:32:05,639::task::595::TaskManager.Task::(_updateState) Task=`7e4c1f43-ae86-41a9-b27f-3ad52dd10f26`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:32:05,639::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:32:05,640::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:32:05,640::task::1185::TaskManager.Task::(prepare) Task=`7e4c1f43-ae86-41a9-b27f-3ad52dd10f26`::finished: {} >Thread-13::DEBUG::2014-07-24 09:32:05,640::task::595::TaskManager.Task::(_updateState) Task=`7e4c1f43-ae86-41a9-b27f-3ad52dd10f26`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:32:05,640::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:32:05,640::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:32:05,640::task::990::TaskManager.Task::(_decref) Task=`7e4c1f43-ae86-41a9-b27f-3ad52dd10f26`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:32:20,949::task::595::TaskManager.Task::(_updateState) Task=`a4486500-0950-43f2-934e-045c987c5177`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:32:20,950::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:32:20,950::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:32:20,950::task::1185::TaskManager.Task::(prepare) Task=`a4486500-0950-43f2-934e-045c987c5177`::finished: {} >Thread-13::DEBUG::2014-07-24 09:32:20,950::task::595::TaskManager.Task::(_updateState) Task=`a4486500-0950-43f2-934e-045c987c5177`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:32:20,950::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:32:20,951::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:32:20,951::task::990::TaskManager.Task::(_decref) Task=`a4486500-0950-43f2-934e-045c987c5177`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:32:36,262::task::595::TaskManager.Task::(_updateState) Task=`2bbeb207-9cf9-4f88-a408-97bd630d1b81`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:32:36,262::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:32:36,263::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:32:36,263::task::1185::TaskManager.Task::(prepare) Task=`2bbeb207-9cf9-4f88-a408-97bd630d1b81`::finished: {} >Thread-13::DEBUG::2014-07-24 09:32:36,263::task::595::TaskManager.Task::(_updateState) Task=`2bbeb207-9cf9-4f88-a408-97bd630d1b81`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:32:36,263::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:32:36,263::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:32:36,263::task::990::TaskManager.Task::(_decref) Task=`2bbeb207-9cf9-4f88-a408-97bd630d1b81`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:32:51,564::task::595::TaskManager.Task::(_updateState) Task=`62d88f7e-9b60-45d2-b2c2-fd02d93ae112`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:32:51,564::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:32:51,564::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:32:51,564::task::1185::TaskManager.Task::(prepare) Task=`62d88f7e-9b60-45d2-b2c2-fd02d93ae112`::finished: {} >Thread-13::DEBUG::2014-07-24 09:32:51,564::task::595::TaskManager.Task::(_updateState) Task=`62d88f7e-9b60-45d2-b2c2-fd02d93ae112`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:32:51,565::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:32:51,565::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:32:51,565::task::990::TaskManager.Task::(_decref) Task=`62d88f7e-9b60-45d2-b2c2-fd02d93ae112`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:33:06,861::task::595::TaskManager.Task::(_updateState) Task=`0c01b273-1f9b-4e44-bbf2-a0c265891828`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:33:06,861::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:33:06,861::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:33:06,861::task::1185::TaskManager.Task::(prepare) Task=`0c01b273-1f9b-4e44-bbf2-a0c265891828`::finished: {} >Thread-13::DEBUG::2014-07-24 09:33:06,861::task::595::TaskManager.Task::(_updateState) Task=`0c01b273-1f9b-4e44-bbf2-a0c265891828`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:33:06,862::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:33:06,862::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:33:06,862::task::990::TaskManager.Task::(_decref) Task=`0c01b273-1f9b-4e44-bbf2-a0c265891828`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:33:22,158::task::595::TaskManager.Task::(_updateState) Task=`a0468091-6128-44dc-9b2c-afb77855693c`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:33:22,158::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:33:22,158::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:33:22,158::task::1185::TaskManager.Task::(prepare) Task=`a0468091-6128-44dc-9b2c-afb77855693c`::finished: {} >Thread-13::DEBUG::2014-07-24 09:33:22,159::task::595::TaskManager.Task::(_updateState) Task=`a0468091-6128-44dc-9b2c-afb77855693c`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:33:22,159::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:33:22,159::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:33:22,159::task::990::TaskManager.Task::(_decref) Task=`a0468091-6128-44dc-9b2c-afb77855693c`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:33:37,472::task::595::TaskManager.Task::(_updateState) Task=`2f896729-e769-417e-987c-483f38168838`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:33:37,472::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:33:37,472::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:33:37,472::task::1185::TaskManager.Task::(prepare) Task=`2f896729-e769-417e-987c-483f38168838`::finished: {} >Thread-13::DEBUG::2014-07-24 09:33:37,472::task::595::TaskManager.Task::(_updateState) Task=`2f896729-e769-417e-987c-483f38168838`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:33:37,473::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:33:37,473::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:33:37,473::task::990::TaskManager.Task::(_decref) Task=`2f896729-e769-417e-987c-483f38168838`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:33:52,793::task::595::TaskManager.Task::(_updateState) Task=`4792aaf7-2598-4fb1-97a1-638aa082d0e3`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:33:52,794::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:33:52,794::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:33:52,794::task::1185::TaskManager.Task::(prepare) Task=`4792aaf7-2598-4fb1-97a1-638aa082d0e3`::finished: {} >Thread-13::DEBUG::2014-07-24 09:33:52,794::task::595::TaskManager.Task::(_updateState) Task=`4792aaf7-2598-4fb1-97a1-638aa082d0e3`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:33:52,794::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:33:52,794::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:33:52,795::task::990::TaskManager.Task::(_decref) Task=`4792aaf7-2598-4fb1-97a1-638aa082d0e3`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:34:08,099::task::595::TaskManager.Task::(_updateState) Task=`b3a3e0ef-3b67-4edd-bd1e-ef7292924936`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:34:08,099::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:34:08,099::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:34:08,100::task::1185::TaskManager.Task::(prepare) Task=`b3a3e0ef-3b67-4edd-bd1e-ef7292924936`::finished: {} >Thread-13::DEBUG::2014-07-24 09:34:08,100::task::595::TaskManager.Task::(_updateState) Task=`b3a3e0ef-3b67-4edd-bd1e-ef7292924936`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:34:08,100::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:34:08,100::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:34:08,100::task::990::TaskManager.Task::(_decref) Task=`b3a3e0ef-3b67-4edd-bd1e-ef7292924936`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:34:23,400::task::595::TaskManager.Task::(_updateState) Task=`c3f34a77-9ffc-4072-a277-69479c3c1e78`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:34:23,400::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:34:23,400::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:34:23,400::task::1185::TaskManager.Task::(prepare) Task=`c3f34a77-9ffc-4072-a277-69479c3c1e78`::finished: {} >Thread-13::DEBUG::2014-07-24 09:34:23,400::task::595::TaskManager.Task::(_updateState) Task=`c3f34a77-9ffc-4072-a277-69479c3c1e78`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:34:23,400::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:34:23,401::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:34:23,401::task::990::TaskManager.Task::(_decref) Task=`c3f34a77-9ffc-4072-a277-69479c3c1e78`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:34:38,710::task::595::TaskManager.Task::(_updateState) Task=`19221d03-5ef5-4d32-abcb-4c81027b010c`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:34:38,710::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:34:38,710::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:34:38,710::task::1185::TaskManager.Task::(prepare) Task=`19221d03-5ef5-4d32-abcb-4c81027b010c`::finished: {} >Thread-13::DEBUG::2014-07-24 09:34:38,710::task::595::TaskManager.Task::(_updateState) Task=`19221d03-5ef5-4d32-abcb-4c81027b010c`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:34:38,711::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:34:38,711::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:34:38,711::task::990::TaskManager.Task::(_decref) Task=`19221d03-5ef5-4d32-abcb-4c81027b010c`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:34:54,057::task::595::TaskManager.Task::(_updateState) Task=`0613aa8a-3ddd-436c-b408-c1ab19b81a13`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:34:54,058::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:34:54,058::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:34:54,058::task::1185::TaskManager.Task::(prepare) Task=`0613aa8a-3ddd-436c-b408-c1ab19b81a13`::finished: {} >Thread-13::DEBUG::2014-07-24 09:34:54,058::task::595::TaskManager.Task::(_updateState) Task=`0613aa8a-3ddd-436c-b408-c1ab19b81a13`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:34:54,058::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:34:54,059::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:34:54,059::task::990::TaskManager.Task::(_decref) Task=`0613aa8a-3ddd-436c-b408-c1ab19b81a13`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:35:09,361::task::595::TaskManager.Task::(_updateState) Task=`f48e3693-5472-4fb4-9aee-f62aeedac4da`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:35:09,361::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:35:09,361::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:35:09,362::task::1185::TaskManager.Task::(prepare) Task=`f48e3693-5472-4fb4-9aee-f62aeedac4da`::finished: {} >Thread-13::DEBUG::2014-07-24 09:35:09,362::task::595::TaskManager.Task::(_updateState) Task=`f48e3693-5472-4fb4-9aee-f62aeedac4da`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:35:09,362::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:35:09,362::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:35:09,362::task::990::TaskManager.Task::(_decref) Task=`f48e3693-5472-4fb4-9aee-f62aeedac4da`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:35:24,964::task::595::TaskManager.Task::(_updateState) Task=`b801c47b-6a45-4f56-8105-ca69d7b2f24d`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:35:24,964::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:35:24,965::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:35:24,965::task::1185::TaskManager.Task::(prepare) Task=`b801c47b-6a45-4f56-8105-ca69d7b2f24d`::finished: {} >Thread-13::DEBUG::2014-07-24 09:35:24,965::task::595::TaskManager.Task::(_updateState) Task=`b801c47b-6a45-4f56-8105-ca69d7b2f24d`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:35:24,965::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:35:24,965::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:35:24,965::task::990::TaskManager.Task::(_decref) Task=`b801c47b-6a45-4f56-8105-ca69d7b2f24d`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:35:40,318::task::595::TaskManager.Task::(_updateState) Task=`bc06261f-981d-42f8-b5d3-5a785170ed9a`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:35:40,319::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:35:40,319::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:35:40,319::task::1185::TaskManager.Task::(prepare) Task=`bc06261f-981d-42f8-b5d3-5a785170ed9a`::finished: {} >Thread-13::DEBUG::2014-07-24 09:35:40,319::task::595::TaskManager.Task::(_updateState) Task=`bc06261f-981d-42f8-b5d3-5a785170ed9a`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:35:40,319::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:35:40,319::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:35:40,320::task::990::TaskManager.Task::(_decref) Task=`bc06261f-981d-42f8-b5d3-5a785170ed9a`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:35:55,616::task::595::TaskManager.Task::(_updateState) Task=`932c8576-0c18-4263-bb08-8b19f0900f39`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:35:55,617::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:35:55,617::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:35:55,617::task::1185::TaskManager.Task::(prepare) Task=`932c8576-0c18-4263-bb08-8b19f0900f39`::finished: {} >Thread-13::DEBUG::2014-07-24 09:35:55,617::task::595::TaskManager.Task::(_updateState) Task=`932c8576-0c18-4263-bb08-8b19f0900f39`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:35:55,617::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:35:55,618::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:35:55,618::task::990::TaskManager.Task::(_decref) Task=`932c8576-0c18-4263-bb08-8b19f0900f39`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:36:10,956::task::595::TaskManager.Task::(_updateState) Task=`480f6974-142f-4636-86e7-85cc787de900`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:36:10,956::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:36:10,956::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:36:10,957::task::1185::TaskManager.Task::(prepare) Task=`480f6974-142f-4636-86e7-85cc787de900`::finished: {} >Thread-13::DEBUG::2014-07-24 09:36:10,957::task::595::TaskManager.Task::(_updateState) Task=`480f6974-142f-4636-86e7-85cc787de900`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:36:10,957::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:36:10,957::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:36:10,957::task::990::TaskManager.Task::(_decref) Task=`480f6974-142f-4636-86e7-85cc787de900`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:36:26,259::task::595::TaskManager.Task::(_updateState) Task=`0ad559f3-a1ef-4987-9683-cb87fe7a8a84`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:36:26,259::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:36:26,260::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:36:26,260::task::1185::TaskManager.Task::(prepare) Task=`0ad559f3-a1ef-4987-9683-cb87fe7a8a84`::finished: {} >Thread-13::DEBUG::2014-07-24 09:36:26,260::task::595::TaskManager.Task::(_updateState) Task=`0ad559f3-a1ef-4987-9683-cb87fe7a8a84`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:36:26,260::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:36:26,260::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:36:26,260::task::990::TaskManager.Task::(_decref) Task=`0ad559f3-a1ef-4987-9683-cb87fe7a8a84`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:36:41,553::task::595::TaskManager.Task::(_updateState) Task=`f0a8f804-ae70-420c-b3b8-1d1d20a0fe73`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:36:41,553::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:36:41,553::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:36:41,554::task::1185::TaskManager.Task::(prepare) Task=`f0a8f804-ae70-420c-b3b8-1d1d20a0fe73`::finished: {} >Thread-13::DEBUG::2014-07-24 09:36:41,554::task::595::TaskManager.Task::(_updateState) Task=`f0a8f804-ae70-420c-b3b8-1d1d20a0fe73`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:36:41,554::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:36:41,554::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:36:41,554::task::990::TaskManager.Task::(_decref) Task=`f0a8f804-ae70-420c-b3b8-1d1d20a0fe73`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:36:56,851::task::595::TaskManager.Task::(_updateState) Task=`8cf85520-3a07-4e1f-9447-0a0565c70124`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:36:56,851::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:36:56,852::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:36:56,852::task::1185::TaskManager.Task::(prepare) Task=`8cf85520-3a07-4e1f-9447-0a0565c70124`::finished: {} >Thread-13::DEBUG::2014-07-24 09:36:56,852::task::595::TaskManager.Task::(_updateState) Task=`8cf85520-3a07-4e1f-9447-0a0565c70124`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:36:56,852::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:36:56,852::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:36:56,852::task::990::TaskManager.Task::(_decref) Task=`8cf85520-3a07-4e1f-9447-0a0565c70124`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:37:12,206::task::595::TaskManager.Task::(_updateState) Task=`770fc5b3-faeb-4c63-9ec5-b6acf42c7347`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:37:12,206::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:37:12,207::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:37:12,207::task::1185::TaskManager.Task::(prepare) Task=`770fc5b3-faeb-4c63-9ec5-b6acf42c7347`::finished: {} >Thread-13::DEBUG::2014-07-24 09:37:12,207::task::595::TaskManager.Task::(_updateState) Task=`770fc5b3-faeb-4c63-9ec5-b6acf42c7347`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:37:12,207::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:37:12,207::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:37:12,207::task::990::TaskManager.Task::(_decref) Task=`770fc5b3-faeb-4c63-9ec5-b6acf42c7347`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:37:27,525::task::595::TaskManager.Task::(_updateState) Task=`aec11b6d-bb06-4d9b-b555-74b60899f878`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:37:27,526::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:37:27,526::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:37:27,526::task::1185::TaskManager.Task::(prepare) Task=`aec11b6d-bb06-4d9b-b555-74b60899f878`::finished: {} >Thread-13::DEBUG::2014-07-24 09:37:27,526::task::595::TaskManager.Task::(_updateState) Task=`aec11b6d-bb06-4d9b-b555-74b60899f878`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:37:27,526::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:37:27,527::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:37:27,527::task::990::TaskManager.Task::(_decref) Task=`aec11b6d-bb06-4d9b-b555-74b60899f878`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:37:43,073::task::595::TaskManager.Task::(_updateState) Task=`298b34ab-ba1f-4a19-98ad-36dc3b17d247`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:37:43,073::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:37:43,074::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:37:43,074::task::1185::TaskManager.Task::(prepare) Task=`298b34ab-ba1f-4a19-98ad-36dc3b17d247`::finished: {} >Thread-13::DEBUG::2014-07-24 09:37:43,074::task::595::TaskManager.Task::(_updateState) Task=`298b34ab-ba1f-4a19-98ad-36dc3b17d247`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:37:43,074::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:37:43,074::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:37:43,074::task::990::TaskManager.Task::(_decref) Task=`298b34ab-ba1f-4a19-98ad-36dc3b17d247`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:37:58,372::task::595::TaskManager.Task::(_updateState) Task=`87138065-0c2b-4738-930e-e6525d97ab70`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:37:58,373::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:37:58,373::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:37:58,373::task::1185::TaskManager.Task::(prepare) Task=`87138065-0c2b-4738-930e-e6525d97ab70`::finished: {} >Thread-13::DEBUG::2014-07-24 09:37:58,373::task::595::TaskManager.Task::(_updateState) Task=`87138065-0c2b-4738-930e-e6525d97ab70`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:37:58,373::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:37:58,373::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:37:58,373::task::990::TaskManager.Task::(_decref) Task=`87138065-0c2b-4738-930e-e6525d97ab70`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:38:13,680::task::595::TaskManager.Task::(_updateState) Task=`17ee2ea3-124d-4c56-85c4-ca663477a0a8`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:38:13,680::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:38:13,680::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:38:13,681::task::1185::TaskManager.Task::(prepare) Task=`17ee2ea3-124d-4c56-85c4-ca663477a0a8`::finished: {} >Thread-13::DEBUG::2014-07-24 09:38:13,681::task::595::TaskManager.Task::(_updateState) Task=`17ee2ea3-124d-4c56-85c4-ca663477a0a8`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:38:13,681::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:38:13,681::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:38:13,681::task::990::TaskManager.Task::(_decref) Task=`17ee2ea3-124d-4c56-85c4-ca663477a0a8`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:38:28,978::task::595::TaskManager.Task::(_updateState) Task=`63a44d76-5df6-44b6-b0cf-3502db4b6cee`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:38:28,978::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:38:28,978::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:38:28,979::task::1185::TaskManager.Task::(prepare) Task=`63a44d76-5df6-44b6-b0cf-3502db4b6cee`::finished: {} >Thread-13::DEBUG::2014-07-24 09:38:28,979::task::595::TaskManager.Task::(_updateState) Task=`63a44d76-5df6-44b6-b0cf-3502db4b6cee`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:38:28,979::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:38:28,979::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:38:28,979::task::990::TaskManager.Task::(_decref) Task=`63a44d76-5df6-44b6-b0cf-3502db4b6cee`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:38:44,330::task::595::TaskManager.Task::(_updateState) Task=`4760eb40-dca5-4b5e-a5a7-fbd6b8e04355`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:38:44,330::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:38:44,331::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:38:44,331::task::1185::TaskManager.Task::(prepare) Task=`4760eb40-dca5-4b5e-a5a7-fbd6b8e04355`::finished: {} >Thread-13::DEBUG::2014-07-24 09:38:44,331::task::595::TaskManager.Task::(_updateState) Task=`4760eb40-dca5-4b5e-a5a7-fbd6b8e04355`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:38:44,331::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:38:44,331::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:38:44,331::task::990::TaskManager.Task::(_decref) Task=`4760eb40-dca5-4b5e-a5a7-fbd6b8e04355`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:38:59,676::task::595::TaskManager.Task::(_updateState) Task=`4abeb667-86c1-4f25-b534-74af018fb07e`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:38:59,676::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:38:59,677::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:38:59,677::task::1185::TaskManager.Task::(prepare) Task=`4abeb667-86c1-4f25-b534-74af018fb07e`::finished: {} >Thread-13::DEBUG::2014-07-24 09:38:59,677::task::595::TaskManager.Task::(_updateState) Task=`4abeb667-86c1-4f25-b534-74af018fb07e`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:38:59,677::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:38:59,677::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:38:59,677::task::990::TaskManager.Task::(_decref) Task=`4abeb667-86c1-4f25-b534-74af018fb07e`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:39:14,987::task::595::TaskManager.Task::(_updateState) Task=`97ed1c1f-d320-41ae-94e2-ba4c2f88a42d`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:39:14,987::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:39:14,987::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:39:14,987::task::1185::TaskManager.Task::(prepare) Task=`97ed1c1f-d320-41ae-94e2-ba4c2f88a42d`::finished: {} >Thread-13::DEBUG::2014-07-24 09:39:14,987::task::595::TaskManager.Task::(_updateState) Task=`97ed1c1f-d320-41ae-94e2-ba4c2f88a42d`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:39:14,988::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:39:14,988::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:39:14,988::task::990::TaskManager.Task::(_decref) Task=`97ed1c1f-d320-41ae-94e2-ba4c2f88a42d`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:39:30,301::task::595::TaskManager.Task::(_updateState) Task=`98eea148-77a6-4343-98de-bfa6881fb86e`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:39:30,301::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:39:30,301::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:39:30,301::task::1185::TaskManager.Task::(prepare) Task=`98eea148-77a6-4343-98de-bfa6881fb86e`::finished: {} >Thread-13::DEBUG::2014-07-24 09:39:30,301::task::595::TaskManager.Task::(_updateState) Task=`98eea148-77a6-4343-98de-bfa6881fb86e`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:39:30,302::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:39:30,302::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:39:30,302::task::990::TaskManager.Task::(_decref) Task=`98eea148-77a6-4343-98de-bfa6881fb86e`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:39:45,603::task::595::TaskManager.Task::(_updateState) Task=`99c279b8-abdf-47c9-8020-3f060efb57ef`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:39:45,603::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:39:45,604::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:39:45,604::task::1185::TaskManager.Task::(prepare) Task=`99c279b8-abdf-47c9-8020-3f060efb57ef`::finished: {} >Thread-13::DEBUG::2014-07-24 09:39:45,604::task::595::TaskManager.Task::(_updateState) Task=`99c279b8-abdf-47c9-8020-3f060efb57ef`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:39:45,604::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:39:45,604::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:39:45,604::task::990::TaskManager.Task::(_decref) Task=`99c279b8-abdf-47c9-8020-3f060efb57ef`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:40:00,914::task::595::TaskManager.Task::(_updateState) Task=`bdf61313-f960-4251-a2b7-b9669da36eb8`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:40:00,914::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:40:00,914::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:40:00,914::task::1185::TaskManager.Task::(prepare) Task=`bdf61313-f960-4251-a2b7-b9669da36eb8`::finished: {} >Thread-13::DEBUG::2014-07-24 09:40:00,914::task::595::TaskManager.Task::(_updateState) Task=`bdf61313-f960-4251-a2b7-b9669da36eb8`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:40:00,915::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:40:00,915::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:40:00,915::task::990::TaskManager.Task::(_decref) Task=`bdf61313-f960-4251-a2b7-b9669da36eb8`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:40:16,239::task::595::TaskManager.Task::(_updateState) Task=`dd14e0af-d25e-4d39-9ff6-58d500a1cd29`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:40:16,239::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:40:16,239::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:40:16,239::task::1185::TaskManager.Task::(prepare) Task=`dd14e0af-d25e-4d39-9ff6-58d500a1cd29`::finished: {} >Thread-13::DEBUG::2014-07-24 09:40:16,240::task::595::TaskManager.Task::(_updateState) Task=`dd14e0af-d25e-4d39-9ff6-58d500a1cd29`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:40:16,240::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:40:16,240::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:40:16,240::task::990::TaskManager.Task::(_decref) Task=`dd14e0af-d25e-4d39-9ff6-58d500a1cd29`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:40:31,917::task::595::TaskManager.Task::(_updateState) Task=`ff09b4bb-1d95-4fb6-9e93-e19ff7a8fa1b`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:40:31,917::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:40:31,917::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:40:31,918::task::1185::TaskManager.Task::(prepare) Task=`ff09b4bb-1d95-4fb6-9e93-e19ff7a8fa1b`::finished: {} >Thread-13::DEBUG::2014-07-24 09:40:31,918::task::595::TaskManager.Task::(_updateState) Task=`ff09b4bb-1d95-4fb6-9e93-e19ff7a8fa1b`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:40:31,918::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:40:31,918::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:40:31,918::task::990::TaskManager.Task::(_decref) Task=`ff09b4bb-1d95-4fb6-9e93-e19ff7a8fa1b`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:40:47,215::task::595::TaskManager.Task::(_updateState) Task=`0d4a7652-ecf9-4b68-9c87-d4278baeb725`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:40:47,215::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:40:47,216::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:40:47,216::task::1185::TaskManager.Task::(prepare) Task=`0d4a7652-ecf9-4b68-9c87-d4278baeb725`::finished: {} >Thread-13::DEBUG::2014-07-24 09:40:47,216::task::595::TaskManager.Task::(_updateState) Task=`0d4a7652-ecf9-4b68-9c87-d4278baeb725`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:40:47,216::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:40:47,216::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:40:47,216::task::990::TaskManager.Task::(_decref) Task=`0d4a7652-ecf9-4b68-9c87-d4278baeb725`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:41:02,523::task::595::TaskManager.Task::(_updateState) Task=`0a03cc0e-2ab0-4d81-993a-d5636109e46e`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:41:02,524::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:41:02,524::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:41:02,524::task::1185::TaskManager.Task::(prepare) Task=`0a03cc0e-2ab0-4d81-993a-d5636109e46e`::finished: {} >Thread-13::DEBUG::2014-07-24 09:41:02,524::task::595::TaskManager.Task::(_updateState) Task=`0a03cc0e-2ab0-4d81-993a-d5636109e46e`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:41:02,524::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:41:02,525::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:41:02,525::task::990::TaskManager.Task::(_decref) Task=`0a03cc0e-2ab0-4d81-993a-d5636109e46e`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:41:17,818::task::595::TaskManager.Task::(_updateState) Task=`87853f5b-c0ad-4303-b318-a39238d8c51d`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:41:17,818::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:41:17,818::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:41:17,818::task::1185::TaskManager.Task::(prepare) Task=`87853f5b-c0ad-4303-b318-a39238d8c51d`::finished: {} >Thread-13::DEBUG::2014-07-24 09:41:17,818::task::595::TaskManager.Task::(_updateState) Task=`87853f5b-c0ad-4303-b318-a39238d8c51d`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:41:17,819::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:41:17,819::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:41:17,819::task::990::TaskManager.Task::(_decref) Task=`87853f5b-c0ad-4303-b318-a39238d8c51d`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:41:33,182::task::595::TaskManager.Task::(_updateState) Task=`6ebd34c9-b801-4e4a-bd47-1f0dfc7b993f`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:41:33,182::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:41:33,182::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:41:33,183::task::1185::TaskManager.Task::(prepare) Task=`6ebd34c9-b801-4e4a-bd47-1f0dfc7b993f`::finished: {} >Thread-13::DEBUG::2014-07-24 09:41:33,183::task::595::TaskManager.Task::(_updateState) Task=`6ebd34c9-b801-4e4a-bd47-1f0dfc7b993f`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:41:33,183::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:41:33,183::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:41:33,183::task::990::TaskManager.Task::(_decref) Task=`6ebd34c9-b801-4e4a-bd47-1f0dfc7b993f`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:41:48,486::task::595::TaskManager.Task::(_updateState) Task=`5cf89a84-16ab-422e-a088-516ba03f96c3`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:41:48,487::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:41:48,487::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:41:48,487::task::1185::TaskManager.Task::(prepare) Task=`5cf89a84-16ab-422e-a088-516ba03f96c3`::finished: {} >Thread-13::DEBUG::2014-07-24 09:41:48,487::task::595::TaskManager.Task::(_updateState) Task=`5cf89a84-16ab-422e-a088-516ba03f96c3`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:41:48,487::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:41:48,488::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:41:48,488::task::990::TaskManager.Task::(_decref) Task=`5cf89a84-16ab-422e-a088-516ba03f96c3`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:42:03,847::task::595::TaskManager.Task::(_updateState) Task=`02c207d6-1eb1-4c4a-86ee-f91f789420dc`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:42:03,848::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:42:03,848::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:42:03,848::task::1185::TaskManager.Task::(prepare) Task=`02c207d6-1eb1-4c4a-86ee-f91f789420dc`::finished: {} >Thread-13::DEBUG::2014-07-24 09:42:03,848::task::595::TaskManager.Task::(_updateState) Task=`02c207d6-1eb1-4c4a-86ee-f91f789420dc`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:42:03,848::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:42:03,848::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:42:03,849::task::990::TaskManager.Task::(_decref) Task=`02c207d6-1eb1-4c4a-86ee-f91f789420dc`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:42:19,191::task::595::TaskManager.Task::(_updateState) Task=`564738bc-a31e-4dd4-87e2-c744ae8b89a1`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:42:19,191::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:42:19,191::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:42:19,191::task::1185::TaskManager.Task::(prepare) Task=`564738bc-a31e-4dd4-87e2-c744ae8b89a1`::finished: {} >Thread-13::DEBUG::2014-07-24 09:42:19,192::task::595::TaskManager.Task::(_updateState) Task=`564738bc-a31e-4dd4-87e2-c744ae8b89a1`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:42:19,192::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:42:19,192::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:42:19,192::task::990::TaskManager.Task::(_decref) Task=`564738bc-a31e-4dd4-87e2-c744ae8b89a1`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:42:34,510::task::595::TaskManager.Task::(_updateState) Task=`fb86f178-dd21-456f-8ab7-2e3474aeafc7`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:42:34,510::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:42:34,510::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:42:34,510::task::1185::TaskManager.Task::(prepare) Task=`fb86f178-dd21-456f-8ab7-2e3474aeafc7`::finished: {} >Thread-13::DEBUG::2014-07-24 09:42:34,510::task::595::TaskManager.Task::(_updateState) Task=`fb86f178-dd21-456f-8ab7-2e3474aeafc7`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:42:34,511::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:42:34,511::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:42:34,511::task::990::TaskManager.Task::(_decref) Task=`fb86f178-dd21-456f-8ab7-2e3474aeafc7`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:42:49,892::task::595::TaskManager.Task::(_updateState) Task=`e7a9faea-5644-43fa-897f-9ca7e4e102d0`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:42:49,892::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:42:49,893::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:42:49,893::task::1185::TaskManager.Task::(prepare) Task=`e7a9faea-5644-43fa-897f-9ca7e4e102d0`::finished: {} >Thread-13::DEBUG::2014-07-24 09:42:49,893::task::595::TaskManager.Task::(_updateState) Task=`e7a9faea-5644-43fa-897f-9ca7e4e102d0`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:42:49,893::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:42:49,893::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:42:49,893::task::990::TaskManager.Task::(_decref) Task=`e7a9faea-5644-43fa-897f-9ca7e4e102d0`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:43:05,347::task::595::TaskManager.Task::(_updateState) Task=`c5b274f9-b73f-44a9-bb0d-64fd6bb46369`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:43:05,347::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:43:05,347::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:43:05,347::task::1185::TaskManager.Task::(prepare) Task=`c5b274f9-b73f-44a9-bb0d-64fd6bb46369`::finished: {} >Thread-13::DEBUG::2014-07-24 09:43:05,347::task::595::TaskManager.Task::(_updateState) Task=`c5b274f9-b73f-44a9-bb0d-64fd6bb46369`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:43:05,347::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:43:05,348::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:43:05,348::task::990::TaskManager.Task::(_decref) Task=`c5b274f9-b73f-44a9-bb0d-64fd6bb46369`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:43:20,849::task::595::TaskManager.Task::(_updateState) Task=`83e27d09-c403-4099-9539-41be2d38da2d`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:43:20,849::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:43:20,850::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:43:20,850::task::1185::TaskManager.Task::(prepare) Task=`83e27d09-c403-4099-9539-41be2d38da2d`::finished: {} >Thread-13::DEBUG::2014-07-24 09:43:20,850::task::595::TaskManager.Task::(_updateState) Task=`83e27d09-c403-4099-9539-41be2d38da2d`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:43:20,850::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:43:20,850::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:43:20,850::task::990::TaskManager.Task::(_decref) Task=`83e27d09-c403-4099-9539-41be2d38da2d`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:43:36,292::task::595::TaskManager.Task::(_updateState) Task=`c2eedf80-daa9-4a46-bedd-7bbd7d8f7381`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:43:36,293::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:43:36,293::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:43:36,293::task::1185::TaskManager.Task::(prepare) Task=`c2eedf80-daa9-4a46-bedd-7bbd7d8f7381`::finished: {} >Thread-13::DEBUG::2014-07-24 09:43:36,293::task::595::TaskManager.Task::(_updateState) Task=`c2eedf80-daa9-4a46-bedd-7bbd7d8f7381`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:43:36,293::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:43:36,293::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:43:36,294::task::990::TaskManager.Task::(_decref) Task=`c2eedf80-daa9-4a46-bedd-7bbd7d8f7381`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:43:51,741::task::595::TaskManager.Task::(_updateState) Task=`4cc0f1b2-c920-4846-bfb2-c720af41a703`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:43:51,741::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:43:51,741::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:43:51,741::task::1185::TaskManager.Task::(prepare) Task=`4cc0f1b2-c920-4846-bfb2-c720af41a703`::finished: {} >Thread-13::DEBUG::2014-07-24 09:43:51,742::task::595::TaskManager.Task::(_updateState) Task=`4cc0f1b2-c920-4846-bfb2-c720af41a703`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:43:51,742::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:43:51,742::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:43:51,742::task::990::TaskManager.Task::(_decref) Task=`4cc0f1b2-c920-4846-bfb2-c720af41a703`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:44:07,195::task::595::TaskManager.Task::(_updateState) Task=`337d4cfc-e1dd-45f2-917d-4a5ed9cb14e8`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:44:07,195::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:44:07,195::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:44:07,195::task::1185::TaskManager.Task::(prepare) Task=`337d4cfc-e1dd-45f2-917d-4a5ed9cb14e8`::finished: {} >Thread-13::DEBUG::2014-07-24 09:44:07,195::task::595::TaskManager.Task::(_updateState) Task=`337d4cfc-e1dd-45f2-917d-4a5ed9cb14e8`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:44:07,196::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:44:07,196::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:44:07,196::task::990::TaskManager.Task::(_decref) Task=`337d4cfc-e1dd-45f2-917d-4a5ed9cb14e8`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:44:22,547::task::595::TaskManager.Task::(_updateState) Task=`26d388d9-95be-4f26-b1c5-a2a316b0e92c`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:44:22,547::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:44:22,547::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:44:22,548::task::1185::TaskManager.Task::(prepare) Task=`26d388d9-95be-4f26-b1c5-a2a316b0e92c`::finished: {} >Thread-13::DEBUG::2014-07-24 09:44:22,548::task::595::TaskManager.Task::(_updateState) Task=`26d388d9-95be-4f26-b1c5-a2a316b0e92c`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:44:22,548::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:44:22,548::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:44:22,548::task::990::TaskManager.Task::(_decref) Task=`26d388d9-95be-4f26-b1c5-a2a316b0e92c`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:44:37,895::task::595::TaskManager.Task::(_updateState) Task=`e94cc5f6-1023-4dc8-a70f-b0ceda46fec4`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:44:37,895::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:44:37,896::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:44:37,896::task::1185::TaskManager.Task::(prepare) Task=`e94cc5f6-1023-4dc8-a70f-b0ceda46fec4`::finished: {} >Thread-13::DEBUG::2014-07-24 09:44:37,896::task::595::TaskManager.Task::(_updateState) Task=`e94cc5f6-1023-4dc8-a70f-b0ceda46fec4`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:44:37,896::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:44:37,896::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:44:37,896::task::990::TaskManager.Task::(_decref) Task=`e94cc5f6-1023-4dc8-a70f-b0ceda46fec4`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:44:53,401::task::595::TaskManager.Task::(_updateState) Task=`9ddf7b61-9877-4f4e-8a77-9143924b5584`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:44:53,401::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:44:53,401::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:44:53,402::task::1185::TaskManager.Task::(prepare) Task=`9ddf7b61-9877-4f4e-8a77-9143924b5584`::finished: {} >Thread-13::DEBUG::2014-07-24 09:44:53,402::task::595::TaskManager.Task::(_updateState) Task=`9ddf7b61-9877-4f4e-8a77-9143924b5584`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:44:53,402::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:44:53,402::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:44:53,402::task::990::TaskManager.Task::(_decref) Task=`9ddf7b61-9877-4f4e-8a77-9143924b5584`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:45:08,707::task::595::TaskManager.Task::(_updateState) Task=`b61a2fdf-100c-4b90-a436-5aecb28b9878`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:45:08,708::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:45:08,708::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:45:08,708::task::1185::TaskManager.Task::(prepare) Task=`b61a2fdf-100c-4b90-a436-5aecb28b9878`::finished: {} >Thread-13::DEBUG::2014-07-24 09:45:08,708::task::595::TaskManager.Task::(_updateState) Task=`b61a2fdf-100c-4b90-a436-5aecb28b9878`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:45:08,708::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:45:08,709::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:45:08,709::task::990::TaskManager.Task::(_decref) Task=`b61a2fdf-100c-4b90-a436-5aecb28b9878`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:45:24,746::task::595::TaskManager.Task::(_updateState) Task=`1b7422af-25a0-48fa-aa08-7b522c30a949`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:45:24,746::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:45:24,746::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:45:24,746::task::1185::TaskManager.Task::(prepare) Task=`1b7422af-25a0-48fa-aa08-7b522c30a949`::finished: {} >Thread-13::DEBUG::2014-07-24 09:45:24,746::task::595::TaskManager.Task::(_updateState) Task=`1b7422af-25a0-48fa-aa08-7b522c30a949`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:45:24,747::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:45:24,747::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:45:24,747::task::990::TaskManager.Task::(_decref) Task=`1b7422af-25a0-48fa-aa08-7b522c30a949`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:45:40,089::task::595::TaskManager.Task::(_updateState) Task=`7c99b0b9-c531-4592-85f4-ba9c2078c012`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:45:40,089::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:45:40,089::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:45:40,089::task::1185::TaskManager.Task::(prepare) Task=`7c99b0b9-c531-4592-85f4-ba9c2078c012`::finished: {} >Thread-13::DEBUG::2014-07-24 09:45:40,089::task::595::TaskManager.Task::(_updateState) Task=`7c99b0b9-c531-4592-85f4-ba9c2078c012`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:45:40,090::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:45:40,090::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:45:40,090::task::990::TaskManager.Task::(_decref) Task=`7c99b0b9-c531-4592-85f4-ba9c2078c012`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:45:55,410::task::595::TaskManager.Task::(_updateState) Task=`757d04cc-7c93-4c46-a705-31d2835e2cd3`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:45:55,410::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:45:55,410::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:45:55,411::task::1185::TaskManager.Task::(prepare) Task=`757d04cc-7c93-4c46-a705-31d2835e2cd3`::finished: {} >Thread-13::DEBUG::2014-07-24 09:45:55,411::task::595::TaskManager.Task::(_updateState) Task=`757d04cc-7c93-4c46-a705-31d2835e2cd3`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:45:55,411::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:45:55,411::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:45:55,411::task::990::TaskManager.Task::(_decref) Task=`757d04cc-7c93-4c46-a705-31d2835e2cd3`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:46:10,734::task::595::TaskManager.Task::(_updateState) Task=`c883cdaf-1b0b-4d32-b086-3566982e00c1`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:46:10,734::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:46:10,734::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:46:10,734::task::1185::TaskManager.Task::(prepare) Task=`c883cdaf-1b0b-4d32-b086-3566982e00c1`::finished: {} >Thread-13::DEBUG::2014-07-24 09:46:10,734::task::595::TaskManager.Task::(_updateState) Task=`c883cdaf-1b0b-4d32-b086-3566982e00c1`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:46:10,734::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:46:10,735::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:46:10,735::task::990::TaskManager.Task::(_decref) Task=`c883cdaf-1b0b-4d32-b086-3566982e00c1`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:46:26,028::task::595::TaskManager.Task::(_updateState) Task=`47d9b80c-9df3-467b-b9db-938401b8f729`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:46:26,029::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:46:26,029::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:46:26,029::task::1185::TaskManager.Task::(prepare) Task=`47d9b80c-9df3-467b-b9db-938401b8f729`::finished: {} >Thread-13::DEBUG::2014-07-24 09:46:26,029::task::595::TaskManager.Task::(_updateState) Task=`47d9b80c-9df3-467b-b9db-938401b8f729`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:46:26,029::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:46:26,030::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:46:26,030::task::990::TaskManager.Task::(_decref) Task=`47d9b80c-9df3-467b-b9db-938401b8f729`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:46:41,354::task::595::TaskManager.Task::(_updateState) Task=`b3539adf-e752-45fd-bf31-bbc29612e727`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:46:41,354::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:46:41,354::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:46:41,354::task::1185::TaskManager.Task::(prepare) Task=`b3539adf-e752-45fd-bf31-bbc29612e727`::finished: {} >Thread-13::DEBUG::2014-07-24 09:46:41,354::task::595::TaskManager.Task::(_updateState) Task=`b3539adf-e752-45fd-bf31-bbc29612e727`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:46:41,354::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:46:41,355::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:46:41,355::task::990::TaskManager.Task::(_decref) Task=`b3539adf-e752-45fd-bf31-bbc29612e727`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:46:56,679::task::595::TaskManager.Task::(_updateState) Task=`0145a15e-7961-4b38-92db-cdad02b8d5d8`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:46:56,680::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:46:56,680::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:46:56,680::task::1185::TaskManager.Task::(prepare) Task=`0145a15e-7961-4b38-92db-cdad02b8d5d8`::finished: {} >Thread-13::DEBUG::2014-07-24 09:46:56,680::task::595::TaskManager.Task::(_updateState) Task=`0145a15e-7961-4b38-92db-cdad02b8d5d8`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:46:56,680::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:46:56,680::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:46:56,681::task::990::TaskManager.Task::(_decref) Task=`0145a15e-7961-4b38-92db-cdad02b8d5d8`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:47:11,977::task::595::TaskManager.Task::(_updateState) Task=`e348b0a4-c7c9-441d-bdd3-7483e112f5b1`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:47:11,977::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:47:11,977::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:47:11,977::task::1185::TaskManager.Task::(prepare) Task=`e348b0a4-c7c9-441d-bdd3-7483e112f5b1`::finished: {} >Thread-13::DEBUG::2014-07-24 09:47:11,977::task::595::TaskManager.Task::(_updateState) Task=`e348b0a4-c7c9-441d-bdd3-7483e112f5b1`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:47:11,977::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:47:11,978::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:47:11,978::task::990::TaskManager.Task::(_decref) Task=`e348b0a4-c7c9-441d-bdd3-7483e112f5b1`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:47:27,264::task::595::TaskManager.Task::(_updateState) Task=`8e38dc00-fd60-4ebc-8cf3-e390f614466f`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:47:27,264::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:47:27,265::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:47:27,265::task::1185::TaskManager.Task::(prepare) Task=`8e38dc00-fd60-4ebc-8cf3-e390f614466f`::finished: {} >Thread-13::DEBUG::2014-07-24 09:47:27,265::task::595::TaskManager.Task::(_updateState) Task=`8e38dc00-fd60-4ebc-8cf3-e390f614466f`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:47:27,265::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:47:27,265::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:47:27,265::task::990::TaskManager.Task::(_decref) Task=`8e38dc00-fd60-4ebc-8cf3-e390f614466f`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:47:42,682::task::595::TaskManager.Task::(_updateState) Task=`ae1a3437-2a8d-4ccd-aeeb-45848e2383d6`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:47:42,683::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:47:42,683::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:47:42,683::task::1185::TaskManager.Task::(prepare) Task=`ae1a3437-2a8d-4ccd-aeeb-45848e2383d6`::finished: {} >Thread-13::DEBUG::2014-07-24 09:47:42,683::task::595::TaskManager.Task::(_updateState) Task=`ae1a3437-2a8d-4ccd-aeeb-45848e2383d6`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:47:42,683::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:47:42,683::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:47:42,684::task::990::TaskManager.Task::(_decref) Task=`ae1a3437-2a8d-4ccd-aeeb-45848e2383d6`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:47:58,064::task::595::TaskManager.Task::(_updateState) Task=`2bb313ad-7b5d-4898-a061-75a741fdfcc3`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:47:58,064::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:47:58,064::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:47:58,064::task::1185::TaskManager.Task::(prepare) Task=`2bb313ad-7b5d-4898-a061-75a741fdfcc3`::finished: {} >Thread-13::DEBUG::2014-07-24 09:47:58,065::task::595::TaskManager.Task::(_updateState) Task=`2bb313ad-7b5d-4898-a061-75a741fdfcc3`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:47:58,065::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:47:58,065::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:47:58,065::task::990::TaskManager.Task::(_decref) Task=`2bb313ad-7b5d-4898-a061-75a741fdfcc3`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:48:13,447::task::595::TaskManager.Task::(_updateState) Task=`7d4cd64c-770d-4965-8c5c-4f9fccdbc5a9`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:48:13,447::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:48:13,448::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:48:13,448::task::1185::TaskManager.Task::(prepare) Task=`7d4cd64c-770d-4965-8c5c-4f9fccdbc5a9`::finished: {} >Thread-13::DEBUG::2014-07-24 09:48:13,448::task::595::TaskManager.Task::(_updateState) Task=`7d4cd64c-770d-4965-8c5c-4f9fccdbc5a9`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:48:13,448::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:48:13,448::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:48:13,448::task::990::TaskManager.Task::(_decref) Task=`7d4cd64c-770d-4965-8c5c-4f9fccdbc5a9`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:48:28,784::task::595::TaskManager.Task::(_updateState) Task=`416bfb85-bef0-4f01-ba76-2869a3b7aed4`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:48:28,784::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:48:28,784::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:48:28,784::task::1185::TaskManager.Task::(prepare) Task=`416bfb85-bef0-4f01-ba76-2869a3b7aed4`::finished: {} >Thread-13::DEBUG::2014-07-24 09:48:28,785::task::595::TaskManager.Task::(_updateState) Task=`416bfb85-bef0-4f01-ba76-2869a3b7aed4`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:48:28,785::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:48:28,785::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:48:28,785::task::990::TaskManager.Task::(_decref) Task=`416bfb85-bef0-4f01-ba76-2869a3b7aed4`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:48:44,134::task::595::TaskManager.Task::(_updateState) Task=`51da0d05-2eb3-4b43-ba56-0e1e5bcde99c`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:48:44,134::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:48:44,135::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:48:44,135::task::1185::TaskManager.Task::(prepare) Task=`51da0d05-2eb3-4b43-ba56-0e1e5bcde99c`::finished: {} >Thread-13::DEBUG::2014-07-24 09:48:44,135::task::595::TaskManager.Task::(_updateState) Task=`51da0d05-2eb3-4b43-ba56-0e1e5bcde99c`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:48:44,135::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:48:44,135::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:48:44,135::task::990::TaskManager.Task::(_decref) Task=`51da0d05-2eb3-4b43-ba56-0e1e5bcde99c`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:48:59,430::task::595::TaskManager.Task::(_updateState) Task=`fe01acc2-7860-4851-b230-2b39bd28fc9a`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:48:59,430::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:48:59,430::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:48:59,431::task::1185::TaskManager.Task::(prepare) Task=`fe01acc2-7860-4851-b230-2b39bd28fc9a`::finished: {} >Thread-13::DEBUG::2014-07-24 09:48:59,431::task::595::TaskManager.Task::(_updateState) Task=`fe01acc2-7860-4851-b230-2b39bd28fc9a`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:48:59,431::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:48:59,431::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:48:59,431::task::990::TaskManager.Task::(_decref) Task=`fe01acc2-7860-4851-b230-2b39bd28fc9a`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:49:14,824::task::595::TaskManager.Task::(_updateState) Task=`13b5977e-8b54-40c6-8216-95ab5370d9d8`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:49:14,824::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:49:14,824::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:49:14,824::task::1185::TaskManager.Task::(prepare) Task=`13b5977e-8b54-40c6-8216-95ab5370d9d8`::finished: {} >Thread-13::DEBUG::2014-07-24 09:49:14,825::task::595::TaskManager.Task::(_updateState) Task=`13b5977e-8b54-40c6-8216-95ab5370d9d8`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:49:14,825::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:49:14,825::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:49:14,825::task::990::TaskManager.Task::(_decref) Task=`13b5977e-8b54-40c6-8216-95ab5370d9d8`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:49:30,155::task::595::TaskManager.Task::(_updateState) Task=`c9bbf38d-6ea7-46e9-9b82-36d703b3e3a2`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:49:30,155::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:49:30,155::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:49:30,155::task::1185::TaskManager.Task::(prepare) Task=`c9bbf38d-6ea7-46e9-9b82-36d703b3e3a2`::finished: {} >Thread-13::DEBUG::2014-07-24 09:49:30,155::task::595::TaskManager.Task::(_updateState) Task=`c9bbf38d-6ea7-46e9-9b82-36d703b3e3a2`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:49:30,156::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:49:30,156::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:49:30,156::task::990::TaskManager.Task::(_decref) Task=`c9bbf38d-6ea7-46e9-9b82-36d703b3e3a2`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:49:45,463::task::595::TaskManager.Task::(_updateState) Task=`79d47da1-63c8-450b-bbb8-291cec97c3e6`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:49:45,463::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:49:45,463::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:49:45,463::task::1185::TaskManager.Task::(prepare) Task=`79d47da1-63c8-450b-bbb8-291cec97c3e6`::finished: {} >Thread-13::DEBUG::2014-07-24 09:49:45,463::task::595::TaskManager.Task::(_updateState) Task=`79d47da1-63c8-450b-bbb8-291cec97c3e6`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:49:45,464::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:49:45,464::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:49:45,464::task::990::TaskManager.Task::(_decref) Task=`79d47da1-63c8-450b-bbb8-291cec97c3e6`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:50:00,783::task::595::TaskManager.Task::(_updateState) Task=`8013f5f8-3b8d-4035-8a8d-fb51667d0c08`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:50:00,784::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:50:00,784::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:50:00,784::task::1185::TaskManager.Task::(prepare) Task=`8013f5f8-3b8d-4035-8a8d-fb51667d0c08`::finished: {} >Thread-13::DEBUG::2014-07-24 09:50:00,784::task::595::TaskManager.Task::(_updateState) Task=`8013f5f8-3b8d-4035-8a8d-fb51667d0c08`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:50:00,784::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:50:00,785::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:50:00,785::task::990::TaskManager.Task::(_decref) Task=`8013f5f8-3b8d-4035-8a8d-fb51667d0c08`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:50:16,088::task::595::TaskManager.Task::(_updateState) Task=`bfe76867-54b2-4dd9-8bcf-d1702712a68e`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:50:16,088::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:50:16,088::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:50:16,088::task::1185::TaskManager.Task::(prepare) Task=`bfe76867-54b2-4dd9-8bcf-d1702712a68e`::finished: {} >Thread-13::DEBUG::2014-07-24 09:50:16,089::task::595::TaskManager.Task::(_updateState) Task=`bfe76867-54b2-4dd9-8bcf-d1702712a68e`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:50:16,089::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:50:16,089::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:50:16,089::task::990::TaskManager.Task::(_decref) Task=`bfe76867-54b2-4dd9-8bcf-d1702712a68e`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:50:31,733::task::595::TaskManager.Task::(_updateState) Task=`ae4f7d6d-9cd0-4ceb-ab3c-48cd6d993de9`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:50:31,733::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:50:31,733::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:50:31,733::task::1185::TaskManager.Task::(prepare) Task=`ae4f7d6d-9cd0-4ceb-ab3c-48cd6d993de9`::finished: {} >Thread-13::DEBUG::2014-07-24 09:50:31,733::task::595::TaskManager.Task::(_updateState) Task=`ae4f7d6d-9cd0-4ceb-ab3c-48cd6d993de9`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:50:31,734::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:50:31,734::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:50:31,734::task::990::TaskManager.Task::(_decref) Task=`ae4f7d6d-9cd0-4ceb-ab3c-48cd6d993de9`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:50:47,053::task::595::TaskManager.Task::(_updateState) Task=`f72c7184-e5d0-4b2b-ab47-35e213c2a22d`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:50:47,054::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:50:47,054::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:50:47,054::task::1185::TaskManager.Task::(prepare) Task=`f72c7184-e5d0-4b2b-ab47-35e213c2a22d`::finished: {} >Thread-13::DEBUG::2014-07-24 09:50:47,054::task::595::TaskManager.Task::(_updateState) Task=`f72c7184-e5d0-4b2b-ab47-35e213c2a22d`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:50:47,054::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:50:47,054::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:50:47,055::task::990::TaskManager.Task::(_decref) Task=`f72c7184-e5d0-4b2b-ab47-35e213c2a22d`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:51:02,370::task::595::TaskManager.Task::(_updateState) Task=`02bed9cc-ee46-47f0-ba5d-47ed490afe7e`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:51:02,371::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:51:02,371::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:51:02,371::task::1185::TaskManager.Task::(prepare) Task=`02bed9cc-ee46-47f0-ba5d-47ed490afe7e`::finished: {} >Thread-13::DEBUG::2014-07-24 09:51:02,371::task::595::TaskManager.Task::(_updateState) Task=`02bed9cc-ee46-47f0-ba5d-47ed490afe7e`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:51:02,371::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:51:02,372::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:51:02,372::task::990::TaskManager.Task::(_decref) Task=`02bed9cc-ee46-47f0-ba5d-47ed490afe7e`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:51:17,688::task::595::TaskManager.Task::(_updateState) Task=`f0464a4f-19a9-485c-9ee2-4b00c8a9eba3`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:51:17,688::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:51:17,688::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:51:17,689::task::1185::TaskManager.Task::(prepare) Task=`f0464a4f-19a9-485c-9ee2-4b00c8a9eba3`::finished: {} >Thread-13::DEBUG::2014-07-24 09:51:17,689::task::595::TaskManager.Task::(_updateState) Task=`f0464a4f-19a9-485c-9ee2-4b00c8a9eba3`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:51:17,689::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:51:17,689::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:51:17,689::task::990::TaskManager.Task::(_decref) Task=`f0464a4f-19a9-485c-9ee2-4b00c8a9eba3`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:51:33,010::task::595::TaskManager.Task::(_updateState) Task=`37779623-ba8f-44f1-927b-d108b613bc86`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:51:33,011::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:51:33,011::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:51:33,011::task::1185::TaskManager.Task::(prepare) Task=`37779623-ba8f-44f1-927b-d108b613bc86`::finished: {} >Thread-13::DEBUG::2014-07-24 09:51:33,011::task::595::TaskManager.Task::(_updateState) Task=`37779623-ba8f-44f1-927b-d108b613bc86`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:51:33,011::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:51:33,011::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:51:33,012::task::990::TaskManager.Task::(_decref) Task=`37779623-ba8f-44f1-927b-d108b613bc86`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:51:48,378::task::595::TaskManager.Task::(_updateState) Task=`a3efbaa3-8e2b-42ad-aeda-1cf4ebf0e920`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:51:48,378::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:51:48,378::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:51:48,378::task::1185::TaskManager.Task::(prepare) Task=`a3efbaa3-8e2b-42ad-aeda-1cf4ebf0e920`::finished: {} >Thread-13::DEBUG::2014-07-24 09:51:48,378::task::595::TaskManager.Task::(_updateState) Task=`a3efbaa3-8e2b-42ad-aeda-1cf4ebf0e920`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:51:48,379::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:51:48,379::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:51:48,379::task::990::TaskManager.Task::(_decref) Task=`a3efbaa3-8e2b-42ad-aeda-1cf4ebf0e920`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:52:03,683::task::595::TaskManager.Task::(_updateState) Task=`5a65fd31-e3ec-4dc8-b4b9-430685f027a2`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:52:03,684::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:52:03,684::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:52:03,684::task::1185::TaskManager.Task::(prepare) Task=`5a65fd31-e3ec-4dc8-b4b9-430685f027a2`::finished: {} >Thread-13::DEBUG::2014-07-24 09:52:03,684::task::595::TaskManager.Task::(_updateState) Task=`5a65fd31-e3ec-4dc8-b4b9-430685f027a2`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:52:03,684::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:52:03,684::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:52:03,685::task::990::TaskManager.Task::(_decref) Task=`5a65fd31-e3ec-4dc8-b4b9-430685f027a2`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:52:19,010::task::595::TaskManager.Task::(_updateState) Task=`99269c33-8e24-4940-82fc-d44527c8510f`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:52:19,011::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:52:19,011::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:52:19,011::task::1185::TaskManager.Task::(prepare) Task=`99269c33-8e24-4940-82fc-d44527c8510f`::finished: {} >Thread-13::DEBUG::2014-07-24 09:52:19,011::task::595::TaskManager.Task::(_updateState) Task=`99269c33-8e24-4940-82fc-d44527c8510f`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:52:19,011::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:52:19,011::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:52:19,012::task::990::TaskManager.Task::(_decref) Task=`99269c33-8e24-4940-82fc-d44527c8510f`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:52:34,302::task::595::TaskManager.Task::(_updateState) Task=`cc81034e-7d0f-4a19-bd1a-64bce50e9aa0`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:52:34,302::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:52:34,302::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:52:34,302::task::1185::TaskManager.Task::(prepare) Task=`cc81034e-7d0f-4a19-bd1a-64bce50e9aa0`::finished: {} >Thread-13::DEBUG::2014-07-24 09:52:34,302::task::595::TaskManager.Task::(_updateState) Task=`cc81034e-7d0f-4a19-bd1a-64bce50e9aa0`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:52:34,302::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:52:34,303::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:52:34,303::task::990::TaskManager.Task::(_decref) Task=`cc81034e-7d0f-4a19-bd1a-64bce50e9aa0`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:52:49,616::task::595::TaskManager.Task::(_updateState) Task=`816d40f5-31ed-4d30-af7e-9fae899cbe03`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:52:49,617::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:52:49,617::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:52:49,617::task::1185::TaskManager.Task::(prepare) Task=`816d40f5-31ed-4d30-af7e-9fae899cbe03`::finished: {} >Thread-13::DEBUG::2014-07-24 09:52:49,617::task::595::TaskManager.Task::(_updateState) Task=`816d40f5-31ed-4d30-af7e-9fae899cbe03`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:52:49,617::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:52:49,618::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:52:49,618::task::990::TaskManager.Task::(_decref) Task=`816d40f5-31ed-4d30-af7e-9fae899cbe03`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:53:04,924::task::595::TaskManager.Task::(_updateState) Task=`51549ad7-e573-4513-844f-707614419611`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:53:04,926::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:53:04,926::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:53:04,927::task::1185::TaskManager.Task::(prepare) Task=`51549ad7-e573-4513-844f-707614419611`::finished: {} >Thread-13::DEBUG::2014-07-24 09:53:04,928::task::595::TaskManager.Task::(_updateState) Task=`51549ad7-e573-4513-844f-707614419611`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:53:04,929::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:53:04,930::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:53:04,930::task::990::TaskManager.Task::(_decref) Task=`51549ad7-e573-4513-844f-707614419611`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:53:20,249::task::595::TaskManager.Task::(_updateState) Task=`6ea5082c-a975-4035-851c-844bb9e68fd0`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:53:20,249::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:53:20,249::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:53:20,249::task::1185::TaskManager.Task::(prepare) Task=`6ea5082c-a975-4035-851c-844bb9e68fd0`::finished: {} >Thread-13::DEBUG::2014-07-24 09:53:20,249::task::595::TaskManager.Task::(_updateState) Task=`6ea5082c-a975-4035-851c-844bb9e68fd0`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:53:20,250::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:53:20,250::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:53:20,250::task::990::TaskManager.Task::(_decref) Task=`6ea5082c-a975-4035-851c-844bb9e68fd0`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:53:35,566::task::595::TaskManager.Task::(_updateState) Task=`02ae66e2-e45a-41c1-a47a-73c1e50976a1`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:53:35,567::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:53:35,567::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:53:35,567::task::1185::TaskManager.Task::(prepare) Task=`02ae66e2-e45a-41c1-a47a-73c1e50976a1`::finished: {} >Thread-13::DEBUG::2014-07-24 09:53:35,567::task::595::TaskManager.Task::(_updateState) Task=`02ae66e2-e45a-41c1-a47a-73c1e50976a1`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:53:35,567::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:53:35,568::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:53:35,568::task::990::TaskManager.Task::(_decref) Task=`02ae66e2-e45a-41c1-a47a-73c1e50976a1`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:53:50,862::task::595::TaskManager.Task::(_updateState) Task=`600b637c-be91-4834-a19f-b46d058aa0ac`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:53:50,862::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:53:50,862::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:53:50,863::task::1185::TaskManager.Task::(prepare) Task=`600b637c-be91-4834-a19f-b46d058aa0ac`::finished: {} >Thread-13::DEBUG::2014-07-24 09:53:50,863::task::595::TaskManager.Task::(_updateState) Task=`600b637c-be91-4834-a19f-b46d058aa0ac`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:53:50,863::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:53:50,863::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:53:50,863::task::990::TaskManager.Task::(_decref) Task=`600b637c-be91-4834-a19f-b46d058aa0ac`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:54:06,223::task::595::TaskManager.Task::(_updateState) Task=`d4b9de32-adb6-479c-9053-d7a91603e7bf`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:54:06,223::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:54:06,224::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:54:06,224::task::1185::TaskManager.Task::(prepare) Task=`d4b9de32-adb6-479c-9053-d7a91603e7bf`::finished: {} >Thread-13::DEBUG::2014-07-24 09:54:06,224::task::595::TaskManager.Task::(_updateState) Task=`d4b9de32-adb6-479c-9053-d7a91603e7bf`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:54:06,224::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:54:06,224::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:54:06,224::task::990::TaskManager.Task::(_decref) Task=`d4b9de32-adb6-479c-9053-d7a91603e7bf`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:54:21,577::task::595::TaskManager.Task::(_updateState) Task=`247a06bd-1761-428e-b3c1-9e2c524f770f`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:54:21,577::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:54:21,577::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:54:21,577::task::1185::TaskManager.Task::(prepare) Task=`247a06bd-1761-428e-b3c1-9e2c524f770f`::finished: {} >Thread-13::DEBUG::2014-07-24 09:54:21,577::task::595::TaskManager.Task::(_updateState) Task=`247a06bd-1761-428e-b3c1-9e2c524f770f`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:54:21,578::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:54:21,578::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:54:21,578::task::990::TaskManager.Task::(_decref) Task=`247a06bd-1761-428e-b3c1-9e2c524f770f`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:54:36,919::task::595::TaskManager.Task::(_updateState) Task=`2bd4647c-b209-44ba-aa18-25217ea6099b`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:54:36,919::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:54:36,920::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:54:36,920::task::1185::TaskManager.Task::(prepare) Task=`2bd4647c-b209-44ba-aa18-25217ea6099b`::finished: {} >Thread-13::DEBUG::2014-07-24 09:54:36,920::task::595::TaskManager.Task::(_updateState) Task=`2bd4647c-b209-44ba-aa18-25217ea6099b`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:54:36,920::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:54:36,920::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:54:36,920::task::990::TaskManager.Task::(_decref) Task=`2bd4647c-b209-44ba-aa18-25217ea6099b`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:54:52,231::task::595::TaskManager.Task::(_updateState) Task=`3cdec47b-a893-4a72-8d23-6d1cadc9d030`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:54:52,232::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:54:52,232::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:54:52,232::task::1185::TaskManager.Task::(prepare) Task=`3cdec47b-a893-4a72-8d23-6d1cadc9d030`::finished: {} >Thread-13::DEBUG::2014-07-24 09:54:52,232::task::595::TaskManager.Task::(_updateState) Task=`3cdec47b-a893-4a72-8d23-6d1cadc9d030`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:54:52,232::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:54:52,232::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:54:52,233::task::990::TaskManager.Task::(_decref) Task=`3cdec47b-a893-4a72-8d23-6d1cadc9d030`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:55:07,581::task::595::TaskManager.Task::(_updateState) Task=`657054bf-1eba-4662-9fc3-b4ba45aa7396`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:55:07,582::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:55:07,582::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:55:07,582::task::1185::TaskManager.Task::(prepare) Task=`657054bf-1eba-4662-9fc3-b4ba45aa7396`::finished: {} >Thread-13::DEBUG::2014-07-24 09:55:07,582::task::595::TaskManager.Task::(_updateState) Task=`657054bf-1eba-4662-9fc3-b4ba45aa7396`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:55:07,582::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:55:07,583::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:55:07,583::task::990::TaskManager.Task::(_decref) Task=`657054bf-1eba-4662-9fc3-b4ba45aa7396`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:55:22,902::task::595::TaskManager.Task::(_updateState) Task=`6ab09ae8-2a37-4f15-bc10-9c9dd16958b1`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:55:22,903::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:55:22,903::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:55:22,903::task::1185::TaskManager.Task::(prepare) Task=`6ab09ae8-2a37-4f15-bc10-9c9dd16958b1`::finished: {} >Thread-13::DEBUG::2014-07-24 09:55:22,903::task::595::TaskManager.Task::(_updateState) Task=`6ab09ae8-2a37-4f15-bc10-9c9dd16958b1`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:55:22,903::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:55:22,903::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:55:22,903::task::990::TaskManager.Task::(_decref) Task=`6ab09ae8-2a37-4f15-bc10-9c9dd16958b1`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:55:38,540::task::595::TaskManager.Task::(_updateState) Task=`efcb20fc-d51f-41bb-9eb1-8adaf7027e8d`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:55:38,540::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:55:38,540::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:55:38,540::task::1185::TaskManager.Task::(prepare) Task=`efcb20fc-d51f-41bb-9eb1-8adaf7027e8d`::finished: {} >Thread-13::DEBUG::2014-07-24 09:55:38,540::task::595::TaskManager.Task::(_updateState) Task=`efcb20fc-d51f-41bb-9eb1-8adaf7027e8d`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:55:38,541::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:55:38,541::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:55:38,541::task::990::TaskManager.Task::(_decref) Task=`efcb20fc-d51f-41bb-9eb1-8adaf7027e8d`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:55:53,896::task::595::TaskManager.Task::(_updateState) Task=`6205eab8-b7e1-4880-b69a-dae4727be8f2`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:55:53,897::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:55:53,897::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:55:53,897::task::1185::TaskManager.Task::(prepare) Task=`6205eab8-b7e1-4880-b69a-dae4727be8f2`::finished: {} >Thread-13::DEBUG::2014-07-24 09:55:53,897::task::595::TaskManager.Task::(_updateState) Task=`6205eab8-b7e1-4880-b69a-dae4727be8f2`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:55:53,897::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:55:53,897::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:55:53,897::task::990::TaskManager.Task::(_decref) Task=`6205eab8-b7e1-4880-b69a-dae4727be8f2`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:56:09,200::task::595::TaskManager.Task::(_updateState) Task=`829c9f7b-7ec8-4851-bf33-031ad00e3446`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:56:09,200::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:56:09,200::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:56:09,200::task::1185::TaskManager.Task::(prepare) Task=`829c9f7b-7ec8-4851-bf33-031ad00e3446`::finished: {} >Thread-13::DEBUG::2014-07-24 09:56:09,201::task::595::TaskManager.Task::(_updateState) Task=`829c9f7b-7ec8-4851-bf33-031ad00e3446`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:56:09,201::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:56:09,201::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:56:09,201::task::990::TaskManager.Task::(_decref) Task=`829c9f7b-7ec8-4851-bf33-031ad00e3446`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:56:24,516::task::595::TaskManager.Task::(_updateState) Task=`39f72f18-2faa-4a2e-a52d-814a08c9d35d`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:56:24,516::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:56:24,517::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:56:24,517::task::1185::TaskManager.Task::(prepare) Task=`39f72f18-2faa-4a2e-a52d-814a08c9d35d`::finished: {} >Thread-13::DEBUG::2014-07-24 09:56:24,517::task::595::TaskManager.Task::(_updateState) Task=`39f72f18-2faa-4a2e-a52d-814a08c9d35d`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:56:24,517::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:56:24,517::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:56:24,517::task::990::TaskManager.Task::(_decref) Task=`39f72f18-2faa-4a2e-a52d-814a08c9d35d`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:56:40,079::task::595::TaskManager.Task::(_updateState) Task=`30f7fe2b-4c25-4c14-8f32-924c551022fe`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:56:40,079::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:56:40,080::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:56:40,080::task::1185::TaskManager.Task::(prepare) Task=`30f7fe2b-4c25-4c14-8f32-924c551022fe`::finished: {} >Thread-13::DEBUG::2014-07-24 09:56:40,080::task::595::TaskManager.Task::(_updateState) Task=`30f7fe2b-4c25-4c14-8f32-924c551022fe`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:56:40,080::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:56:40,080::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:56:40,080::task::990::TaskManager.Task::(_decref) Task=`30f7fe2b-4c25-4c14-8f32-924c551022fe`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:56:55,552::task::595::TaskManager.Task::(_updateState) Task=`13d4b758-922c-4fee-9e7d-13774a8f1ee1`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:56:55,553::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:56:55,553::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:56:55,553::task::1185::TaskManager.Task::(prepare) Task=`13d4b758-922c-4fee-9e7d-13774a8f1ee1`::finished: {} >Thread-13::DEBUG::2014-07-24 09:56:55,553::task::595::TaskManager.Task::(_updateState) Task=`13d4b758-922c-4fee-9e7d-13774a8f1ee1`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:56:55,553::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:56:55,554::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:56:55,554::task::990::TaskManager.Task::(_decref) Task=`13d4b758-922c-4fee-9e7d-13774a8f1ee1`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:57:11,024::task::595::TaskManager.Task::(_updateState) Task=`2f42d9ab-a4c5-4fb3-bce8-e3c2f139a565`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:57:11,024::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:57:11,024::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:57:11,025::task::1185::TaskManager.Task::(prepare) Task=`2f42d9ab-a4c5-4fb3-bce8-e3c2f139a565`::finished: {} >Thread-13::DEBUG::2014-07-24 09:57:11,025::task::595::TaskManager.Task::(_updateState) Task=`2f42d9ab-a4c5-4fb3-bce8-e3c2f139a565`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:57:11,025::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:57:11,025::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:57:11,025::task::990::TaskManager.Task::(_decref) Task=`2f42d9ab-a4c5-4fb3-bce8-e3c2f139a565`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:57:26,458::task::595::TaskManager.Task::(_updateState) Task=`63301304-146b-4ac7-b104-7b73158e11b3`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:57:26,458::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:57:26,458::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:57:26,458::task::1185::TaskManager.Task::(prepare) Task=`63301304-146b-4ac7-b104-7b73158e11b3`::finished: {} >Thread-13::DEBUG::2014-07-24 09:57:26,459::task::595::TaskManager.Task::(_updateState) Task=`63301304-146b-4ac7-b104-7b73158e11b3`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:57:26,459::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:57:26,459::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:57:26,459::task::990::TaskManager.Task::(_decref) Task=`63301304-146b-4ac7-b104-7b73158e11b3`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:57:41,929::task::595::TaskManager.Task::(_updateState) Task=`1e37c34f-77f9-4c31-a7cd-fe05c82151f5`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:57:41,930::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:57:41,930::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:57:41,930::task::1185::TaskManager.Task::(prepare) Task=`1e37c34f-77f9-4c31-a7cd-fe05c82151f5`::finished: {} >Thread-13::DEBUG::2014-07-24 09:57:41,930::task::595::TaskManager.Task::(_updateState) Task=`1e37c34f-77f9-4c31-a7cd-fe05c82151f5`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:57:41,930::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:57:41,930::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:57:41,931::task::990::TaskManager.Task::(_decref) Task=`1e37c34f-77f9-4c31-a7cd-fe05c82151f5`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:57:57,433::task::595::TaskManager.Task::(_updateState) Task=`94b234cc-fb98-463f-af52-01cb2925d1c7`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:57:57,433::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:57:57,433::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:57:57,433::task::1185::TaskManager.Task::(prepare) Task=`94b234cc-fb98-463f-af52-01cb2925d1c7`::finished: {} >Thread-13::DEBUG::2014-07-24 09:57:57,434::task::595::TaskManager.Task::(_updateState) Task=`94b234cc-fb98-463f-af52-01cb2925d1c7`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:57:57,434::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:57:57,434::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:57:57,434::task::990::TaskManager.Task::(_decref) Task=`94b234cc-fb98-463f-af52-01cb2925d1c7`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:58:12,752::task::595::TaskManager.Task::(_updateState) Task=`fab08b7a-290c-4c01-93e9-57dcca3668d3`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:58:12,752::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:58:12,752::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:58:12,752::task::1185::TaskManager.Task::(prepare) Task=`fab08b7a-290c-4c01-93e9-57dcca3668d3`::finished: {} >Thread-13::DEBUG::2014-07-24 09:58:12,752::task::595::TaskManager.Task::(_updateState) Task=`fab08b7a-290c-4c01-93e9-57dcca3668d3`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:58:12,753::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:58:12,753::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:58:12,753::task::990::TaskManager.Task::(_decref) Task=`fab08b7a-290c-4c01-93e9-57dcca3668d3`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:58:28,108::task::595::TaskManager.Task::(_updateState) Task=`7ce710a1-831f-4aec-88b3-68d872eb08bb`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:58:28,114::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:58:28,115::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:58:28,115::task::1185::TaskManager.Task::(prepare) Task=`7ce710a1-831f-4aec-88b3-68d872eb08bb`::finished: {} >Thread-13::DEBUG::2014-07-24 09:58:28,115::task::595::TaskManager.Task::(_updateState) Task=`7ce710a1-831f-4aec-88b3-68d872eb08bb`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:58:28,115::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:58:28,115::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:58:28,115::task::990::TaskManager.Task::(_decref) Task=`7ce710a1-831f-4aec-88b3-68d872eb08bb`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:58:43,479::task::595::TaskManager.Task::(_updateState) Task=`9b7c44ad-5333-47f0-ba3a-f08ebd18205e`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:58:43,479::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:58:43,479::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:58:43,480::task::1185::TaskManager.Task::(prepare) Task=`9b7c44ad-5333-47f0-ba3a-f08ebd18205e`::finished: {} >Thread-13::DEBUG::2014-07-24 09:58:43,480::task::595::TaskManager.Task::(_updateState) Task=`9b7c44ad-5333-47f0-ba3a-f08ebd18205e`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:58:43,480::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:58:43,480::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:58:43,480::task::990::TaskManager.Task::(_decref) Task=`9b7c44ad-5333-47f0-ba3a-f08ebd18205e`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:58:58,800::task::595::TaskManager.Task::(_updateState) Task=`49defd0f-4f4d-41dc-b41a-8d36e49be269`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:58:58,801::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:58:58,801::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:58:58,801::task::1185::TaskManager.Task::(prepare) Task=`49defd0f-4f4d-41dc-b41a-8d36e49be269`::finished: {} >Thread-13::DEBUG::2014-07-24 09:58:58,801::task::595::TaskManager.Task::(_updateState) Task=`49defd0f-4f4d-41dc-b41a-8d36e49be269`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:58:58,801::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:58:58,801::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:58:58,801::task::990::TaskManager.Task::(_decref) Task=`49defd0f-4f4d-41dc-b41a-8d36e49be269`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:59:14,108::task::595::TaskManager.Task::(_updateState) Task=`53103629-f3bf-444d-b20e-7143add4545b`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:59:14,109::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:59:14,109::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:59:14,109::task::1185::TaskManager.Task::(prepare) Task=`53103629-f3bf-444d-b20e-7143add4545b`::finished: {} >Thread-13::DEBUG::2014-07-24 09:59:14,109::task::595::TaskManager.Task::(_updateState) Task=`53103629-f3bf-444d-b20e-7143add4545b`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:59:14,109::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:59:14,109::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:59:14,110::task::990::TaskManager.Task::(_decref) Task=`53103629-f3bf-444d-b20e-7143add4545b`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:59:29,417::task::595::TaskManager.Task::(_updateState) Task=`c4f6bc97-1f2e-45f2-9706-9c0f6cd615af`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:59:29,417::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:59:29,417::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:59:29,417::task::1185::TaskManager.Task::(prepare) Task=`c4f6bc97-1f2e-45f2-9706-9c0f6cd615af`::finished: {} >Thread-13::DEBUG::2014-07-24 09:59:29,418::task::595::TaskManager.Task::(_updateState) Task=`c4f6bc97-1f2e-45f2-9706-9c0f6cd615af`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:59:29,418::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:59:29,418::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:59:29,418::task::990::TaskManager.Task::(_decref) Task=`c4f6bc97-1f2e-45f2-9706-9c0f6cd615af`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 09:59:44,741::task::595::TaskManager.Task::(_updateState) Task=`f967f9aa-fd3f-4fd8-a303-4e14161d0d0a`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 09:59:44,741::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 09:59:44,742::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 09:59:44,742::task::1185::TaskManager.Task::(prepare) Task=`f967f9aa-fd3f-4fd8-a303-4e14161d0d0a`::finished: {} >Thread-13::DEBUG::2014-07-24 09:59:44,742::task::595::TaskManager.Task::(_updateState) Task=`f967f9aa-fd3f-4fd8-a303-4e14161d0d0a`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 09:59:44,742::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 09:59:44,742::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 09:59:44,742::task::990::TaskManager.Task::(_decref) Task=`f967f9aa-fd3f-4fd8-a303-4e14161d0d0a`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:00:00,077::task::595::TaskManager.Task::(_updateState) Task=`02f73203-7229-4248-899b-208132ea5f59`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:00:00,077::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:00:00,077::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:00:00,077::task::1185::TaskManager.Task::(prepare) Task=`02f73203-7229-4248-899b-208132ea5f59`::finished: {} >Thread-13::DEBUG::2014-07-24 10:00:00,077::task::595::TaskManager.Task::(_updateState) Task=`02f73203-7229-4248-899b-208132ea5f59`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:00:00,077::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:00:00,078::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:00:00,078::task::990::TaskManager.Task::(_decref) Task=`02f73203-7229-4248-899b-208132ea5f59`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:00:15,396::task::595::TaskManager.Task::(_updateState) Task=`8b077c05-9c23-49eb-a3fa-bba871539b8f`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:00:15,396::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:00:15,396::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:00:15,397::task::1185::TaskManager.Task::(prepare) Task=`8b077c05-9c23-49eb-a3fa-bba871539b8f`::finished: {} >Thread-13::DEBUG::2014-07-24 10:00:15,397::task::595::TaskManager.Task::(_updateState) Task=`8b077c05-9c23-49eb-a3fa-bba871539b8f`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:00:15,397::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:00:15,397::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:00:15,397::task::990::TaskManager.Task::(_decref) Task=`8b077c05-9c23-49eb-a3fa-bba871539b8f`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:00:30,997::task::595::TaskManager.Task::(_updateState) Task=`2e685a5a-60c0-4647-b0a0-a887d53571ca`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:00:30,997::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:00:30,997::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:00:30,997::task::1185::TaskManager.Task::(prepare) Task=`2e685a5a-60c0-4647-b0a0-a887d53571ca`::finished: {} >Thread-13::DEBUG::2014-07-24 10:00:30,997::task::595::TaskManager.Task::(_updateState) Task=`2e685a5a-60c0-4647-b0a0-a887d53571ca`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:00:30,998::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:00:30,998::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:00:30,998::task::990::TaskManager.Task::(_decref) Task=`2e685a5a-60c0-4647-b0a0-a887d53571ca`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:00:46,312::task::595::TaskManager.Task::(_updateState) Task=`6caf797f-8cbf-4a3a-a613-0170da1c24e8`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:00:46,313::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:00:46,313::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:00:46,313::task::1185::TaskManager.Task::(prepare) Task=`6caf797f-8cbf-4a3a-a613-0170da1c24e8`::finished: {} >Thread-13::DEBUG::2014-07-24 10:00:46,313::task::595::TaskManager.Task::(_updateState) Task=`6caf797f-8cbf-4a3a-a613-0170da1c24e8`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:00:46,314::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:00:46,314::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:00:46,314::task::990::TaskManager.Task::(_decref) Task=`6caf797f-8cbf-4a3a-a613-0170da1c24e8`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:01:01,624::task::595::TaskManager.Task::(_updateState) Task=`b2c10e15-d249-472f-a2a8-8092eb917d52`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:01:01,624::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:01:01,624::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:01:01,625::task::1185::TaskManager.Task::(prepare) Task=`b2c10e15-d249-472f-a2a8-8092eb917d52`::finished: {} >Thread-13::DEBUG::2014-07-24 10:01:01,625::task::595::TaskManager.Task::(_updateState) Task=`b2c10e15-d249-472f-a2a8-8092eb917d52`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:01:01,625::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:01:01,625::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:01:01,625::task::990::TaskManager.Task::(_decref) Task=`b2c10e15-d249-472f-a2a8-8092eb917d52`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:01:16,936::task::595::TaskManager.Task::(_updateState) Task=`e50c6aaa-e5b4-40ce-964c-32cb5781b8cd`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:01:16,937::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:01:16,937::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:01:16,937::task::1185::TaskManager.Task::(prepare) Task=`e50c6aaa-e5b4-40ce-964c-32cb5781b8cd`::finished: {} >Thread-13::DEBUG::2014-07-24 10:01:16,937::task::595::TaskManager.Task::(_updateState) Task=`e50c6aaa-e5b4-40ce-964c-32cb5781b8cd`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:01:16,937::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:01:16,937::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:01:16,937::task::990::TaskManager.Task::(_decref) Task=`e50c6aaa-e5b4-40ce-964c-32cb5781b8cd`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:01:32,356::task::595::TaskManager.Task::(_updateState) Task=`2822c9b0-2804-4015-b2cc-00cf636ec30b`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:01:32,356::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:01:32,357::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:01:32,357::task::1185::TaskManager.Task::(prepare) Task=`2822c9b0-2804-4015-b2cc-00cf636ec30b`::finished: {} >Thread-13::DEBUG::2014-07-24 10:01:32,357::task::595::TaskManager.Task::(_updateState) Task=`2822c9b0-2804-4015-b2cc-00cf636ec30b`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:01:32,357::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:01:32,357::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:01:32,357::task::990::TaskManager.Task::(_decref) Task=`2822c9b0-2804-4015-b2cc-00cf636ec30b`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:01:47,865::task::595::TaskManager.Task::(_updateState) Task=`70dc3082-f63f-4144-b291-41e2b38f5496`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:01:47,865::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:01:47,866::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:01:47,866::task::1185::TaskManager.Task::(prepare) Task=`70dc3082-f63f-4144-b291-41e2b38f5496`::finished: {} >Thread-13::DEBUG::2014-07-24 10:01:47,866::task::595::TaskManager.Task::(_updateState) Task=`70dc3082-f63f-4144-b291-41e2b38f5496`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:01:47,866::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:01:47,866::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:01:47,866::task::990::TaskManager.Task::(_decref) Task=`70dc3082-f63f-4144-b291-41e2b38f5496`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:02:03,256::task::595::TaskManager.Task::(_updateState) Task=`19d1e0ee-ddfe-4ba8-a3a5-3cd931bad9a9`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:02:03,256::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:02:03,256::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:02:03,256::task::1185::TaskManager.Task::(prepare) Task=`19d1e0ee-ddfe-4ba8-a3a5-3cd931bad9a9`::finished: {} >Thread-13::DEBUG::2014-07-24 10:02:03,257::task::595::TaskManager.Task::(_updateState) Task=`19d1e0ee-ddfe-4ba8-a3a5-3cd931bad9a9`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:02:03,257::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:02:03,257::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:02:03,257::task::990::TaskManager.Task::(_decref) Task=`19d1e0ee-ddfe-4ba8-a3a5-3cd931bad9a9`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:02:18,658::task::595::TaskManager.Task::(_updateState) Task=`9f20d31a-823e-4d54-8558-012c6e436c2d`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:02:18,659::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:02:18,659::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:02:18,659::task::1185::TaskManager.Task::(prepare) Task=`9f20d31a-823e-4d54-8558-012c6e436c2d`::finished: {} >Thread-13::DEBUG::2014-07-24 10:02:18,659::task::595::TaskManager.Task::(_updateState) Task=`9f20d31a-823e-4d54-8558-012c6e436c2d`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:02:18,659::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:02:18,659::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:02:18,660::task::990::TaskManager.Task::(_decref) Task=`9f20d31a-823e-4d54-8558-012c6e436c2d`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:02:33,957::task::595::TaskManager.Task::(_updateState) Task=`fea74f67-876f-4351-bbee-d559eb0753b9`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:02:33,957::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:02:33,957::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:02:33,957::task::1185::TaskManager.Task::(prepare) Task=`fea74f67-876f-4351-bbee-d559eb0753b9`::finished: {} >Thread-13::DEBUG::2014-07-24 10:02:33,957::task::595::TaskManager.Task::(_updateState) Task=`fea74f67-876f-4351-bbee-d559eb0753b9`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:02:33,957::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:02:33,958::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:02:33,958::task::990::TaskManager.Task::(_decref) Task=`fea74f67-876f-4351-bbee-d559eb0753b9`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:02:40,816::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:02:40,817::task::595::TaskManager.Task::(_updateState) Task=`8bb73425-1d25-4b81-81d7-75493d0a50c2`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:02:40,817::logUtils::44::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=3, options={}) >Thread-13::DEBUG::2014-07-24 10:02:40,817::misc::738::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-13::DEBUG::2014-07-24 10:02:40,817::misc::740::SamplingMethod::(__call__) Got in to sampling method >Thread-13::DEBUG::2014-07-24 10:02:40,818::misc::738::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-13::DEBUG::2014-07-24 10:02:40,818::misc::740::SamplingMethod::(__call__) Got in to sampling method >Thread-13::DEBUG::2014-07-24 10:02:40,818::iscsi::407::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-13::DEBUG::2014-07-24 10:02:40,818::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-13::DEBUG::2014-07-24 10:02:40,861::misc::748::SamplingMethod::(__call__) Returning last result >Thread-13::DEBUG::2014-07-24 10:02:40,862::multipath::109::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-13::DEBUG::2014-07-24 10:02:40,952::multipath::109::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:02:40,953::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:02:40,953::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:02:40,953::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:02:40,954::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:02:40,954::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:02:40,954::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:02:40,954::misc::748::SamplingMethod::(__call__) Returning last result >Thread-13::DEBUG::2014-07-24 10:02:40,955::lvm::325::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:02:40,956::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-13::DEBUG::2014-07-24 10:02:41,137::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:02:41,137::lvm::350::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:02:41,175::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --test --metadatasize 128m --metadatacopies 2 --metadataignore y' (cwd None) >Thread-13::DEBUG::2014-07-24 10:02:41,301::lvm::296::Storage.Misc.excCmd::(cmd) FAILED: <err> = " TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.\n Please enter a physical volume path\n Run `pvcreate --help' for more information.\n"; <rc> = 3 >Thread-13::DEBUG::2014-07-24 10:02:41,302::lvm::860::Storage.LVM::(testPVCreate) rc: 3, out: [], err: [' TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.', ' Please enter a physical volume path', " Run `pvcreate --help' for more information."], unusedDevs: set([]), usedDevs: set([]) >Thread-13::INFO::2014-07-24 10:02:41,302::logUtils::47::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList': []} >Thread-13::DEBUG::2014-07-24 10:02:41,303::task::1185::TaskManager.Task::(prepare) Task=`8bb73425-1d25-4b81-81d7-75493d0a50c2`::finished: {'devList': []} >Thread-13::DEBUG::2014-07-24 10:02:41,303::task::595::TaskManager.Task::(_updateState) Task=`8bb73425-1d25-4b81-81d7-75493d0a50c2`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:02:41,303::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:02:41,303::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:02:41,303::task::990::TaskManager.Task::(_decref) Task=`8bb73425-1d25-4b81-81d7-75493d0a50c2`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:02:47,282::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:02:47,282::task::595::TaskManager.Task::(_updateState) Task=`664e88c0-0d96-4676-9ace-eb328abef4c1`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:02:47,283::logUtils::44::dispatcher::(wrapper) Run and protect: discoverSendTargets(con={'connection': '10.35.160.108', 'password': '******', 'port': '3260', 'user': ''}, options=None) >Thread-13::DEBUG::2014-07-24 10:02:47,283::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.108:3260 --op=new' (cwd None) >Thread-13::DEBUG::2014-07-24 10:02:47,299::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:02:47,300::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.108:3260 --discover' (cwd None) >Thread-14::DEBUG::2014-07-24 10:02:49,264::task::595::TaskManager.Task::(_updateState) Task=`c462ec38-8815-4297-a061-3b82589c8252`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:02:49,265::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:02:49,265::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-14::DEBUG::2014-07-24 10:02:49,265::task::1185::TaskManager.Task::(prepare) Task=`c462ec38-8815-4297-a061-3b82589c8252`::finished: {} >Thread-14::DEBUG::2014-07-24 10:02:49,265::task::595::TaskManager.Task::(_updateState) Task=`c462ec38-8815-4297-a061-3b82589c8252`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:02:49,265::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:02:49,265::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:02:49,266::task::990::TaskManager.Task::(_decref) Task=`c462ec38-8815-4297-a061-3b82589c8252`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:02:52,325::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = 'iscsiadm: cannot make connection to 10.35.160.108: Connection refused\niscsiadm: cannot make connection to 10.35.160.108: Connection refused\niscsiadm: cannot make connection to 10.35.160.108: Connection refused\niscsiadm: cannot make connection to 10.35.160.108: Connection refused\niscsiadm: cannot make connection to 10.35.160.108: Connection refused\niscsiadm: cannot make connection to 10.35.160.108: Connection refused\niscsiadm: connection login retries (reopen_max) 5 exceeded\niscsiadm: No portals found\n'; <rc> = 21 >Thread-13::DEBUG::2014-07-24 10:02:52,326::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m iface' (cwd None) >Thread-13::DEBUG::2014-07-24 10:02:52,347::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:02:52,348::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.108:3260 --op=delete' (cwd None) >Thread-13::DEBUG::2014-07-24 10:02:52,361::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::ERROR::2014-07-24 10:02:52,361::hsm::2989::Storage.HSM::(discoverSendTargets) Discovery failed >Traceback (most recent call last): > File "/usr/share/vdsm/storage/hsm.py", line 2987, in discoverSendTargets > targets = iscsi.discoverSendTargets(iface, portal, cred) > File "/usr/share/vdsm/storage/iscsi.py", line 229, in discoverSendTargets > portalStr) > File "/usr/share/vdsm/storage/iscsiadm.py", line 216, in discoverydb_discover > raise IscsiDiscoverdbError(rc, out, err) >IscsiDiscoverdbError: (21, [], ['iscsiadm: cannot make connection to 10.35.160.108: Connection refused', 'iscsiadm: cannot make connection to 10.35.160.108: Connection refused', 'iscsiadm: cannot make connection to 10.35.160.108: Connection refused', 'iscsiadm: cannot make connection to 10.35.160.108: Connection refused', 'iscsiadm: cannot make connection to 10.35.160.108: Connection refused', 'iscsiadm: cannot make connection to 10.35.160.108: Connection refused', 'iscsiadm: connection login retries (reopen_max) 5 exceeded', 'iscsiadm: No portals found']) >Thread-13::ERROR::2014-07-24 10:02:52,363::task::866::TaskManager.Task::(_setError) Task=`664e88c0-0d96-4676-9ace-eb328abef4c1`::Unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/storage/task.py", line 873, in _run > return fn(*args, **kargs) > File "/usr/share/vdsm/logUtils.py", line 45, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/storage/hsm.py", line 2990, in discoverSendTargets > raise se.iSCSIDiscoveryError(portal, e) >iSCSIDiscoveryError: Failed discovery of iSCSI targets: "portal=IscsiPortal(hostname='10.35.160.108', port=3260), err=(21, [], ['iscsiadm: cannot make connection to 10.35.160.108: Connection refused', 'iscsiadm: cannot make connection to 10.35.160.108: Connection refused', 'iscsiadm: cannot make connection to 10.35.160.108: Connection refused', 'iscsiadm: cannot make connection to 10.35.160.108: Connection refused', 'iscsiadm: cannot make connection to 10.35.160.108: Connection refused', 'iscsiadm: cannot make connection to 10.35.160.108: Connection refused', 'iscsiadm: connection login retries (reopen_max) 5 exceeded', 'iscsiadm: No portals found'])" >Thread-13::DEBUG::2014-07-24 10:02:52,370::task::885::TaskManager.Task::(_run) Task=`664e88c0-0d96-4676-9ace-eb328abef4c1`::Task._run: 664e88c0-0d96-4676-9ace-eb328abef4c1 ({'connection': '10.35.160.108', 'password': '', 'port': '3260', 'user': ''},) {} failed - stopping task >Thread-13::DEBUG::2014-07-24 10:02:52,371::task::1211::TaskManager.Task::(stop) Task=`664e88c0-0d96-4676-9ace-eb328abef4c1`::stopping in state preparing (force False) >Thread-13::DEBUG::2014-07-24 10:02:52,371::task::990::TaskManager.Task::(_decref) Task=`664e88c0-0d96-4676-9ace-eb328abef4c1`::ref 1 aborting True >Thread-13::INFO::2014-07-24 10:02:52,371::task::1168::TaskManager.Task::(prepare) Task=`664e88c0-0d96-4676-9ace-eb328abef4c1`::aborting: Task is aborted: 'Failed discovery of iSCSI targets' - code 475 >Thread-13::DEBUG::2014-07-24 10:02:52,371::task::1173::TaskManager.Task::(prepare) Task=`664e88c0-0d96-4676-9ace-eb328abef4c1`::Prepare: aborted: Failed discovery of iSCSI targets >Thread-13::DEBUG::2014-07-24 10:02:52,371::task::990::TaskManager.Task::(_decref) Task=`664e88c0-0d96-4676-9ace-eb328abef4c1`::ref 0 aborting True >Thread-13::DEBUG::2014-07-24 10:02:52,372::task::925::TaskManager.Task::(_doAbort) Task=`664e88c0-0d96-4676-9ace-eb328abef4c1`::Task._doAbort: force False >Thread-13::DEBUG::2014-07-24 10:02:52,372::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:02:52,372::task::595::TaskManager.Task::(_updateState) Task=`664e88c0-0d96-4676-9ace-eb328abef4c1`::moving from state preparing -> state aborting >Thread-13::DEBUG::2014-07-24 10:02:52,372::task::550::TaskManager.Task::(__state_aborting) Task=`664e88c0-0d96-4676-9ace-eb328abef4c1`::_aborting: recover policy none >Thread-13::DEBUG::2014-07-24 10:02:52,372::task::595::TaskManager.Task::(_updateState) Task=`664e88c0-0d96-4676-9ace-eb328abef4c1`::moving from state aborting -> state failed >Thread-13::DEBUG::2014-07-24 10:02:52,372::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:02:52,373::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::ERROR::2014-07-24 10:02:52,373::dispatcher::65::Storage.Dispatcher.Protect::(run) {'status': {'message': 'Failed discovery of iSCSI targets: "portal=IscsiPortal(hostname=\'10.35.160.108\', port=3260), err=(21, [], [\'iscsiadm: cannot make connection to 10.35.160.108: Connection refused\', \'iscsiadm: cannot make connection to 10.35.160.108: Connection refused\', \'iscsiadm: cannot make connection to 10.35.160.108: Connection refused\', \'iscsiadm: cannot make connection to 10.35.160.108: Connection refused\', \'iscsiadm: cannot make connection to 10.35.160.108: Connection refused\', \'iscsiadm: cannot make connection to 10.35.160.108: Connection refused\', \'iscsiadm: connection login retries (reopen_max) 5 exceeded\', \'iscsiadm: No portals found\'])"', 'code': 475}} >Thread-13::DEBUG::2014-07-24 10:03:04,653::task::595::TaskManager.Task::(_updateState) Task=`a548dd81-256a-49a3-891d-24891fd0aa67`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:03:04,653::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:03:04,653::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:03:04,653::task::1185::TaskManager.Task::(prepare) Task=`a548dd81-256a-49a3-891d-24891fd0aa67`::finished: {} >Thread-13::DEBUG::2014-07-24 10:03:04,654::task::595::TaskManager.Task::(_updateState) Task=`a548dd81-256a-49a3-891d-24891fd0aa67`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:03:04,654::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:03:04,654::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:03:04,654::task::990::TaskManager.Task::(_decref) Task=`a548dd81-256a-49a3-891d-24891fd0aa67`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:03:07,679::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:03:07,681::task::595::TaskManager.Task::(_updateState) Task=`8552f2e6-028e-45f0-b4c3-a76c3eca89b3`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:03:07,683::logUtils::44::dispatcher::(wrapper) Run and protect: discoverSendTargets(con={'connection': '10.35.160.104', 'password': '******', 'port': '3260', 'user': ''}, options=None) >Thread-13::DEBUG::2014-07-24 10:03:07,686::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.104:3260 --op=new' (cwd None) >Thread-13::DEBUG::2014-07-24 10:03:07,705::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:03:07,708::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.104:3260 --discover' (cwd None) >Thread-13::DEBUG::2014-07-24 10:03:07,735::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:03:07,736::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.160.104:3260 --op=delete' (cwd None) >Thread-13::DEBUG::2014-07-24 10:03:07,756::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::INFO::2014-07-24 10:03:07,756::logUtils::47::dispatcher::(wrapper) Run and protect: discoverSendTargets, Return response: {'fullTargets': ['10.35.160.104:3260,1 iqn.1992-04.com.emc:cx.ckm00121000438.a6', '10.35.160.105:3260,2 iqn.1992-04.com.emc:cx.ckm00121000438.a7', '10.35.160.106:3260,3 iqn.1992-04.com.emc:cx.ckm00121000438.b6', '10.35.160.107:3260,4 iqn.1992-04.com.emc:cx.ckm00121000438.b7'], 'targets': ['iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'iqn.1992-04.com.emc:cx.ckm00121000438.b7']} >Thread-13::DEBUG::2014-07-24 10:03:07,756::task::1185::TaskManager.Task::(prepare) Task=`8552f2e6-028e-45f0-b4c3-a76c3eca89b3`::finished: {'fullTargets': ['10.35.160.104:3260,1 iqn.1992-04.com.emc:cx.ckm00121000438.a6', '10.35.160.105:3260,2 iqn.1992-04.com.emc:cx.ckm00121000438.a7', '10.35.160.106:3260,3 iqn.1992-04.com.emc:cx.ckm00121000438.b6', '10.35.160.107:3260,4 iqn.1992-04.com.emc:cx.ckm00121000438.b7'], 'targets': ['iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'iqn.1992-04.com.emc:cx.ckm00121000438.b7']} >Thread-13::DEBUG::2014-07-24 10:03:07,757::task::595::TaskManager.Task::(_updateState) Task=`8552f2e6-028e-45f0-b4c3-a76c3eca89b3`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:03:07,757::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:03:07,757::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:03:07,757::task::990::TaskManager.Task::(_decref) Task=`8552f2e6-028e-45f0-b4c3-a76c3eca89b3`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:03:09,903::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [401b2ce8] >Thread-13::DEBUG::2014-07-24 10:03:09,903::task::595::TaskManager.Task::(_updateState) Task=`574ee682-4c21-490b-b0d7-2b39ddf6a302`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:03:09,903::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'user': '', 'tpgt': '1', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-13::DEBUG::2014-07-24 10:03:09,904::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a6 -I default -p 10.35.160.104:3260,1 --op=new' (cwd None) >Thread-13::DEBUG::2014-07-24 10:03:09,918::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:03:09,918::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a6 -I default -p 10.35.160.104:3260,1 -l' (cwd None) >Thread-13::DEBUG::2014-07-24 10:03:09,933::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:03:09,934::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a6 -I default -p 10.35.160.104:3260,1 -n node.startup -v manual --op=update' (cwd None) >Thread-13::DEBUG::2014-07-24 10:03:09,947::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:03:09,947::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:03:09,948::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >Thread-13::DEBUG::2014-07-24 10:03:10,097::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:03:10,098::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:03:10,098::hsm::2352::Storage.HSM::(__prefetchDomains) Found SD uuids: () >Thread-13::DEBUG::2014-07-24 10:03:10,098::hsm::2408::Storage.HSM::(connectStorageServer) knownSDs: {} >Thread-13::INFO::2014-07-24 10:03:10,098::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-13::DEBUG::2014-07-24 10:03:10,099::task::1185::TaskManager.Task::(prepare) Task=`574ee682-4c21-490b-b0d7-2b39ddf6a302`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-13::DEBUG::2014-07-24 10:03:10,099::task::595::TaskManager.Task::(_updateState) Task=`574ee682-4c21-490b-b0d7-2b39ddf6a302`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:03:10,099::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:03:10,099::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:03:10,099::task::990::TaskManager.Task::(_decref) Task=`574ee682-4c21-490b-b0d7-2b39ddf6a302`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:03:10,383::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [7b224c24] >Thread-13::DEBUG::2014-07-24 10:03:10,383::task::595::TaskManager.Task::(_updateState) Task=`8edc0206-2533-4bd8-8128-79a9c70c8e18`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:03:10,383::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'user': '', 'tpgt': '1', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-13::DEBUG::2014-07-24 10:03:10,384::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a7 -I default -p 10.35.160.105:3260,1 --op=new' (cwd None) >Thread-13::DEBUG::2014-07-24 10:03:10,399::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:03:10,399::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a7 -I default -p 10.35.160.105:3260,1 -l' (cwd None) >Thread-13::DEBUG::2014-07-24 10:03:10,415::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:03:10,415::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a7 -I default -p 10.35.160.105:3260,1 -n node.startup -v manual --op=update' (cwd None) >Thread-13::DEBUG::2014-07-24 10:03:10,428::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:03:10,429::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:03:10,429::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >Thread-13::DEBUG::2014-07-24 10:03:10,555::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:03:10,556::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:03:10,556::hsm::2352::Storage.HSM::(__prefetchDomains) Found SD uuids: () >Thread-13::DEBUG::2014-07-24 10:03:10,556::hsm::2408::Storage.HSM::(connectStorageServer) knownSDs: {} >Thread-13::INFO::2014-07-24 10:03:10,556::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-13::DEBUG::2014-07-24 10:03:10,556::task::1185::TaskManager.Task::(prepare) Task=`8edc0206-2533-4bd8-8128-79a9c70c8e18`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-13::DEBUG::2014-07-24 10:03:10,557::task::595::TaskManager.Task::(_updateState) Task=`8edc0206-2533-4bd8-8128-79a9c70c8e18`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:03:10,557::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:03:10,557::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:03:10,557::task::990::TaskManager.Task::(_decref) Task=`8edc0206-2533-4bd8-8128-79a9c70c8e18`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:03:10,789::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [34810048] >Thread-13::DEBUG::2014-07-24 10:03:10,789::task::595::TaskManager.Task::(_updateState) Task=`5c5e9e7a-cd20-4734-9c9a-cf8146e309cb`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:03:10,789::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'user': '', 'tpgt': '1', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-13::DEBUG::2014-07-24 10:03:10,790::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b6 -I default -p 10.35.160.106:3260,1 --op=new' (cwd None) >Thread-13::DEBUG::2014-07-24 10:03:10,804::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:03:10,804::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b6 -I default -p 10.35.160.106:3260,1 -l' (cwd None) >Thread-13::DEBUG::2014-07-24 10:03:10,820::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:03:10,820::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b6 -I default -p 10.35.160.106:3260,1 -n node.startup -v manual --op=update' (cwd None) >Thread-13::DEBUG::2014-07-24 10:03:10,833::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:03:10,834::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:03:10,834::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >Thread-13::DEBUG::2014-07-24 10:03:10,964::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:03:10,965::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:03:10,965::hsm::2352::Storage.HSM::(__prefetchDomains) Found SD uuids: () >Thread-13::DEBUG::2014-07-24 10:03:10,965::hsm::2408::Storage.HSM::(connectStorageServer) knownSDs: {} >Thread-13::INFO::2014-07-24 10:03:10,965::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-13::DEBUG::2014-07-24 10:03:10,965::task::1185::TaskManager.Task::(prepare) Task=`5c5e9e7a-cd20-4734-9c9a-cf8146e309cb`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-13::DEBUG::2014-07-24 10:03:10,966::task::595::TaskManager.Task::(_updateState) Task=`5c5e9e7a-cd20-4734-9c9a-cf8146e309cb`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:03:10,966::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:03:10,966::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:03:10,966::task::990::TaskManager.Task::(_decref) Task=`5c5e9e7a-cd20-4734-9c9a-cf8146e309cb`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:03:11,185::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [7714dbd6] >Thread-13::DEBUG::2014-07-24 10:03:11,186::task::595::TaskManager.Task::(_updateState) Task=`602aa88a-e6e8-4c49-be66-906ee17053a6`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:03:11,186::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'user': '', 'tpgt': '1', 'password': '******', 'id': '00000000-0000-0000-0000-000000000000', 'port': '3260'}], options=None) >Thread-13::DEBUG::2014-07-24 10:03:11,186::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b7 -I default -p 10.35.160.107:3260,1 --op=new' (cwd None) >Thread-13::DEBUG::2014-07-24 10:03:11,201::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:03:11,201::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b7 -I default -p 10.35.160.107:3260,1 -l' (cwd None) >Thread-13::DEBUG::2014-07-24 10:03:11,217::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:03:11,217::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b7 -I default -p 10.35.160.107:3260,1 -n node.startup -v manual --op=update' (cwd None) >Thread-13::DEBUG::2014-07-24 10:03:11,231::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:03:11,231::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:03:11,232::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >Thread-13::DEBUG::2014-07-24 10:03:11,357::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:03:11,358::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:03:11,358::hsm::2352::Storage.HSM::(__prefetchDomains) Found SD uuids: () >Thread-13::DEBUG::2014-07-24 10:03:11,358::hsm::2408::Storage.HSM::(connectStorageServer) knownSDs: {} >Thread-13::INFO::2014-07-24 10:03:11,358::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-13::DEBUG::2014-07-24 10:03:11,358::task::1185::TaskManager.Task::(prepare) Task=`602aa88a-e6e8-4c49-be66-906ee17053a6`::finished: {'statuslist': [{'status': 0, 'id': '00000000-0000-0000-0000-000000000000'}]} >Thread-13::DEBUG::2014-07-24 10:03:11,358::task::595::TaskManager.Task::(_updateState) Task=`602aa88a-e6e8-4c49-be66-906ee17053a6`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:03:11,359::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:03:11,359::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:03:11,359::task::990::TaskManager.Task::(_decref) Task=`602aa88a-e6e8-4c49-be66-906ee17053a6`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:03:11,455::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:03:11,455::task::595::TaskManager.Task::(_updateState) Task=`3493fe0e-0c03-4b1e-a3dc-fd77e8183b29`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:03:11,455::logUtils::44::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=3, options={}) >Thread-13::DEBUG::2014-07-24 10:03:11,456::misc::738::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-13::DEBUG::2014-07-24 10:03:11,456::misc::740::SamplingMethod::(__call__) Got in to sampling method >Thread-13::DEBUG::2014-07-24 10:03:11,456::misc::738::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-13::DEBUG::2014-07-24 10:03:11,456::misc::740::SamplingMethod::(__call__) Got in to sampling method >Thread-13::DEBUG::2014-07-24 10:03:11,456::iscsi::407::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-13::DEBUG::2014-07-24 10:03:11,456::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-13::DEBUG::2014-07-24 10:03:11,476::misc::748::SamplingMethod::(__call__) Returning last result >Thread-13::DEBUG::2014-07-24 10:03:11,476::multipath::109::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-13::DEBUG::2014-07-24 10:03:11,559::multipath::109::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:03:11,560::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:03:11,560::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:03:11,560::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:03:11,561::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:03:11,561::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:03:11,561::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:03:11,561::misc::748::SamplingMethod::(__call__) Returning last result >Thread-13::DEBUG::2014-07-24 10:03:11,561::lvm::325::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:03:11,563::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-13::DEBUG::2014-07-24 10:03:11,708::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:03:11,708::lvm::350::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:03:11,731::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --test --metadatasize 128m --metadatacopies 2 --metadataignore y' (cwd None) >Thread-13::DEBUG::2014-07-24 10:03:11,858::lvm::296::Storage.Misc.excCmd::(cmd) FAILED: <err> = " TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.\n Please enter a physical volume path\n Run `pvcreate --help' for more information.\n"; <rc> = 3 >Thread-13::DEBUG::2014-07-24 10:03:11,858::lvm::860::Storage.LVM::(testPVCreate) rc: 3, out: [], err: [' TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.', ' Please enter a physical volume path', " Run `pvcreate --help' for more information."], unusedDevs: set([]), usedDevs: set([]) >Thread-13::INFO::2014-07-24 10:03:11,859::logUtils::47::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList': []} >Thread-13::DEBUG::2014-07-24 10:03:11,859::task::1185::TaskManager.Task::(prepare) Task=`3493fe0e-0c03-4b1e-a3dc-fd77e8183b29`::finished: {'devList': []} >Thread-13::DEBUG::2014-07-24 10:03:11,859::task::595::TaskManager.Task::(_updateState) Task=`3493fe0e-0c03-4b1e-a3dc-fd77e8183b29`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:03:11,859::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:03:11,859::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:03:11,860::task::990::TaskManager.Task::(_decref) Task=`3493fe0e-0c03-4b1e-a3dc-fd77e8183b29`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:03:19,956::task::595::TaskManager.Task::(_updateState) Task=`d6c130a8-f954-4487-9df2-20be89408d68`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:03:19,956::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:03:19,957::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:03:19,957::task::1185::TaskManager.Task::(prepare) Task=`d6c130a8-f954-4487-9df2-20be89408d68`::finished: {} >Thread-13::DEBUG::2014-07-24 10:03:19,957::task::595::TaskManager.Task::(_updateState) Task=`d6c130a8-f954-4487-9df2-20be89408d68`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:03:19,957::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:03:19,957::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:03:19,957::task::990::TaskManager.Task::(_decref) Task=`d6c130a8-f954-4487-9df2-20be89408d68`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:03:35,287::task::595::TaskManager.Task::(_updateState) Task=`d972c4eb-bb1a-4bb3-910a-dbf467cc4aa2`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:03:35,288::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:03:35,288::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:03:35,288::task::1185::TaskManager.Task::(prepare) Task=`d972c4eb-bb1a-4bb3-910a-dbf467cc4aa2`::finished: {} >Thread-13::DEBUG::2014-07-24 10:03:35,288::task::595::TaskManager.Task::(_updateState) Task=`d972c4eb-bb1a-4bb3-910a-dbf467cc4aa2`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:03:35,289::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:03:35,289::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:03:35,289::task::990::TaskManager.Task::(_decref) Task=`d972c4eb-bb1a-4bb3-910a-dbf467cc4aa2`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:03:50,636::task::595::TaskManager.Task::(_updateState) Task=`939372a2-ae16-43b4-940a-047b60ac2d94`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:03:50,636::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:03:50,636::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:03:50,636::task::1185::TaskManager.Task::(prepare) Task=`939372a2-ae16-43b4-940a-047b60ac2d94`::finished: {} >Thread-13::DEBUG::2014-07-24 10:03:50,637::task::595::TaskManager.Task::(_updateState) Task=`939372a2-ae16-43b4-940a-047b60ac2d94`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:03:50,637::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:03:50,637::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:03:50,637::task::990::TaskManager.Task::(_decref) Task=`939372a2-ae16-43b4-940a-047b60ac2d94`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:04:05,986::task::595::TaskManager.Task::(_updateState) Task=`00d88060-4efd-45a9-be18-2ccc6244372e`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:04:05,986::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:04:05,986::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:04:05,986::task::1185::TaskManager.Task::(prepare) Task=`00d88060-4efd-45a9-be18-2ccc6244372e`::finished: {} >Thread-13::DEBUG::2014-07-24 10:04:05,987::task::595::TaskManager.Task::(_updateState) Task=`00d88060-4efd-45a9-be18-2ccc6244372e`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:04:05,987::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:04:05,987::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:04:05,987::task::990::TaskManager.Task::(_decref) Task=`00d88060-4efd-45a9-be18-2ccc6244372e`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:04:21,282::task::595::TaskManager.Task::(_updateState) Task=`911f2335-bfd9-4528-96c6-e9d837ad3685`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:04:21,282::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:04:21,282::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:04:21,282::task::1185::TaskManager.Task::(prepare) Task=`911f2335-bfd9-4528-96c6-e9d837ad3685`::finished: {} >Thread-13::DEBUG::2014-07-24 10:04:21,282::task::595::TaskManager.Task::(_updateState) Task=`911f2335-bfd9-4528-96c6-e9d837ad3685`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:04:21,283::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:04:21,283::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:04:21,283::task::990::TaskManager.Task::(_decref) Task=`911f2335-bfd9-4528-96c6-e9d837ad3685`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:04:36,579::task::595::TaskManager.Task::(_updateState) Task=`79fce478-7b81-498b-a1f9-2cf27f98af12`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:04:36,579::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:04:36,580::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:04:36,580::task::1185::TaskManager.Task::(prepare) Task=`79fce478-7b81-498b-a1f9-2cf27f98af12`::finished: {} >Thread-13::DEBUG::2014-07-24 10:04:36,580::task::595::TaskManager.Task::(_updateState) Task=`79fce478-7b81-498b-a1f9-2cf27f98af12`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:04:36,580::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:04:36,580::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:04:36,580::task::990::TaskManager.Task::(_decref) Task=`79fce478-7b81-498b-a1f9-2cf27f98af12`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:04:51,876::task::595::TaskManager.Task::(_updateState) Task=`c04d5d09-c0e1-45b0-8e6d-34b740062905`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:04:51,876::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:04:51,877::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:04:51,877::task::1185::TaskManager.Task::(prepare) Task=`c04d5d09-c0e1-45b0-8e6d-34b740062905`::finished: {} >Thread-13::DEBUG::2014-07-24 10:04:51,877::task::595::TaskManager.Task::(_updateState) Task=`c04d5d09-c0e1-45b0-8e6d-34b740062905`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:04:51,877::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:04:51,877::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:04:51,877::task::990::TaskManager.Task::(_decref) Task=`c04d5d09-c0e1-45b0-8e6d-34b740062905`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:05:07,181::task::595::TaskManager.Task::(_updateState) Task=`2576cb6d-70f6-42ac-83cf-e6b0ea407405`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:05:07,182::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:05:07,182::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:05:07,182::task::1185::TaskManager.Task::(prepare) Task=`2576cb6d-70f6-42ac-83cf-e6b0ea407405`::finished: {} >Thread-13::DEBUG::2014-07-24 10:05:07,182::task::595::TaskManager.Task::(_updateState) Task=`2576cb6d-70f6-42ac-83cf-e6b0ea407405`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:05:07,182::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:05:07,182::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:05:07,183::task::990::TaskManager.Task::(_decref) Task=`2576cb6d-70f6-42ac-83cf-e6b0ea407405`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:05:22,511::task::595::TaskManager.Task::(_updateState) Task=`67337a5a-d09b-49cd-ad4e-1fb4028dd00b`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:05:22,512::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:05:22,512::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:05:22,512::task::1185::TaskManager.Task::(prepare) Task=`67337a5a-d09b-49cd-ad4e-1fb4028dd00b`::finished: {} >Thread-13::DEBUG::2014-07-24 10:05:22,512::task::595::TaskManager.Task::(_updateState) Task=`67337a5a-d09b-49cd-ad4e-1fb4028dd00b`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:05:22,512::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:05:22,512::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:05:22,512::task::990::TaskManager.Task::(_decref) Task=`67337a5a-d09b-49cd-ad4e-1fb4028dd00b`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:05:38,146::task::595::TaskManager.Task::(_updateState) Task=`7d8eabe4-2892-4562-b594-0c5279cd3a86`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:05:38,147::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:05:38,147::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:05:38,147::task::1185::TaskManager.Task::(prepare) Task=`7d8eabe4-2892-4562-b594-0c5279cd3a86`::finished: {} >Thread-13::DEBUG::2014-07-24 10:05:38,147::task::595::TaskManager.Task::(_updateState) Task=`7d8eabe4-2892-4562-b594-0c5279cd3a86`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:05:38,147::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:05:38,148::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:05:38,148::task::990::TaskManager.Task::(_decref) Task=`7d8eabe4-2892-4562-b594-0c5279cd3a86`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:05:53,454::task::595::TaskManager.Task::(_updateState) Task=`f0c2cef3-919f-43eb-a5ee-983312b31cc0`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:05:53,455::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:05:53,455::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:05:53,455::task::1185::TaskManager.Task::(prepare) Task=`f0c2cef3-919f-43eb-a5ee-983312b31cc0`::finished: {} >Thread-13::DEBUG::2014-07-24 10:05:53,455::task::595::TaskManager.Task::(_updateState) Task=`f0c2cef3-919f-43eb-a5ee-983312b31cc0`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:05:53,455::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:05:53,456::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:05:53,456::task::990::TaskManager.Task::(_decref) Task=`f0c2cef3-919f-43eb-a5ee-983312b31cc0`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:06:08,767::task::595::TaskManager.Task::(_updateState) Task=`41c4dc5d-1a3e-4c35-92e6-ca2cd203eff6`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:06:08,767::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:06:08,767::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:06:08,767::task::1185::TaskManager.Task::(prepare) Task=`41c4dc5d-1a3e-4c35-92e6-ca2cd203eff6`::finished: {} >Thread-13::DEBUG::2014-07-24 10:06:08,767::task::595::TaskManager.Task::(_updateState) Task=`41c4dc5d-1a3e-4c35-92e6-ca2cd203eff6`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:06:08,768::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:06:08,768::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:06:08,768::task::990::TaskManager.Task::(_decref) Task=`41c4dc5d-1a3e-4c35-92e6-ca2cd203eff6`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:06:24,068::task::595::TaskManager.Task::(_updateState) Task=`99d2f56b-ce5e-4d41-8851-16f4dc92d978`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:06:24,068::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:06:24,068::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:06:24,068::task::1185::TaskManager.Task::(prepare) Task=`99d2f56b-ce5e-4d41-8851-16f4dc92d978`::finished: {} >Thread-13::DEBUG::2014-07-24 10:06:24,069::task::595::TaskManager.Task::(_updateState) Task=`99d2f56b-ce5e-4d41-8851-16f4dc92d978`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:06:24,069::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:06:24,069::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:06:24,069::task::990::TaskManager.Task::(_decref) Task=`99d2f56b-ce5e-4d41-8851-16f4dc92d978`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:06:39,372::task::595::TaskManager.Task::(_updateState) Task=`ba0ccf29-8a62-4ca5-b606-07205efb5d36`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:06:39,372::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:06:39,372::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:06:39,372::task::1185::TaskManager.Task::(prepare) Task=`ba0ccf29-8a62-4ca5-b606-07205efb5d36`::finished: {} >Thread-13::DEBUG::2014-07-24 10:06:39,372::task::595::TaskManager.Task::(_updateState) Task=`ba0ccf29-8a62-4ca5-b606-07205efb5d36`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:06:39,373::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:06:39,373::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:06:39,373::task::990::TaskManager.Task::(_decref) Task=`ba0ccf29-8a62-4ca5-b606-07205efb5d36`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:06:54,718::task::595::TaskManager.Task::(_updateState) Task=`38a9a301-01a0-4048-932b-cb49ff37112f`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:06:54,718::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:06:54,718::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:06:54,719::task::1185::TaskManager.Task::(prepare) Task=`38a9a301-01a0-4048-932b-cb49ff37112f`::finished: {} >Thread-13::DEBUG::2014-07-24 10:06:54,719::task::595::TaskManager.Task::(_updateState) Task=`38a9a301-01a0-4048-932b-cb49ff37112f`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:06:54,719::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:06:54,719::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:06:54,719::task::990::TaskManager.Task::(_decref) Task=`38a9a301-01a0-4048-932b-cb49ff37112f`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:07:10,025::task::595::TaskManager.Task::(_updateState) Task=`fcb7b146-08e6-4dc0-a5dd-9df2d1bd2f52`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:07:10,026::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:07:10,026::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:07:10,026::task::1185::TaskManager.Task::(prepare) Task=`fcb7b146-08e6-4dc0-a5dd-9df2d1bd2f52`::finished: {} >Thread-13::DEBUG::2014-07-24 10:07:10,026::task::595::TaskManager.Task::(_updateState) Task=`fcb7b146-08e6-4dc0-a5dd-9df2d1bd2f52`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:07:10,026::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:07:10,026::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:07:10,027::task::990::TaskManager.Task::(_decref) Task=`fcb7b146-08e6-4dc0-a5dd-9df2d1bd2f52`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:07:14,932::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:07:14,932::task::595::TaskManager.Task::(_updateState) Task=`50e56811-52fc-45a1-a028-2f2b342406dc`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:07:14,933::logUtils::44::dispatcher::(wrapper) Run and protect: discoverSendTargets(con={'connection': '10.35.162.2', 'password': '******', 'port': '3260', 'user': ''}, options=None) >Thread-13::DEBUG::2014-07-24 10:07:14,933::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.162.2:3260 --op=new' (cwd None) >Thread-13::DEBUG::2014-07-24 10:07:14,960::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:07:14,961::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.162.2:3260 --discover' (cwd None) >Thread-14::DEBUG::2014-07-24 10:07:25,339::task::595::TaskManager.Task::(_updateState) Task=`51398a8a-50e2-4908-8956-5f985c5f167d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:07:25,339::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:07:25,340::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-14::DEBUG::2014-07-24 10:07:25,340::task::1185::TaskManager.Task::(prepare) Task=`51398a8a-50e2-4908-8956-5f985c5f167d`::finished: {} >Thread-14::DEBUG::2014-07-24 10:07:25,340::task::595::TaskManager.Task::(_updateState) Task=`51398a8a-50e2-4908-8956-5f985c5f167d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:07:25,340::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:07:25,340::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:07:25,340::task::990::TaskManager.Task::(_decref) Task=`51398a8a-50e2-4908-8956-5f985c5f167d`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:07:40,645::task::595::TaskManager.Task::(_updateState) Task=`bafc1911-8e20-418f-9368-55be708cef55`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:07:40,645::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:07:40,646::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-14::DEBUG::2014-07-24 10:07:40,646::task::1185::TaskManager.Task::(prepare) Task=`bafc1911-8e20-418f-9368-55be708cef55`::finished: {} >Thread-14::DEBUG::2014-07-24 10:07:40,646::task::595::TaskManager.Task::(_updateState) Task=`bafc1911-8e20-418f-9368-55be708cef55`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:07:40,646::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:07:40,646::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:07:40,646::task::990::TaskManager.Task::(_decref) Task=`bafc1911-8e20-418f-9368-55be708cef55`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:07:55,946::task::595::TaskManager.Task::(_updateState) Task=`72c0618c-19fb-4ebe-98b4-6bfa6f43916b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:07:55,946::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:07:55,946::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-14::DEBUG::2014-07-24 10:07:55,947::task::1185::TaskManager.Task::(prepare) Task=`72c0618c-19fb-4ebe-98b4-6bfa6f43916b`::finished: {} >Thread-14::DEBUG::2014-07-24 10:07:55,947::task::595::TaskManager.Task::(_updateState) Task=`72c0618c-19fb-4ebe-98b4-6bfa6f43916b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:07:55,947::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:07:55,947::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:07:55,947::task::990::TaskManager.Task::(_decref) Task=`72c0618c-19fb-4ebe-98b4-6bfa6f43916b`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:08:11,306::task::595::TaskManager.Task::(_updateState) Task=`3671adf4-9c08-4a00-b3fd-5a26498a4e56`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:08:11,307::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:08:11,307::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-14::DEBUG::2014-07-24 10:08:11,307::task::1185::TaskManager.Task::(prepare) Task=`3671adf4-9c08-4a00-b3fd-5a26498a4e56`::finished: {} >Thread-14::DEBUG::2014-07-24 10:08:11,307::task::595::TaskManager.Task::(_updateState) Task=`3671adf4-9c08-4a00-b3fd-5a26498a4e56`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:08:11,307::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:08:11,307::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:08:11,308::task::990::TaskManager.Task::(_decref) Task=`3671adf4-9c08-4a00-b3fd-5a26498a4e56`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:08:26,626::task::595::TaskManager.Task::(_updateState) Task=`db163f58-18e3-445e-87b9-40923957d011`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:08:26,626::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:08:26,626::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-14::DEBUG::2014-07-24 10:08:26,626::task::1185::TaskManager.Task::(prepare) Task=`db163f58-18e3-445e-87b9-40923957d011`::finished: {} >Thread-14::DEBUG::2014-07-24 10:08:26,627::task::595::TaskManager.Task::(_updateState) Task=`db163f58-18e3-445e-87b9-40923957d011`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:08:26,627::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:08:26,627::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:08:26,627::task::990::TaskManager.Task::(_decref) Task=`db163f58-18e3-445e-87b9-40923957d011`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:08:41,915::task::595::TaskManager.Task::(_updateState) Task=`a3679de1-cb1b-4cda-8e0d-d4ba0f29619e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:08:41,916::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:08:41,916::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-14::DEBUG::2014-07-24 10:08:41,916::task::1185::TaskManager.Task::(prepare) Task=`a3679de1-cb1b-4cda-8e0d-d4ba0f29619e`::finished: {} >Thread-14::DEBUG::2014-07-24 10:08:41,916::task::595::TaskManager.Task::(_updateState) Task=`a3679de1-cb1b-4cda-8e0d-d4ba0f29619e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:08:41,916::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:08:41,916::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:08:41,916::task::990::TaskManager.Task::(_decref) Task=`a3679de1-cb1b-4cda-8e0d-d4ba0f29619e`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:08:49,979::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) FAILED: <err> = 'iscsiadm: connect to 10.35.162.2 timed out\niscsiadm: connect to 10.35.162.2 timed out\niscsiadm: connect to 10.35.162.2 timed out\niscsiadm: connect to 10.35.162.2 timed out\niscsiadm: connect to 10.35.162.2 timed out\niscsiadm: connect to 10.35.162.2 timed out\niscsiadm: connection login retries (reopen_max) 5 exceeded\niscsiadm: No portals found\n'; <rc> = 21 >Thread-13::DEBUG::2014-07-24 10:08:49,979::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m iface' (cwd None) >Thread-13::DEBUG::2014-07-24 10:08:49,995::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:08:49,995::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m discoverydb -t sendtargets -I default -p 10.35.162.2:3260 --op=delete' (cwd None) >Thread-13::DEBUG::2014-07-24 10:08:50,016::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::ERROR::2014-07-24 10:08:50,017::hsm::2989::Storage.HSM::(discoverSendTargets) Discovery failed >Traceback (most recent call last): > File "/usr/share/vdsm/storage/hsm.py", line 2987, in discoverSendTargets > targets = iscsi.discoverSendTargets(iface, portal, cred) > File "/usr/share/vdsm/storage/iscsi.py", line 229, in discoverSendTargets > portalStr) > File "/usr/share/vdsm/storage/iscsiadm.py", line 216, in discoverydb_discover > raise IscsiDiscoverdbError(rc, out, err) >IscsiDiscoverdbError: (21, [], ['iscsiadm: connect to 10.35.162.2 timed out', 'iscsiadm: connect to 10.35.162.2 timed out', 'iscsiadm: connect to 10.35.162.2 timed out', 'iscsiadm: connect to 10.35.162.2 timed out', 'iscsiadm: connect to 10.35.162.2 timed out', 'iscsiadm: connect to 10.35.162.2 timed out', 'iscsiadm: connection login retries (reopen_max) 5 exceeded', 'iscsiadm: No portals found']) >Thread-13::ERROR::2014-07-24 10:08:50,017::task::866::TaskManager.Task::(_setError) Task=`50e56811-52fc-45a1-a028-2f2b342406dc`::Unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/storage/task.py", line 873, in _run > return fn(*args, **kargs) > File "/usr/share/vdsm/logUtils.py", line 45, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/storage/hsm.py", line 2990, in discoverSendTargets > raise se.iSCSIDiscoveryError(portal, e) >iSCSIDiscoveryError: Failed discovery of iSCSI targets: "portal=IscsiPortal(hostname='10.35.162.2', port=3260), err=(21, [], ['iscsiadm: connect to 10.35.162.2 timed out', 'iscsiadm: connect to 10.35.162.2 timed out', 'iscsiadm: connect to 10.35.162.2 timed out', 'iscsiadm: connect to 10.35.162.2 timed out', 'iscsiadm: connect to 10.35.162.2 timed out', 'iscsiadm: connect to 10.35.162.2 timed out', 'iscsiadm: connection login retries (reopen_max) 5 exceeded', 'iscsiadm: No portals found'])" >Thread-13::DEBUG::2014-07-24 10:08:50,019::task::885::TaskManager.Task::(_run) Task=`50e56811-52fc-45a1-a028-2f2b342406dc`::Task._run: 50e56811-52fc-45a1-a028-2f2b342406dc ({'connection': '10.35.162.2', 'password': '', 'port': '3260', 'user': ''},) {} failed - stopping task >Thread-13::DEBUG::2014-07-24 10:08:50,019::task::1211::TaskManager.Task::(stop) Task=`50e56811-52fc-45a1-a028-2f2b342406dc`::stopping in state preparing (force False) >Thread-13::DEBUG::2014-07-24 10:08:50,019::task::990::TaskManager.Task::(_decref) Task=`50e56811-52fc-45a1-a028-2f2b342406dc`::ref 1 aborting True >Thread-13::INFO::2014-07-24 10:08:50,019::task::1168::TaskManager.Task::(prepare) Task=`50e56811-52fc-45a1-a028-2f2b342406dc`::aborting: Task is aborted: 'Failed discovery of iSCSI targets' - code 475 >Thread-13::DEBUG::2014-07-24 10:08:50,019::task::1173::TaskManager.Task::(prepare) Task=`50e56811-52fc-45a1-a028-2f2b342406dc`::Prepare: aborted: Failed discovery of iSCSI targets >Thread-13::DEBUG::2014-07-24 10:08:50,020::task::990::TaskManager.Task::(_decref) Task=`50e56811-52fc-45a1-a028-2f2b342406dc`::ref 0 aborting True >Thread-13::DEBUG::2014-07-24 10:08:50,020::task::925::TaskManager.Task::(_doAbort) Task=`50e56811-52fc-45a1-a028-2f2b342406dc`::Task._doAbort: force False >Thread-13::DEBUG::2014-07-24 10:08:50,020::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:08:50,020::task::595::TaskManager.Task::(_updateState) Task=`50e56811-52fc-45a1-a028-2f2b342406dc`::moving from state preparing -> state aborting >Thread-13::DEBUG::2014-07-24 10:08:50,020::task::550::TaskManager.Task::(__state_aborting) Task=`50e56811-52fc-45a1-a028-2f2b342406dc`::_aborting: recover policy none >Thread-13::DEBUG::2014-07-24 10:08:50,020::task::595::TaskManager.Task::(_updateState) Task=`50e56811-52fc-45a1-a028-2f2b342406dc`::moving from state aborting -> state failed >Thread-13::DEBUG::2014-07-24 10:08:50,021::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:08:50,021::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::ERROR::2014-07-24 10:08:50,021::dispatcher::65::Storage.Dispatcher.Protect::(run) {'status': {'message': 'Failed discovery of iSCSI targets: "portal=IscsiPortal(hostname=\'10.35.162.2\', port=3260), err=(21, [], [\'iscsiadm: connect to 10.35.162.2 timed out\', \'iscsiadm: connect to 10.35.162.2 timed out\', \'iscsiadm: connect to 10.35.162.2 timed out\', \'iscsiadm: connect to 10.35.162.2 timed out\', \'iscsiadm: connect to 10.35.162.2 timed out\', \'iscsiadm: connect to 10.35.162.2 timed out\', \'iscsiadm: connection login retries (reopen_max) 5 exceeded\', \'iscsiadm: No portals found\'])"', 'code': 475}} >Thread-13::DEBUG::2014-07-24 10:08:57,223::task::595::TaskManager.Task::(_updateState) Task=`a3ee7a05-215b-41e0-aec6-f7e45a4b10be`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:08:57,223::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:08:57,224::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:08:57,224::task::1185::TaskManager.Task::(prepare) Task=`a3ee7a05-215b-41e0-aec6-f7e45a4b10be`::finished: {} >Thread-13::DEBUG::2014-07-24 10:08:57,224::task::595::TaskManager.Task::(_updateState) Task=`a3ee7a05-215b-41e0-aec6-f7e45a4b10be`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:08:57,224::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:08:57,224::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:08:57,224::task::990::TaskManager.Task::(_decref) Task=`a3ee7a05-215b-41e0-aec6-f7e45a4b10be`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:09:12,546::task::595::TaskManager.Task::(_updateState) Task=`531f2b4a-ccc9-44b3-b6a5-2d215f081d41`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:09:12,546::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:09:12,546::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:09:12,547::task::1185::TaskManager.Task::(prepare) Task=`531f2b4a-ccc9-44b3-b6a5-2d215f081d41`::finished: {} >Thread-13::DEBUG::2014-07-24 10:09:12,547::task::595::TaskManager.Task::(_updateState) Task=`531f2b4a-ccc9-44b3-b6a5-2d215f081d41`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:09:12,547::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:09:12,547::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:09:12,547::task::990::TaskManager.Task::(_decref) Task=`531f2b4a-ccc9-44b3-b6a5-2d215f081d41`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:09:28,029::task::595::TaskManager.Task::(_updateState) Task=`7451ce31-b9ce-4df3-ac4c-e8567b12b9f8`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:09:28,029::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:09:28,029::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:09:28,029::task::1185::TaskManager.Task::(prepare) Task=`7451ce31-b9ce-4df3-ac4c-e8567b12b9f8`::finished: {} >Thread-13::DEBUG::2014-07-24 10:09:28,029::task::595::TaskManager.Task::(_updateState) Task=`7451ce31-b9ce-4df3-ac4c-e8567b12b9f8`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:09:28,030::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:09:28,030::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:09:28,030::task::990::TaskManager.Task::(_decref) Task=`7451ce31-b9ce-4df3-ac4c-e8567b12b9f8`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:09:43,398::task::595::TaskManager.Task::(_updateState) Task=`52429454-a2ae-4e37-aa74-ea87a130677c`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:09:43,399::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:09:43,399::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:09:43,399::task::1185::TaskManager.Task::(prepare) Task=`52429454-a2ae-4e37-aa74-ea87a130677c`::finished: {} >Thread-13::DEBUG::2014-07-24 10:09:43,399::task::595::TaskManager.Task::(_updateState) Task=`52429454-a2ae-4e37-aa74-ea87a130677c`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:09:43,399::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:09:43,400::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:09:43,400::task::990::TaskManager.Task::(_decref) Task=`52429454-a2ae-4e37-aa74-ea87a130677c`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:09:58,754::task::595::TaskManager.Task::(_updateState) Task=`22ff2a28-5361-46c4-9036-390888fd95c5`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:09:58,754::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:09:58,755::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:09:58,755::task::1185::TaskManager.Task::(prepare) Task=`22ff2a28-5361-46c4-9036-390888fd95c5`::finished: {} >Thread-13::DEBUG::2014-07-24 10:09:58,755::task::595::TaskManager.Task::(_updateState) Task=`22ff2a28-5361-46c4-9036-390888fd95c5`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:09:58,755::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:09:58,755::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:09:58,755::task::990::TaskManager.Task::(_decref) Task=`22ff2a28-5361-46c4-9036-390888fd95c5`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:10:14,121::task::595::TaskManager.Task::(_updateState) Task=`a71642fd-22db-495d-a09e-a5f1dfbad803`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:10:14,121::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:10:14,122::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:10:14,122::task::1185::TaskManager.Task::(prepare) Task=`a71642fd-22db-495d-a09e-a5f1dfbad803`::finished: {} >Thread-13::DEBUG::2014-07-24 10:10:14,122::task::595::TaskManager.Task::(_updateState) Task=`a71642fd-22db-495d-a09e-a5f1dfbad803`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:10:14,122::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:10:14,122::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:10:14,122::task::990::TaskManager.Task::(_decref) Task=`a71642fd-22db-495d-a09e-a5f1dfbad803`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:10:29,571::task::595::TaskManager.Task::(_updateState) Task=`5aa567ee-b0cc-4ee4-b24c-5bd155921c2c`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:10:29,572::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:10:29,572::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:10:29,572::task::1185::TaskManager.Task::(prepare) Task=`5aa567ee-b0cc-4ee4-b24c-5bd155921c2c`::finished: {} >Thread-13::DEBUG::2014-07-24 10:10:29,572::task::595::TaskManager.Task::(_updateState) Task=`5aa567ee-b0cc-4ee4-b24c-5bd155921c2c`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:10:29,572::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:10:29,573::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:10:29,573::task::990::TaskManager.Task::(_decref) Task=`5aa567ee-b0cc-4ee4-b24c-5bd155921c2c`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:10:45,318::task::595::TaskManager.Task::(_updateState) Task=`9071ebc9-776e-4450-a0c3-2f03abf43961`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:10:45,319::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:10:45,319::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:10:45,319::task::1185::TaskManager.Task::(prepare) Task=`9071ebc9-776e-4450-a0c3-2f03abf43961`::finished: {} >Thread-13::DEBUG::2014-07-24 10:10:45,319::task::595::TaskManager.Task::(_updateState) Task=`9071ebc9-776e-4450-a0c3-2f03abf43961`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:10:45,319::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:10:45,319::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:10:45,320::task::990::TaskManager.Task::(_decref) Task=`9071ebc9-776e-4450-a0c3-2f03abf43961`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:11:00,913::task::595::TaskManager.Task::(_updateState) Task=`f0088a27-7bac-4269-b548-f04abc058ff4`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:11:00,913::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:11:00,913::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:11:00,913::task::1185::TaskManager.Task::(prepare) Task=`f0088a27-7bac-4269-b548-f04abc058ff4`::finished: {} >Thread-13::DEBUG::2014-07-24 10:11:00,914::task::595::TaskManager.Task::(_updateState) Task=`f0088a27-7bac-4269-b548-f04abc058ff4`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:11:00,914::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:11:00,914::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:11:00,914::task::990::TaskManager.Task::(_decref) Task=`f0088a27-7bac-4269-b548-f04abc058ff4`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:11:16,341::task::595::TaskManager.Task::(_updateState) Task=`4228ae6e-0258-401e-9d80-17331e62fe3b`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:11:16,341::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:11:16,341::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:11:16,341::task::1185::TaskManager.Task::(prepare) Task=`4228ae6e-0258-401e-9d80-17331e62fe3b`::finished: {} >Thread-13::DEBUG::2014-07-24 10:11:16,341::task::595::TaskManager.Task::(_updateState) Task=`4228ae6e-0258-401e-9d80-17331e62fe3b`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:11:16,341::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:11:16,342::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:11:16,342::task::990::TaskManager.Task::(_decref) Task=`4228ae6e-0258-401e-9d80-17331e62fe3b`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:11:31,771::task::595::TaskManager.Task::(_updateState) Task=`4f6f35a7-57dc-4bd5-912e-3a6064ebefff`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:11:31,771::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:11:31,771::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:11:31,772::task::1185::TaskManager.Task::(prepare) Task=`4f6f35a7-57dc-4bd5-912e-3a6064ebefff`::finished: {} >Thread-13::DEBUG::2014-07-24 10:11:31,772::task::595::TaskManager.Task::(_updateState) Task=`4f6f35a7-57dc-4bd5-912e-3a6064ebefff`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:11:31,772::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:11:31,772::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:11:31,772::task::990::TaskManager.Task::(_decref) Task=`4f6f35a7-57dc-4bd5-912e-3a6064ebefff`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:11:47,183::task::595::TaskManager.Task::(_updateState) Task=`5906048f-33e2-4a65-ac15-c3c5191c9035`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:11:47,184::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:11:47,184::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:11:47,184::task::1185::TaskManager.Task::(prepare) Task=`5906048f-33e2-4a65-ac15-c3c5191c9035`::finished: {} >Thread-13::DEBUG::2014-07-24 10:11:47,184::task::595::TaskManager.Task::(_updateState) Task=`5906048f-33e2-4a65-ac15-c3c5191c9035`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:11:47,184::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:11:47,184::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:11:47,184::task::990::TaskManager.Task::(_decref) Task=`5906048f-33e2-4a65-ac15-c3c5191c9035`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:12:02,485::task::595::TaskManager.Task::(_updateState) Task=`fe4c37fe-f8cd-4462-8fc8-487e9aa7b9ee`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:12:02,485::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:12:02,485::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:12:02,485::task::1185::TaskManager.Task::(prepare) Task=`fe4c37fe-f8cd-4462-8fc8-487e9aa7b9ee`::finished: {} >Thread-13::DEBUG::2014-07-24 10:12:02,486::task::595::TaskManager.Task::(_updateState) Task=`fe4c37fe-f8cd-4462-8fc8-487e9aa7b9ee`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:12:02,486::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:12:02,486::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:12:02,486::task::990::TaskManager.Task::(_decref) Task=`fe4c37fe-f8cd-4462-8fc8-487e9aa7b9ee`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:12:17,790::task::595::TaskManager.Task::(_updateState) Task=`37cdc763-e3a0-4bd7-84c2-bc6c77ee3534`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:12:17,790::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:12:17,790::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:12:17,791::task::1185::TaskManager.Task::(prepare) Task=`37cdc763-e3a0-4bd7-84c2-bc6c77ee3534`::finished: {} >Thread-13::DEBUG::2014-07-24 10:12:17,791::task::595::TaskManager.Task::(_updateState) Task=`37cdc763-e3a0-4bd7-84c2-bc6c77ee3534`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:12:17,791::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:12:17,791::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:12:17,791::task::990::TaskManager.Task::(_decref) Task=`37cdc763-e3a0-4bd7-84c2-bc6c77ee3534`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:12:33,117::task::595::TaskManager.Task::(_updateState) Task=`45cffc1c-2bab-458a-ab79-f6775e5c4987`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:12:33,117::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:12:33,117::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:12:33,117::task::1185::TaskManager.Task::(prepare) Task=`45cffc1c-2bab-458a-ab79-f6775e5c4987`::finished: {} >Thread-13::DEBUG::2014-07-24 10:12:33,117::task::595::TaskManager.Task::(_updateState) Task=`45cffc1c-2bab-458a-ab79-f6775e5c4987`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:12:33,118::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:12:33,118::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:12:33,118::task::990::TaskManager.Task::(_decref) Task=`45cffc1c-2bab-458a-ab79-f6775e5c4987`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:12:48,416::task::595::TaskManager.Task::(_updateState) Task=`959fa8f9-edcc-438d-ae67-841cf942f89b`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:12:48,416::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:12:48,416::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:12:48,417::task::1185::TaskManager.Task::(prepare) Task=`959fa8f9-edcc-438d-ae67-841cf942f89b`::finished: {} >Thread-13::DEBUG::2014-07-24 10:12:48,417::task::595::TaskManager.Task::(_updateState) Task=`959fa8f9-edcc-438d-ae67-841cf942f89b`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:12:48,417::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:12:48,417::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:12:48,417::task::990::TaskManager.Task::(_decref) Task=`959fa8f9-edcc-438d-ae67-841cf942f89b`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:13:03,754::task::595::TaskManager.Task::(_updateState) Task=`a0372a35-2fdb-4977-8d1a-4b6cf8b91da0`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:13:03,754::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:13:03,754::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:13:03,755::task::1185::TaskManager.Task::(prepare) Task=`a0372a35-2fdb-4977-8d1a-4b6cf8b91da0`::finished: {} >Thread-13::DEBUG::2014-07-24 10:13:03,755::task::595::TaskManager.Task::(_updateState) Task=`a0372a35-2fdb-4977-8d1a-4b6cf8b91da0`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:13:03,755::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:13:03,755::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:13:03,755::task::990::TaskManager.Task::(_decref) Task=`a0372a35-2fdb-4977-8d1a-4b6cf8b91da0`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:13:19,082::task::595::TaskManager.Task::(_updateState) Task=`0bd2f014-7b95-4a68-bf61-84a3004745d7`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:13:19,083::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:13:19,083::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:13:19,083::task::1185::TaskManager.Task::(prepare) Task=`0bd2f014-7b95-4a68-bf61-84a3004745d7`::finished: {} >Thread-13::DEBUG::2014-07-24 10:13:19,083::task::595::TaskManager.Task::(_updateState) Task=`0bd2f014-7b95-4a68-bf61-84a3004745d7`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:13:19,083::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:13:19,083::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:13:19,084::task::990::TaskManager.Task::(_decref) Task=`0bd2f014-7b95-4a68-bf61-84a3004745d7`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:13:34,388::task::595::TaskManager.Task::(_updateState) Task=`622f8dc3-93ec-4db7-963e-e07283c74204`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:13:34,389::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:13:34,389::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:13:34,389::task::1185::TaskManager.Task::(prepare) Task=`622f8dc3-93ec-4db7-963e-e07283c74204`::finished: {} >Thread-13::DEBUG::2014-07-24 10:13:34,390::task::595::TaskManager.Task::(_updateState) Task=`622f8dc3-93ec-4db7-963e-e07283c74204`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:13:34,390::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:13:34,390::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:13:34,390::task::990::TaskManager.Task::(_decref) Task=`622f8dc3-93ec-4db7-963e-e07283c74204`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:13:49,741::task::595::TaskManager.Task::(_updateState) Task=`5145bb39-2deb-407c-8186-26bd4b715fdd`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:13:49,741::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:13:49,741::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:13:49,742::task::1185::TaskManager.Task::(prepare) Task=`5145bb39-2deb-407c-8186-26bd4b715fdd`::finished: {} >Thread-13::DEBUG::2014-07-24 10:13:49,742::task::595::TaskManager.Task::(_updateState) Task=`5145bb39-2deb-407c-8186-26bd4b715fdd`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:13:49,742::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:13:49,742::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:13:49,742::task::990::TaskManager.Task::(_decref) Task=`5145bb39-2deb-407c-8186-26bd4b715fdd`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:14:05,043::task::595::TaskManager.Task::(_updateState) Task=`fb974430-fa87-4a03-a052-7c798c86a9e4`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:14:05,043::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:14:05,043::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:14:05,043::task::1185::TaskManager.Task::(prepare) Task=`fb974430-fa87-4a03-a052-7c798c86a9e4`::finished: {} >Thread-13::DEBUG::2014-07-24 10:14:05,044::task::595::TaskManager.Task::(_updateState) Task=`fb974430-fa87-4a03-a052-7c798c86a9e4`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:14:05,044::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:14:05,044::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:14:05,044::task::990::TaskManager.Task::(_decref) Task=`fb974430-fa87-4a03-a052-7c798c86a9e4`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:14:20,373::task::595::TaskManager.Task::(_updateState) Task=`2c9dd5fc-b7dc-4f7e-b92b-d9fa7100439b`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:14:20,373::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:14:20,373::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:14:20,373::task::1185::TaskManager.Task::(prepare) Task=`2c9dd5fc-b7dc-4f7e-b92b-d9fa7100439b`::finished: {} >Thread-13::DEBUG::2014-07-24 10:14:20,373::task::595::TaskManager.Task::(_updateState) Task=`2c9dd5fc-b7dc-4f7e-b92b-d9fa7100439b`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:14:20,373::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:14:20,374::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:14:20,374::task::990::TaskManager.Task::(_decref) Task=`2c9dd5fc-b7dc-4f7e-b92b-d9fa7100439b`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:14:35,705::task::595::TaskManager.Task::(_updateState) Task=`0b01aa4e-0248-4e89-a20b-92f56ac71e5b`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:14:35,705::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:14:35,705::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:14:35,705::task::1185::TaskManager.Task::(prepare) Task=`0b01aa4e-0248-4e89-a20b-92f56ac71e5b`::finished: {} >Thread-13::DEBUG::2014-07-24 10:14:35,706::task::595::TaskManager.Task::(_updateState) Task=`0b01aa4e-0248-4e89-a20b-92f56ac71e5b`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:14:35,706::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:14:35,706::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:14:35,706::task::990::TaskManager.Task::(_decref) Task=`0b01aa4e-0248-4e89-a20b-92f56ac71e5b`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:14:51,042::task::595::TaskManager.Task::(_updateState) Task=`1289a590-68db-435d-91c1-c79aa28e2c6c`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:14:51,042::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:14:51,042::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:14:51,042::task::1185::TaskManager.Task::(prepare) Task=`1289a590-68db-435d-91c1-c79aa28e2c6c`::finished: {} >Thread-13::DEBUG::2014-07-24 10:14:51,042::task::595::TaskManager.Task::(_updateState) Task=`1289a590-68db-435d-91c1-c79aa28e2c6c`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:14:51,043::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:14:51,043::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:14:51,043::task::990::TaskManager.Task::(_decref) Task=`1289a590-68db-435d-91c1-c79aa28e2c6c`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:15:06,402::task::595::TaskManager.Task::(_updateState) Task=`22b5b559-4de6-4c70-8e6b-86b74ae7b601`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:15:06,402::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:15:06,402::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:15:06,402::task::1185::TaskManager.Task::(prepare) Task=`22b5b559-4de6-4c70-8e6b-86b74ae7b601`::finished: {} >Thread-13::DEBUG::2014-07-24 10:15:06,402::task::595::TaskManager.Task::(_updateState) Task=`22b5b559-4de6-4c70-8e6b-86b74ae7b601`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:15:06,403::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:15:06,403::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:15:06,403::task::990::TaskManager.Task::(_decref) Task=`22b5b559-4de6-4c70-8e6b-86b74ae7b601`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:15:21,715::task::595::TaskManager.Task::(_updateState) Task=`f46152e5-d59e-49cb-bcb8-cc18dd4c99f1`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:15:21,715::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:15:21,716::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:15:21,716::task::1185::TaskManager.Task::(prepare) Task=`f46152e5-d59e-49cb-bcb8-cc18dd4c99f1`::finished: {} >Thread-13::DEBUG::2014-07-24 10:15:21,716::task::595::TaskManager.Task::(_updateState) Task=`f46152e5-d59e-49cb-bcb8-cc18dd4c99f1`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:15:21,716::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:15:21,716::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:15:21,716::task::990::TaskManager.Task::(_decref) Task=`f46152e5-d59e-49cb-bcb8-cc18dd4c99f1`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:15:37,314::task::595::TaskManager.Task::(_updateState) Task=`bd63efa3-e983-405d-92c9-2a763f2a3723`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:15:37,315::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:15:37,315::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:15:37,315::task::1185::TaskManager.Task::(prepare) Task=`bd63efa3-e983-405d-92c9-2a763f2a3723`::finished: {} >Thread-13::DEBUG::2014-07-24 10:15:37,315::task::595::TaskManager.Task::(_updateState) Task=`bd63efa3-e983-405d-92c9-2a763f2a3723`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:15:37,315::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:15:37,315::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:15:37,316::task::990::TaskManager.Task::(_decref) Task=`bd63efa3-e983-405d-92c9-2a763f2a3723`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:15:52,635::task::595::TaskManager.Task::(_updateState) Task=`2bc24f0f-02dd-4d2f-98cd-c4bb1e326037`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:15:52,635::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:15:52,635::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:15:52,635::task::1185::TaskManager.Task::(prepare) Task=`2bc24f0f-02dd-4d2f-98cd-c4bb1e326037`::finished: {} >Thread-13::DEBUG::2014-07-24 10:15:52,635::task::595::TaskManager.Task::(_updateState) Task=`2bc24f0f-02dd-4d2f-98cd-c4bb1e326037`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:15:52,636::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:15:52,636::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:15:52,636::task::990::TaskManager.Task::(_decref) Task=`2bc24f0f-02dd-4d2f-98cd-c4bb1e326037`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:16:07,946::task::595::TaskManager.Task::(_updateState) Task=`5fc85472-55fa-4725-bf1f-16d41b45c422`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:16:07,946::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:16:07,946::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:16:07,947::task::1185::TaskManager.Task::(prepare) Task=`5fc85472-55fa-4725-bf1f-16d41b45c422`::finished: {} >Thread-13::DEBUG::2014-07-24 10:16:07,947::task::595::TaskManager.Task::(_updateState) Task=`5fc85472-55fa-4725-bf1f-16d41b45c422`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:16:07,947::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:16:07,947::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:16:07,947::task::990::TaskManager.Task::(_decref) Task=`5fc85472-55fa-4725-bf1f-16d41b45c422`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:16:23,257::task::595::TaskManager.Task::(_updateState) Task=`7e97992d-63c5-4daa-b2cd-2c5a543868c7`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:16:23,258::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:16:23,258::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:16:23,258::task::1185::TaskManager.Task::(prepare) Task=`7e97992d-63c5-4daa-b2cd-2c5a543868c7`::finished: {} >Thread-13::DEBUG::2014-07-24 10:16:23,258::task::595::TaskManager.Task::(_updateState) Task=`7e97992d-63c5-4daa-b2cd-2c5a543868c7`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:16:23,258::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:16:23,258::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:16:23,259::task::990::TaskManager.Task::(_decref) Task=`7e97992d-63c5-4daa-b2cd-2c5a543868c7`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:16:39,069::task::595::TaskManager.Task::(_updateState) Task=`b139a6a6-3a7c-4b87-8da9-0d32fbd651f1`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:16:39,070::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:16:39,070::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:16:39,070::task::1185::TaskManager.Task::(prepare) Task=`b139a6a6-3a7c-4b87-8da9-0d32fbd651f1`::finished: {} >Thread-13::DEBUG::2014-07-24 10:16:39,070::task::595::TaskManager.Task::(_updateState) Task=`b139a6a6-3a7c-4b87-8da9-0d32fbd651f1`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:16:39,070::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:16:39,071::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:16:39,071::task::990::TaskManager.Task::(_decref) Task=`b139a6a6-3a7c-4b87-8da9-0d32fbd651f1`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:16:54,393::task::595::TaskManager.Task::(_updateState) Task=`ad70fa32-d43f-4181-9ddf-44f9e4454b1b`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:16:54,393::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:16:54,393::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:16:54,393::task::1185::TaskManager.Task::(prepare) Task=`ad70fa32-d43f-4181-9ddf-44f9e4454b1b`::finished: {} >Thread-13::DEBUG::2014-07-24 10:16:54,393::task::595::TaskManager.Task::(_updateState) Task=`ad70fa32-d43f-4181-9ddf-44f9e4454b1b`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:16:54,394::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:16:54,394::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:16:54,394::task::990::TaskManager.Task::(_decref) Task=`ad70fa32-d43f-4181-9ddf-44f9e4454b1b`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:17:09,719::task::595::TaskManager.Task::(_updateState) Task=`116e9114-6fac-4a99-adf0-2433a86f451f`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:17:09,720::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:17:09,720::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:17:09,720::task::1185::TaskManager.Task::(prepare) Task=`116e9114-6fac-4a99-adf0-2433a86f451f`::finished: {} >Thread-13::DEBUG::2014-07-24 10:17:09,720::task::595::TaskManager.Task::(_updateState) Task=`116e9114-6fac-4a99-adf0-2433a86f451f`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:17:09,720::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:17:09,720::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:17:09,720::task::990::TaskManager.Task::(_decref) Task=`116e9114-6fac-4a99-adf0-2433a86f451f`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:17:25,015::task::595::TaskManager.Task::(_updateState) Task=`a821d0e3-6668-4883-b023-b5ef9e5b663d`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:17:25,015::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:17:25,015::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:17:25,015::task::1185::TaskManager.Task::(prepare) Task=`a821d0e3-6668-4883-b023-b5ef9e5b663d`::finished: {} >Thread-13::DEBUG::2014-07-24 10:17:25,015::task::595::TaskManager.Task::(_updateState) Task=`a821d0e3-6668-4883-b023-b5ef9e5b663d`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:17:25,016::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:17:25,016::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:17:25,016::task::990::TaskManager.Task::(_decref) Task=`a821d0e3-6668-4883-b023-b5ef9e5b663d`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:17:40,354::task::595::TaskManager.Task::(_updateState) Task=`be662d49-ee10-446f-ad3d-97de33ef4632`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:17:40,354::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:17:40,354::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:17:40,354::task::1185::TaskManager.Task::(prepare) Task=`be662d49-ee10-446f-ad3d-97de33ef4632`::finished: {} >Thread-13::DEBUG::2014-07-24 10:17:40,354::task::595::TaskManager.Task::(_updateState) Task=`be662d49-ee10-446f-ad3d-97de33ef4632`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:17:40,354::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:17:40,355::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:17:40,355::task::990::TaskManager.Task::(_decref) Task=`be662d49-ee10-446f-ad3d-97de33ef4632`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:17:55,740::task::595::TaskManager.Task::(_updateState) Task=`7680f8a7-d953-4443-b283-a79340fcce3f`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:17:55,740::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:17:55,741::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:17:55,741::task::1185::TaskManager.Task::(prepare) Task=`7680f8a7-d953-4443-b283-a79340fcce3f`::finished: {} >Thread-13::DEBUG::2014-07-24 10:17:55,741::task::595::TaskManager.Task::(_updateState) Task=`7680f8a7-d953-4443-b283-a79340fcce3f`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:17:55,741::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:17:55,741::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:17:55,741::task::990::TaskManager.Task::(_decref) Task=`7680f8a7-d953-4443-b283-a79340fcce3f`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:18:11,046::task::595::TaskManager.Task::(_updateState) Task=`ebd73e98-c7cf-4c5c-a311-92587ef92fb1`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:18:11,046::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:18:11,046::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:18:11,047::task::1185::TaskManager.Task::(prepare) Task=`ebd73e98-c7cf-4c5c-a311-92587ef92fb1`::finished: {} >Thread-13::DEBUG::2014-07-24 10:18:11,047::task::595::TaskManager.Task::(_updateState) Task=`ebd73e98-c7cf-4c5c-a311-92587ef92fb1`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:18:11,047::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:18:11,047::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:18:11,047::task::990::TaskManager.Task::(_decref) Task=`ebd73e98-c7cf-4c5c-a311-92587ef92fb1`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:18:26,359::task::595::TaskManager.Task::(_updateState) Task=`3602c749-4411-4666-a99f-05673c63754c`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:18:26,359::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:18:26,359::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:18:26,360::task::1185::TaskManager.Task::(prepare) Task=`3602c749-4411-4666-a99f-05673c63754c`::finished: {} >Thread-13::DEBUG::2014-07-24 10:18:26,360::task::595::TaskManager.Task::(_updateState) Task=`3602c749-4411-4666-a99f-05673c63754c`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:18:26,360::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:18:26,360::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:18:26,360::task::990::TaskManager.Task::(_decref) Task=`3602c749-4411-4666-a99f-05673c63754c`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:18:41,675::task::595::TaskManager.Task::(_updateState) Task=`8f6d8b5b-d82e-4e50-a0c5-deaac18131b0`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:18:41,675::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:18:41,676::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:18:41,676::task::1185::TaskManager.Task::(prepare) Task=`8f6d8b5b-d82e-4e50-a0c5-deaac18131b0`::finished: {} >Thread-13::DEBUG::2014-07-24 10:18:41,676::task::595::TaskManager.Task::(_updateState) Task=`8f6d8b5b-d82e-4e50-a0c5-deaac18131b0`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:18:41,676::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:18:41,676::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:18:41,676::task::990::TaskManager.Task::(_decref) Task=`8f6d8b5b-d82e-4e50-a0c5-deaac18131b0`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:18:56,977::task::595::TaskManager.Task::(_updateState) Task=`729d4f93-c7c4-4c0d-9c31-2ac4716d0811`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:18:56,977::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:18:56,977::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:18:56,977::task::1185::TaskManager.Task::(prepare) Task=`729d4f93-c7c4-4c0d-9c31-2ac4716d0811`::finished: {} >Thread-13::DEBUG::2014-07-24 10:18:56,977::task::595::TaskManager.Task::(_updateState) Task=`729d4f93-c7c4-4c0d-9c31-2ac4716d0811`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:18:56,978::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:18:56,978::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:18:56,978::task::990::TaskManager.Task::(_decref) Task=`729d4f93-c7c4-4c0d-9c31-2ac4716d0811`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:19:12,289::task::595::TaskManager.Task::(_updateState) Task=`585526e4-5573-40cd-8c2a-bc4e28269c22`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:19:12,289::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:19:12,289::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:19:12,289::task::1185::TaskManager.Task::(prepare) Task=`585526e4-5573-40cd-8c2a-bc4e28269c22`::finished: {} >Thread-13::DEBUG::2014-07-24 10:19:12,290::task::595::TaskManager.Task::(_updateState) Task=`585526e4-5573-40cd-8c2a-bc4e28269c22`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:19:12,290::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:19:12,290::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:19:12,290::task::990::TaskManager.Task::(_decref) Task=`585526e4-5573-40cd-8c2a-bc4e28269c22`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:19:27,651::task::595::TaskManager.Task::(_updateState) Task=`5caae8d3-fc40-46a9-9c83-1dca9a45a64f`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:19:27,652::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:19:27,652::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:19:27,652::task::1185::TaskManager.Task::(prepare) Task=`5caae8d3-fc40-46a9-9c83-1dca9a45a64f`::finished: {} >Thread-13::DEBUG::2014-07-24 10:19:27,652::task::595::TaskManager.Task::(_updateState) Task=`5caae8d3-fc40-46a9-9c83-1dca9a45a64f`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:19:27,652::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:19:27,652::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:19:27,653::task::990::TaskManager.Task::(_decref) Task=`5caae8d3-fc40-46a9-9c83-1dca9a45a64f`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:19:42,953::task::595::TaskManager.Task::(_updateState) Task=`90609abc-01c0-4d3a-a217-972b008fb090`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:19:42,953::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:19:42,953::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:19:42,953::task::1185::TaskManager.Task::(prepare) Task=`90609abc-01c0-4d3a-a217-972b008fb090`::finished: {} >Thread-13::DEBUG::2014-07-24 10:19:42,954::task::595::TaskManager.Task::(_updateState) Task=`90609abc-01c0-4d3a-a217-972b008fb090`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:19:42,954::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:19:42,954::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:19:42,954::task::990::TaskManager.Task::(_decref) Task=`90609abc-01c0-4d3a-a217-972b008fb090`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:19:58,277::task::595::TaskManager.Task::(_updateState) Task=`235a6201-ce3b-433a-84eb-5c29787dddda`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:19:58,277::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:19:58,278::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:19:58,278::task::1185::TaskManager.Task::(prepare) Task=`235a6201-ce3b-433a-84eb-5c29787dddda`::finished: {} >Thread-13::DEBUG::2014-07-24 10:19:58,278::task::595::TaskManager.Task::(_updateState) Task=`235a6201-ce3b-433a-84eb-5c29787dddda`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:19:58,278::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:19:58,278::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:19:58,278::task::990::TaskManager.Task::(_decref) Task=`235a6201-ce3b-433a-84eb-5c29787dddda`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:20:12,570::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:20:12,570::task::595::TaskManager.Task::(_updateState) Task=`f25f530a-d047-489a-8303-91f7f52d9665`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:20:12,571::logUtils::44::dispatcher::(wrapper) Run and protect: getDeviceList(storageType=3, options={}) >Thread-13::DEBUG::2014-07-24 10:20:12,571::misc::738::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-13::DEBUG::2014-07-24 10:20:12,571::misc::740::SamplingMethod::(__call__) Got in to sampling method >Thread-13::DEBUG::2014-07-24 10:20:12,571::misc::738::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-13::DEBUG::2014-07-24 10:20:12,571::misc::740::SamplingMethod::(__call__) Got in to sampling method >Thread-13::DEBUG::2014-07-24 10:20:12,571::iscsi::407::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-13::DEBUG::2014-07-24 10:20:12,572::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-13::DEBUG::2014-07-24 10:20:12,617::misc::748::SamplingMethod::(__call__) Returning last result >Thread-13::DEBUG::2014-07-24 10:20:12,626::multipath::109::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-13::DEBUG::2014-07-24 10:20:12,773::multipath::109::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:20:12,774::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:12,774::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:12,775::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:12,775::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:12,775::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:12,775::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:12,775::misc::748::SamplingMethod::(__call__) Returning last result >Thread-13::DEBUG::2014-07-24 10:20:12,776::lvm::325::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:12,778::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size' (cwd None) >Thread-13::DEBUG::2014-07-24 10:20:13,134::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:20:13,135::lvm::350::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:13,227::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --test --metadatasize 128m --metadatacopies 2 --metadataignore y /dev/mapper/360060160128230005ddddcba33f2e311 /dev/mapper/360060160128230005cdddcba33f2e311 /dev/mapper/360060160128230005edddcba33f2e311 /dev/mapper/360060160128230005fdddcba33f2e311 /dev/mapper/3600601601282300060dddcba33f2e311' (cwd None) >Thread-13::DEBUG::2014-07-24 10:20:13,487::lvm::296::Storage.Misc.excCmd::(cmd) FAILED: <err> = ' TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.\n Can\'t initialize physical volume "/dev/mapper/360060160128230005ddddcba33f2e311" of volume group "c3537562-9170-4f1f-8007-34aca9f16fc8" without -ff\n Can\'t initialize physical volume "/dev/mapper/360060160128230005cdddcba33f2e311" of volume group "65e44b24-19b9-4407-80ad-cd36c7634de9" without -ff\n Can\'t initialize physical volume "/dev/mapper/360060160128230005fdddcba33f2e311" of volume group "fd6fc760-3270-4641-9db0-6937f5c50bbb" without -ff\n'; <rc> = 5 >Thread-13::DEBUG::2014-07-24 10:20:13,488::lvm::860::Storage.LVM::(testPVCreate) rc: 5, out: [' Physical volume "/dev/mapper/360060160128230005edddcba33f2e311" successfully created', ' Physical volume "/dev/mapper/3600601601282300060dddcba33f2e311" successfully created'], err: [' TEST MODE: Metadata will NOT be updated and volumes will not be (de)activated.', ' Can\'t initialize physical volume "/dev/mapper/360060160128230005ddddcba33f2e311" of volume group "c3537562-9170-4f1f-8007-34aca9f16fc8" without -ff', ' Can\'t initialize physical volume "/dev/mapper/360060160128230005cdddcba33f2e311" of volume group "65e44b24-19b9-4407-80ad-cd36c7634de9" without -ff', ' Can\'t initialize physical volume "/dev/mapper/360060160128230005fdddcba33f2e311" of volume group "fd6fc760-3270-4641-9db0-6937f5c50bbb" without -ff'], unusedDevs: set(['/dev/mapper/3600601601282300060dddcba33f2e311', '/dev/mapper/360060160128230005edddcba33f2e311']), usedDevs: set(['/dev/mapper/360060160128230005fdddcba33f2e311', '/dev/mapper/360060160128230005ddddcba33f2e311', '/dev/mapper/360060160128230005cdddcba33f2e311']) >Thread-13::INFO::2014-07-24 10:20:13,489::logUtils::47::dispatcher::(wrapper) Run and protect: getDeviceList, Return response: {'devList': [{'status': 'used', 'vendorID': 'DGC', 'capacity': '42949672960', 'fwrev': '0532', 'vgUUID': 'q1Ti6I-DtOH-esyj-Uw96-9q6N-g7aG-Im8HXG', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'portal': '3', 'password': '******', 'port': '3260'}, {'initiatorname': 'default', 'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'portal': '4', 'password': '******', 'port': '3260'}, {'initiatorname': 'default', 'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'portal': '2', 'password': '******', 'port': '3260'}, {'initiatorname': 'default', 'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdi', 'type': 'iSCSI', 'state': 'active', 'lun': '2'}, {'physdev': 'sdj', 'type': 'iSCSI', 'state': 'active', 'lun': '2'}, {'physdev': 'sdp', 'type': 'iSCSI', 'state': 'active', 'lun': '2'}, {'physdev': 'sdr', 'type': 'iSCSI', 'state': 'active', 'lun': '2'}], 'devtype': 'iSCSI', 'physicalblocksize': '512', 'pvUUID': 'NINprB-qg5p-FSDG-0urq-ZMEL-FF3x-zmNcEt', 'serial': 'SDGC_RAID_5_CKM00121000438', 'GUID': '360060160128230005ddddcba33f2e311', 'productID': 'RAID 5'}, {'status': 'used', 'vendorID': 'DGC', 'capacity': '42949672960', 'fwrev': '0532', 'vgUUID': 'bUAcOY-KqCt-LwKi-umki-Qper-ly0Q-yUFBp7', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'portal': '1', 'password': '******', 'port': '3260'}, {'initiatorname': 'default', 'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'portal': '2', 'password': '******', 'port': '3260'}, {'initiatorname': 'default', 'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'portal': '4', 'password': '******', 'port': '3260'}, {'initiatorname': 'default', 'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'portal': '3', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdk', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}, {'physdev': 'sdh', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}, {'physdev': 'sdf', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}, {'physdev': 'sdg', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}], 'devtype': 'iSCSI', 'physicalblocksize': '512', 'pvUUID': '1Ok1iN-ZV9J-dwi8-NMYp-wYN1-9Pq9-cG33qe', 'serial': 'SDGC_RAID_5_CKM00121000438', 'GUID': '360060160128230005cdddcba33f2e311', 'productID': 'RAID 5'}, {'status': 'free', 'vendorID': 'DGC', 'capacity': '42949672960', 'fwrev': '0532', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'portal': '1', 'password': '******', 'port': '3260'}, {'initiatorname': 'default', 'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'portal': '2', 'password': '******', 'port': '3260'}, {'initiatorname': 'default', 'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'portal': '4', 'password': '******', 'port': '3260'}, {'initiatorname': 'default', 'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'portal': '3', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdt', 'type': 'iSCSI', 'state': 'active', 'lun': '3'}, {'physdev': 'sdq', 'type': 'iSCSI', 'state': 'active', 'lun': '3'}, {'physdev': 'sdm', 'type': 'iSCSI', 'state': 'active', 'lun': '3'}, {'physdev': 'sdl', 'type': 'iSCSI', 'state': 'active', 'lun': '3'}], 'devtype': 'iSCSI', 'physicalblocksize': '512', 'pvUUID': 'iCiCW9-ksd2-Rre8-2roW-iag8-op69-RzMsND', 'serial': 'SDGC_RAID_5_CKM00121000438', 'GUID': '360060160128230005edddcba33f2e311', 'productID': 'RAID 5'}, {'status': 'used', 'vendorID': 'DGC', 'capacity': '42949672960', 'fwrev': '0532', 'vgUUID': 'XFiHaU-cCDH-l4Dl-hMDk-oWT2-cAxg-jlN1Ut', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'portal': '3', 'password': '******', 'port': '3260'}, {'initiatorname': 'default', 'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'portal': '1', 'password': '******', 'port': '3260'}, {'initiatorname': 'default', 'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'portal': '2', 'password': '******', 'port': '3260'}, {'initiatorname': 'default', 'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'portal': '4', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdo', 'type': 'iSCSI', 'state': 'active', 'lun': '4'}, {'physdev': 'sdu', 'type': 'iSCSI', 'state': 'active', 'lun': '4'}, {'physdev': 'sds', 'type': 'iSCSI', 'state': 'active', 'lun': '4'}, {'physdev': 'sdn', 'type': 'iSCSI', 'state': 'active', 'lun': '4'}], 'devtype': 'iSCSI', 'physicalblocksize': '512', 'pvUUID': 'XfFcQG-yjFo-1O8x-mXK2-yylJ-30PY-2R6By7', 'serial': 'SDGC_RAID_5_CKM00121000438', 'GUID': '360060160128230005fdddcba33f2e311', 'productID': 'RAID 5'}, {'status': 'free', 'vendorID': 'DGC', 'capacity': '42949672960', 'fwrev': '0532', 'vgUUID': '', 'pathlist': [{'initiatorname': 'default', 'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'portal': '3', 'password': '******', 'port': '3260'}, {'initiatorname': 'default', 'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'portal': '2', 'password': '******', 'port': '3260'}, {'initiatorname': 'default', 'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'portal': '4', 'password': '******', 'port': '3260'}, {'initiatorname': 'default', 'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'portal': '1', 'password': '******', 'port': '3260'}], 'logicalblocksize': '512', 'pathstatus': [{'physdev': 'sdd', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}, {'physdev': 'sdc', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}, {'physdev': 'sde', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}, {'physdev': 'sdb', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}], 'devtype': 'iSCSI', 'physicalblocksize': '512', 'pvUUID': 'S30hJn-U2MX-Pvf9-WyCo-inNs-eRrJ-f9FjpC', 'serial': 'SDGC_RAID_5_CKM00121000438', 'GUID': '3600601601282300060dddcba33f2e311', 'productID': 'RAID 5'}]} >Thread-13::DEBUG::2014-07-24 10:20:13,490::task::1185::TaskManager.Task::(prepare) Task=`f25f530a-d047-489a-8303-91f7f52d9665`::finished: {'devList': [{'status': 'used', 'fwrev': '0532', 'vgUUID': 'q1Ti6I-DtOH-esyj-Uw96-9q6N-g7aG-Im8HXG', 'pathlist': [{'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'portal': '3', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'portal': '4', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'portal': '2', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '512', 'serial': 'SDGC_RAID_5_CKM00121000438', 'GUID': '360060160128230005ddddcba33f2e311', 'productID': 'RAID 5', 'vendorID': 'DGC', 'capacity': '42949672960', 'pathstatus': [{'physdev': 'sdi', 'type': 'iSCSI', 'state': 'active', 'lun': '2'}, {'physdev': 'sdj', 'type': 'iSCSI', 'state': 'active', 'lun': '2'}, {'physdev': 'sdp', 'type': 'iSCSI', 'state': 'active', 'lun': '2'}, {'physdev': 'sdr', 'type': 'iSCSI', 'state': 'active', 'lun': '2'}], 'pvUUID': 'NINprB-qg5p-FSDG-0urq-ZMEL-FF3x-zmNcEt'}, {'status': 'used', 'fwrev': '0532', 'vgUUID': 'bUAcOY-KqCt-LwKi-umki-Qper-ly0Q-yUFBp7', 'pathlist': [{'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'portal': '2', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'portal': '4', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'portal': '3', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '512', 'serial': 'SDGC_RAID_5_CKM00121000438', 'GUID': '360060160128230005cdddcba33f2e311', 'productID': 'RAID 5', 'vendorID': 'DGC', 'capacity': '42949672960', 'pathstatus': [{'physdev': 'sdk', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}, {'physdev': 'sdh', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}, {'physdev': 'sdf', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}, {'physdev': 'sdg', 'type': 'iSCSI', 'state': 'active', 'lun': '1'}], 'pvUUID': '1Ok1iN-ZV9J-dwi8-NMYp-wYN1-9Pq9-cG33qe'}, {'status': 'free', 'fwrev': '0532', 'vgUUID': '', 'pathlist': [{'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'portal': '2', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'portal': '4', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'portal': '3', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '512', 'serial': 'SDGC_RAID_5_CKM00121000438', 'GUID': '360060160128230005edddcba33f2e311', 'productID': 'RAID 5', 'vendorID': 'DGC', 'capacity': '42949672960', 'pathstatus': [{'physdev': 'sdt', 'type': 'iSCSI', 'state': 'active', 'lun': '3'}, {'physdev': 'sdq', 'type': 'iSCSI', 'state': 'active', 'lun': '3'}, {'physdev': 'sdm', 'type': 'iSCSI', 'state': 'active', 'lun': '3'}, {'physdev': 'sdl', 'type': 'iSCSI', 'state': 'active', 'lun': '3'}], 'pvUUID': 'iCiCW9-ksd2-Rre8-2roW-iag8-op69-RzMsND'}, {'status': 'used', 'fwrev': '0532', 'vgUUID': 'XFiHaU-cCDH-l4Dl-hMDk-oWT2-cAxg-jlN1Ut', 'pathlist': [{'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'portal': '3', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'portal': '2', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'portal': '4', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '512', 'serial': 'SDGC_RAID_5_CKM00121000438', 'GUID': '360060160128230005fdddcba33f2e311', 'productID': 'RAID 5', 'vendorID': 'DGC', 'capacity': '42949672960', 'pathstatus': [{'physdev': 'sdo', 'type': 'iSCSI', 'state': 'active', 'lun': '4'}, {'physdev': 'sdu', 'type': 'iSCSI', 'state': 'active', 'lun': '4'}, {'physdev': 'sds', 'type': 'iSCSI', 'state': 'active', 'lun': '4'}, {'physdev': 'sdn', 'type': 'iSCSI', 'state': 'active', 'lun': '4'}], 'pvUUID': 'XfFcQG-yjFo-1O8x-mXK2-yylJ-30PY-2R6By7'}, {'status': 'free', 'fwrev': '0532', 'vgUUID': '', 'pathlist': [{'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'portal': '3', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'portal': '2', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'portal': '4', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'logicalblocksize': '512', 'devtype': 'iSCSI', 'physicalblocksize': '512', 'serial': 'SDGC_RAID_5_CKM00121000438', 'GUID': '3600601601282300060dddcba33f2e311', 'productID': 'RAID 5', 'vendorID': 'DGC', 'capacity': '42949672960', 'pathstatus': [{'physdev': 'sdd', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}, {'physdev': 'sdc', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}, {'physdev': 'sde', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}, {'physdev': 'sdb', 'type': 'iSCSI', 'state': 'active', 'lun': '0'}], 'pvUUID': 'S30hJn-U2MX-Pvf9-WyCo-inNs-eRrJ-f9FjpC'}]} >Thread-13::DEBUG::2014-07-24 10:20:13,490::task::595::TaskManager.Task::(_updateState) Task=`f25f530a-d047-489a-8303-91f7f52d9665`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:20:13,490::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:20:13,490::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:20:13,491::task::990::TaskManager.Task::(_decref) Task=`f25f530a-d047-489a-8303-91f7f52d9665`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:20:13,655::task::595::TaskManager.Task::(_updateState) Task=`208b23e4-4922-4982-90f6-5766c87ffa94`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:20:13,655::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:20:13,655::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:20:13,655::task::1185::TaskManager.Task::(prepare) Task=`208b23e4-4922-4982-90f6-5766c87ffa94`::finished: {} >Thread-13::DEBUG::2014-07-24 10:20:13,656::task::595::TaskManager.Task::(_updateState) Task=`208b23e4-4922-4982-90f6-5766c87ffa94`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:20:13,656::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:20:13,656::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:20:13,656::task::990::TaskManager.Task::(_decref) Task=`208b23e4-4922-4982-90f6-5766c87ffa94`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:20:22,642::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [7b39f3f3] >Thread-13::DEBUG::2014-07-24 10:20:22,643::task::595::TaskManager.Task::(_updateState) Task=`21443e3d-16cd-43de-b00f-19f4d36cee96`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:20:22,643::logUtils::44::dispatcher::(wrapper) Run and protect: createVG(vgname='23aa0606-edc3-4882-a4aa-18aa1983458f', devlist=['360060160128230005ddddcba33f2e311'], force=True, options=None) >Thread-13::DEBUG::2014-07-24 10:20:22,645::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " -y -ff --metadatasize 128m --metadatacopies 2 --metadataignore y /dev/mapper/360060160128230005ddddcba33f2e311' (cwd None) >Thread-13::DEBUG::2014-07-24 10:20:22,865::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: Forcing physical volume creation on /dev/mapper/360060160128230005ddddcba33f2e311 of volume group "c3537562-9170-4f1f-8007-34aca9f16fc8"\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:20:22,865::lvm::491::OperationMutex::(_invalidatepvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:22,865::lvm::494::OperationMutex::(_invalidatepvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:22,866::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --metadataignore n /dev/mapper/360060160128230005ddddcba33f2e311' (cwd None) >Thread-13::DEBUG::2014-07-24 10:20:23,049::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:20:23,051::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --physicalextentsize 128m --addtag RHAT_storage_domain_UNREADY 23aa0606-edc3-4882-a4aa-18aa1983458f /dev/mapper/360060160128230005ddddcba33f2e311' (cwd None) >Thread-13::DEBUG::2014-07-24 10:20:23,314::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:20:23,316::lvm::491::OperationMutex::(_invalidatepvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:23,317::lvm::494::OperationMutex::(_invalidatepvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:23,317::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:23,317::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:23,318::lvm::931::Storage.LVM::(createVG) Cache after createvg {'23aa0606-edc3-4882-a4aa-18aa1983458f': Stub(name='23aa0606-edc3-4882-a4aa-18aa1983458f', stale=True)} >Thread-13::DEBUG::2014-07-24 10:20:23,318::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:23,319::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-13::DEBUG::2014-07-24 10:20:23,516::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:20:23,517::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-13::INFO::2014-07-24 10:20:23,518::logUtils::47::dispatcher::(wrapper) Run and protect: createVG, Return response: {'uuid': 'NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs'} >Thread-13::DEBUG::2014-07-24 10:20:23,518::task::1185::TaskManager.Task::(prepare) Task=`21443e3d-16cd-43de-b00f-19f4d36cee96`::finished: {'uuid': 'NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs'} >Thread-13::DEBUG::2014-07-24 10:20:23,518::task::595::TaskManager.Task::(_updateState) Task=`21443e3d-16cd-43de-b00f-19f4d36cee96`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:20:23,518::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:20:23,518::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:20:23,519::task::990::TaskManager.Task::(_decref) Task=`21443e3d-16cd-43de-b00f-19f4d36cee96`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:20:23,578::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [7b39f3f3] >Thread-13::DEBUG::2014-07-24 10:20:23,579::task::595::TaskManager.Task::(_updateState) Task=`535742bc-355f-440c-a2ce-f24a5685593f`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:20:23,579::logUtils::44::dispatcher::(wrapper) Run and protect: createStorageDomain(storageType=3, sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', domainName='ISCSI', typeSpecificArg='NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', domClass=1, domVersion='3', options=None) >Thread-13::ERROR::2014-07-24 10:20:23,579::sdc::137::Storage.StorageDomainCache::(_findDomain) looking for unfetched domain 23aa0606-edc3-4882-a4aa-18aa1983458f >Thread-13::ERROR::2014-07-24 10:20:23,579::sdc::154::Storage.StorageDomainCache::(_findUnfetchedDomain) looking for domain 23aa0606-edc3-4882-a4aa-18aa1983458f >Thread-13::ERROR::2014-07-24 10:20:23,581::sdc::143::Storage.StorageDomainCache::(_findDomain) domain 23aa0606-edc3-4882-a4aa-18aa1983458f not found >Traceback (most recent call last): > File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain > dom = findMethod(sdUUID) > File "/usr/share/vdsm/storage/sdc.py", line 171, in _findUnfetchedDomain > raise se.StorageDomainDoesNotExist(sdUUID) >StorageDomainDoesNotExist: Storage domain does not exist: ('23aa0606-edc3-4882-a4aa-18aa1983458f',) >Thread-13::INFO::2014-07-24 10:20:23,581::blockSD::488::Storage.StorageDomain::(create) sdUUID=23aa0606-edc3-4882-a4aa-18aa1983458f domainName=ISCSI domClass=1 vgUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs storageType=3 version=3 >Thread-13::DEBUG::2014-07-24 10:20:23,582::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:23,582::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >Thread-13::DEBUG::2014-07-24 10:20:23,773::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:20:23,775::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:23,776::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:23,776::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-13::DEBUG::2014-07-24 10:20:23,926::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:20:23,927::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-13::DEBUG::2014-07-24 10:20:23,927::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-13::INFO::2014-07-24 10:20:23,934::blockSD::472::Storage.StorageDomain::(metaSize) size 512 MB (metaratio 262144) >Thread-13::DEBUG::2014-07-24 10:20:23,934::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 512m --name metadata 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-13::DEBUG::2014-07-24 10:20:24,155::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:20:24,156::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:24,156::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:24,156::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:24,157::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:24,157::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:24,158::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-13::DEBUG::2014-07-24 10:20:24,325::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:20:24,326::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-13::DEBUG::2014-07-24 10:20:24,326::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:24,326::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:24,327::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-13::DEBUG::2014-07-24 10:20:24,498::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:20:24,499::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-13::INFO::2014-07-24 10:20:24,499::blockSD::660::Storage.StorageDomain::(getMetaDataMapping) Create: SORT MAPPING: ['/dev/mapper/360060160128230005ddddcba33f2e311'] >Thread-13::DEBUG::2014-07-24 10:20:24,500::lvm::325::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:24,500::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size /dev/mapper/360060160128230005ddddcba33f2e311' (cwd None) >Thread-13::DEBUG::2014-07-24 10:20:24,674::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:20:24,675::lvm::350::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:24,676::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 16m --name outbox 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-13::DEBUG::2014-07-24 10:20:24,899::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:20:24,899::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:24,899::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:24,899::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:24,900::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:24,900::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 2048m --name leases 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-13::DEBUG::2014-07-24 10:20:25,107::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:20:25,108::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:25,108::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:25,108::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:25,109::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:25,109::lvm::1080::Storage.Misc.excCmd::(createLV) '/usr/bin/sudo -n /bin/chown vdsm:qemu /dev/23aa0606-edc3-4882-a4aa-18aa1983458f/leases' (cwd None) >Thread-13::DEBUG::2014-07-24 10:20:25,122::lvm::1080::Storage.Misc.excCmd::(createLV) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:20:25,123::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 8m --name ids 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-13::DEBUG::2014-07-24 10:20:25,338::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:20:25,338::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:25,339::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:25,339::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:25,339::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:25,340::lvm::1080::Storage.Misc.excCmd::(createLV) '/usr/bin/sudo -n /bin/chown vdsm:qemu /dev/23aa0606-edc3-4882-a4aa-18aa1983458f/ids' (cwd None) >Thread-13::DEBUG::2014-07-24 10:20:25,353::lvm::1080::Storage.Misc.excCmd::(createLV) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:20:25,354::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 16m --name inbox 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-13::DEBUG::2014-07-24 10:20:25,578::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:20:25,578::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:25,578::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:25,579::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:25,579::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:25,580::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --name master 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-13::DEBUG::2014-07-24 10:20:25,785::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:20:25,786::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:25,786::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:25,786::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:25,787::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:25,787::lvm::1080::Storage.Misc.excCmd::(createLV) '/usr/bin/sudo -n /bin/chown vdsm:qemu /dev/23aa0606-edc3-4882-a4aa-18aa1983458f/master' (cwd None) >Thread-13::DEBUG::2014-07-24 10:20:25,800::lvm::1080::Storage.Misc.excCmd::(createLV) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:20:25,801::blockSD::1346::Storage.Misc.excCmd::(_createVMSfs) '/usr/bin/sudo -n /sbin/mkfs -q -j -E nodiscard /dev/23aa0606-edc3-4882-a4aa-18aa1983458f/master' (cwd None) >Thread-13::DEBUG::2014-07-24 10:20:26,662::blockSD::1346::Storage.Misc.excCmd::(_createVMSfs) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:20:26,663::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n 23aa0606-edc3-4882-a4aa-18aa1983458f/master' (cwd None) >Thread-13::DEBUG::2014-07-24 10:20:26,854::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:20:26,854::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:26,854::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:26,855::blockSD::539::Storage.Misc.excCmd::(create) '/bin/nice -n 19 /usr/bin/ionice -c 3 /bin/dd if=/dev/zero of=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata bs=1048576 seek=0 skip=0 conv=notrunc count=40 oflag=direct' (cwd None) >Thread-13::DEBUG::2014-07-24 10:20:27,503::blockSD::539::Storage.Misc.excCmd::(create) SUCCESS: <err> = '40+0 records in\n40+0 records out\n41943040 bytes (42 MB) copied, 0.640332 s, 65.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:20:27,503::misc::264::Storage.Misc::(validateDDBytes) err: ['40+0 records in', '40+0 records out', '41943040 bytes (42 MB) copied, 0.640332 s, 65.5 MB/s'], size: 41943040 >Thread-13::DEBUG::2014-07-24 10:20:27,503::blockSD::541::Storage.Misc.excCmd::(create) '/bin/nice -n 19 /usr/bin/ionice -c 3 /bin/dd if=/dev/zero of=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/inbox bs=1024000 seek=0 skip=0 conv=notrunc count=1 oflag=direct' (cwd None) >Thread-13::DEBUG::2014-07-24 10:20:27,520::blockSD::541::Storage.Misc.excCmd::(create) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0102187 s, 100 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:20:27,520::misc::264::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '1024000 bytes (1.0 MB) copied, 0.0102187 s, 100 MB/s'], size: 1024000 >Thread-13::DEBUG::2014-07-24 10:20:27,521::blockSD::543::Storage.Misc.excCmd::(create) '/bin/nice -n 19 /usr/bin/ionice -c 3 /bin/dd if=/dev/zero of=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/outbox bs=1024000 seek=0 skip=0 conv=notrunc count=1 oflag=direct' (cwd None) >Thread-13::DEBUG::2014-07-24 10:20:27,537::blockSD::543::Storage.Misc.excCmd::(create) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.010285 s, 99.6 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:20:27,537::misc::264::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '1024000 bytes (1.0 MB) copied, 0.010285 s, 99.6 MB/s'], size: 1024000 >Thread-13::DEBUG::2014-07-24 10:20:27,538::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-13::DEBUG::2014-07-24 10:20:27,538::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:27,539::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-13::DEBUG::2014-07-24 10:20:27,705::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:20:27,706::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:27,707::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:27,707::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:27,707::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:27,708::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:27,708::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:27,708::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-13::DEBUG::2014-07-24 10:20:27,878::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:20:27,879::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:27,879::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=[] >Thread-13::WARNING::2014-07-24 10:20:27,879::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-13::DEBUG::2014-07-24 10:20:27,879::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-13::DEBUG::2014-07-24 10:20:27,879::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-13::DEBUG::2014-07-24 10:20:27,880::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=ISCSI', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'PHYBLKSIZE=512', 'POOL_UUID=', 'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'ROLE=Regular', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', '_SHA_CKSUM=37794de8480bb16c68ca2d238d29ce64d44a92fc'] >Thread-13::DEBUG::2014-07-24 10:20:27,880::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:27,880::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:27,880::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:27,881::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:27,881::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:27,881::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-13::DEBUG::2014-07-24 10:20:28,054::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:20:28,058::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:28,058::blockSD::315::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT_PHYBLKSIZE=512, MDT_SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f, MDT__SHA_CKSUM=37794de8480bb16c68ca2d238d29ce64d44a92fc, MDT_POOL_UUID=, MDT_LEASERETRIES=3, MDT_CLASS=Data, MDT_IOOPTIMEOUTSEC=10, MDT_VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs, MDT_LOCKRENEWALINTERVALSEC=5, MDT_LOGBLKSIZE=512, MDT_LEASETIMESEC=60, MDT_PV0=pv:360060160128230005ddddcba33f2e311&44&uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw&44&pestart:0&44&pecount:317&44&mapoffset:0, MDT_VERSION=3, MDT_DESCRIPTION=ISCSI, MDT_TYPE=ISCSI, MDT_ROLE=Regular, MDT_LOCKPOLICY= removing= >Thread-13::DEBUG::2014-07-24 10:20:28,059::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --addtag MDT_LEASETIMESEC=60 --addtag MDT_CLASS=Data --addtag MDT_VERSION=3 --addtag MDT_TYPE=ISCSI --addtag MDT_DESCRIPTION=ISCSI --addtag MDT__SHA_CKSUM=37794de8480bb16c68ca2d238d29ce64d44a92fc --addtag MDT_LEASERETRIES=3 --addtag MDT_IOOPTIMEOUTSEC=10 --addtag MDT_LOCKRENEWALINTERVALSEC=5 --addtag MDT_ROLE=Regular --addtag MDT_PHYBLKSIZE=512 --addtag MDT_LOGBLKSIZE=512 --addtag MDT_VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs --addtag MDT_PV0=pv:360060160128230005ddddcba33f2e311&44&uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw&44&pestart:0&44&pecount:317&44&mapoffset:0 --addtag MDT_POOL_UUID= --addtag MDT_SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f --addtag MDT_LOCKPOLICY= 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-13::DEBUG::2014-07-24 10:20:28,284::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:20:28,285::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:28,285::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:28,285::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-13::DEBUG::2014-07-24 10:20:28,286::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --deltag RHAT_storage_domain_UNREADY --addtag RHAT_storage_domain 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-13::DEBUG::2014-07-24 10:20:28,562::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:20:28,562::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:28,562::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:28,563::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-13::DEBUG::2014-07-24 10:20:28,563::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata count=1' (cwd None) >Thread-13::DEBUG::2014-07-24 10:20:28,570::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000518282 s, 4.0 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:20:28,570::misc::264::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000518282 s, 4.0 MB/s'], size: 2048 >Thread-13::DEBUG::2014-07-24 10:20:28,570::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-13::WARNING::2014-07-24 10:20:28,570::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-13::DEBUG::2014-07-24 10:20:28,571::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-13::DEBUG::2014-07-24 10:20:28,571::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:28,571::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:28,571::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:28,572::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:28,572::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:28,572::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-13::DEBUG::2014-07-24 10:20:28,779::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:20:28,780::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:28,781::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=ISCSI', '_SHA_CKSUM=37794de8480bb16c68ca2d238d29ce64d44a92fc', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'POOL_UUID=', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'LOCKPOLICY='] >Thread-13::DEBUG::2014-07-24 10:20:28,782::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y 23aa0606-edc3-4882-a4aa-18aa1983458f/master' (cwd None) >Thread-13::DEBUG::2014-07-24 10:20:28,996::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:20:28,996::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:28,996::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-13::DEBUG::2014-07-24 10:20:28,997::resourceManager::421::ResourceManager::(registerNamespace) Registering namespace '23aa0606-edc3-4882-a4aa-18aa1983458f_imageNS' >Thread-13::DEBUG::2014-07-24 10:20:28,997::resourceManager::421::ResourceManager::(registerNamespace) Registering namespace '23aa0606-edc3-4882-a4aa-18aa1983458f_volumeNS' >Thread-13::DEBUG::2014-07-24 10:20:28,998::resourceManager::421::ResourceManager::(registerNamespace) Registering namespace '23aa0606-edc3-4882-a4aa-18aa1983458f_lvmActivationNS' >Thread-13::DEBUG::2014-07-24 10:20:28,998::clusterlock::144::initSANLock::(initSANLock) Initializing SANLock for domain 23aa0606-edc3-4882-a4aa-18aa1983458f >Thread-14::DEBUG::2014-07-24 10:20:29,016::task::595::TaskManager.Task::(_updateState) Task=`c761c770-dab5-48b9-8706-a8b7921da8d8`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:20:29,016::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:20:29,017::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-14::DEBUG::2014-07-24 10:20:29,017::task::1185::TaskManager.Task::(prepare) Task=`c761c770-dab5-48b9-8706-a8b7921da8d8`::finished: {} >Thread-14::DEBUG::2014-07-24 10:20:29,017::task::595::TaskManager.Task::(_updateState) Task=`c761c770-dab5-48b9-8706-a8b7921da8d8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:20:29,018::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:20:29,018::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:20:29,018::task::990::TaskManager.Task::(_decref) Task=`c761c770-dab5-48b9-8706-a8b7921da8d8`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:20:29,021::sd::434::Storage.StorageDomain::(initSPMlease) lease initialized successfully >Thread-13::DEBUG::2014-07-24 10:20:29,022::hsm::2647::Storage.HSM::(createStorageDomain) knownSDs: {23aa0606-edc3-4882-a4aa-18aa1983458f: storage.blockSD.findDomain} >Thread-13::INFO::2014-07-24 10:20:29,023::logUtils::47::dispatcher::(wrapper) Run and protect: createStorageDomain, Return response: None >Thread-13::DEBUG::2014-07-24 10:20:29,024::task::1185::TaskManager.Task::(prepare) Task=`535742bc-355f-440c-a2ce-f24a5685593f`::finished: None >Thread-13::DEBUG::2014-07-24 10:20:29,025::task::595::TaskManager.Task::(_updateState) Task=`535742bc-355f-440c-a2ce-f24a5685593f`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:20:29,026::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:20:29,026::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:20:29,027::task::990::TaskManager.Task::(_decref) Task=`535742bc-355f-440c-a2ce-f24a5685593f`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:20:29,175::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [7b39f3f3] >Thread-14::DEBUG::2014-07-24 10:20:29,175::task::595::TaskManager.Task::(_updateState) Task=`f02b14b9-5ca5-4165-bd71-bc189c86e8b5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:20:29,176::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainStats(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', options=None) >Thread-14::DEBUG::2014-07-24 10:20:29,176::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.23aa0606-edc3-4882-a4aa-18aa1983458f`ReqID=`f81971ea-d753-47cb-9de2-92fb900c85de`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2786' at 'getStorageDomainStats' >Thread-14::DEBUG::2014-07-24 10:20:29,176::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f' for lock type 'shared' >Thread-14::DEBUG::2014-07-24 10:20:29,176::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f' is free. Now locking as 'shared' (1 active user) >Thread-14::DEBUG::2014-07-24 10:20:29,177::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.23aa0606-edc3-4882-a4aa-18aa1983458f`ReqID=`f81971ea-d753-47cb-9de2-92fb900c85de`::Granted request >Thread-14::DEBUG::2014-07-24 10:20:29,177::task::827::TaskManager.Task::(resourceAcquired) Task=`f02b14b9-5ca5-4165-bd71-bc189c86e8b5`::_resourcesAcquired: Storage.23aa0606-edc3-4882-a4aa-18aa1983458f (shared) >Thread-14::DEBUG::2014-07-24 10:20:29,178::task::990::TaskManager.Task::(_decref) Task=`f02b14b9-5ca5-4165-bd71-bc189c86e8b5`::ref 1 aborting False >Thread-14::DEBUG::2014-07-24 10:20:29,180::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:29,180::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:29,180::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:29,180::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:29,181::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-14::DEBUG::2014-07-24 10:20:29,181::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata count=1' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:29,187::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000587315 s, 3.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:29,188::misc::264::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000587315 s, 3.5 MB/s'], size: 2048 >Thread-14::DEBUG::2014-07-24 10:20:29,188::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-14::WARNING::2014-07-24 10:20:29,188::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-14::DEBUG::2014-07-24 10:20:29,188::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-14::DEBUG::2014-07-24 10:20:29,188::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:29,189::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:29,359::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:29,360::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::INFO::2014-07-24 10:20:29,360::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainStats, Return response: {'stats': {'mdasize': '134217728', 'mdathreshold': True, 'mdavalid': True, 'diskfree': '38386270208', 'disktotal': '42547019776', 'mdafree': '67104768'}} >Thread-14::DEBUG::2014-07-24 10:20:29,360::task::1185::TaskManager.Task::(prepare) Task=`f02b14b9-5ca5-4165-bd71-bc189c86e8b5`::finished: {'stats': {'mdasize': '134217728', 'mdathreshold': True, 'mdavalid': True, 'diskfree': '38386270208', 'disktotal': '42547019776', 'mdafree': '67104768'}} >Thread-14::DEBUG::2014-07-24 10:20:29,361::task::595::TaskManager.Task::(_updateState) Task=`f02b14b9-5ca5-4165-bd71-bc189c86e8b5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:20:29,361::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f': < ResourceRef 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f', isValid: 'True' obj: 'None'>} >Thread-14::DEBUG::2014-07-24 10:20:29,361::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:20:29,361::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f' >Thread-14::DEBUG::2014-07-24 10:20:29,361::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f' (0 active users) >Thread-14::DEBUG::2014-07-24 10:20:29,362::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f' is free, finding out if anyone is waiting for it. >Thread-14::DEBUG::2014-07-24 10:20:29,362::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f', Clearing records. >Thread-14::DEBUG::2014-07-24 10:20:29,362::task::990::TaskManager.Task::(_decref) Task=`f02b14b9-5ca5-4165-bd71-bc189c86e8b5`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:20:29,422::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [7b39f3f3] >Thread-14::DEBUG::2014-07-24 10:20:29,422::task::595::TaskManager.Task::(_updateState) Task=`73e98301-af6e-4064-8f63-b6bd08f377ed`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:20:29,422::logUtils::44::dispatcher::(wrapper) Run and protect: getVGInfo(vgUUID='NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', options=None) >Thread-14::INFO::2014-07-24 10:20:29,474::logUtils::47::dispatcher::(wrapper) Run and protect: getVGInfo, Return response: {'info': {'state': 'OK', 'vgsize': '42547019776', 'name': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'vgfree': '38386270208', 'vgUUID': 'NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', 'pvlist': [{'vendorID': 'DGC', 'capacity': '42547019776', 'fwrev': '0000', 'vgUUID': 'NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', 'pathlist': [{'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'portal': '3', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'portal': '4', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'portal': '2', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sdi', 'type': 'iSCSI', 'state': 'active', 'lun': '2'}, {'physdev': 'sdj', 'type': 'iSCSI', 'state': 'active', 'lun': '2'}, {'physdev': 'sdp', 'type': 'iSCSI', 'state': 'active', 'lun': '2'}, {'physdev': 'sdr', 'type': 'iSCSI', 'state': 'active', 'lun': '2'}], 'devtype': 'iSCSI', 'pvUUID': 'ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw', 'serial': 'SDGC_RAID_5_CKM00121000438', 'GUID': '360060160128230005ddddcba33f2e311', 'devcapacity': '42949672960', 'productID': 'RAID 5'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}}} >Thread-14::DEBUG::2014-07-24 10:20:29,475::task::1185::TaskManager.Task::(prepare) Task=`73e98301-af6e-4064-8f63-b6bd08f377ed`::finished: {'info': {'state': 'OK', 'vgsize': '42547019776', 'name': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'vgfree': '38386270208', 'vgUUID': 'NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', 'pvlist': [{'vendorID': 'DGC', 'capacity': '42547019776', 'fwrev': '0000', 'vgUUID': 'NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', 'pathlist': [{'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'portal': '3', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'portal': '4', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'portal': '2', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sdi', 'type': 'iSCSI', 'state': 'active', 'lun': '2'}, {'physdev': 'sdj', 'type': 'iSCSI', 'state': 'active', 'lun': '2'}, {'physdev': 'sdp', 'type': 'iSCSI', 'state': 'active', 'lun': '2'}, {'physdev': 'sdr', 'type': 'iSCSI', 'state': 'active', 'lun': '2'}], 'devtype': 'iSCSI', 'pvUUID': 'ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw', 'serial': 'SDGC_RAID_5_CKM00121000438', 'GUID': '360060160128230005ddddcba33f2e311', 'devcapacity': '42949672960', 'productID': 'RAID 5'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}}} >Thread-14::DEBUG::2014-07-24 10:20:29,475::task::595::TaskManager.Task::(_updateState) Task=`73e98301-af6e-4064-8f63-b6bd08f377ed`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:20:29,475::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:20:29,475::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:20:29,475::task::990::TaskManager.Task::(_decref) Task=`73e98301-af6e-4064-8f63-b6bd08f377ed`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:20:30,828::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [22415ce8] >Thread-14::DEBUG::2014-07-24 10:20:30,830::task::595::TaskManager.Task::(_updateState) Task=`4f4ae5cb-31a9-4a88-8c7c-ffe4989f0558`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:20:30,832::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='637ea13c-81a8-4b44-8cab-961458b01883', conList=[{'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'user': '', 'tpgt': '4', 'password': '******', 'id': '1bc690b4-6656-40a4-8d35-914c7114052a', 'port': '3260'}, {'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'user': '', 'tpgt': '3', 'password': '******', 'id': '49335d7a-3418-4b02-90f8-d512eddbac73', 'port': '3260'}, {'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'user': '', 'tpgt': '1', 'password': '******', 'id': '9fdc4ae2-f9a0-4b01-bea6-e968aa130382', 'port': '3260'}, {'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'user': '', 'tpgt': '2', 'password': '******', 'id': 'c7c16a5e-4fcb-4f17-a04c-62c3bd3ea404', 'port': '3260'}], options=None) >Thread-14::DEBUG::2014-07-24 10:20:30,835::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b7 -I default -p 10.35.160.107:3260,4 --op=new' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:30,853::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:30,861::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b7 -I default -p 10.35.160.107:3260,4 -l' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:30,879::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:30,879::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b7 -I default -p 10.35.160.107:3260,4 -n node.startup -v manual --op=update' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:30,893::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:30,893::hsm::2352::Storage.HSM::(__prefetchDomains) Found SD uuids: ('23aa0606-edc3-4882-a4aa-18aa1983458f',) >Thread-14::DEBUG::2014-07-24 10:20:30,893::hsm::2408::Storage.HSM::(connectStorageServer) knownSDs: {23aa0606-edc3-4882-a4aa-18aa1983458f: storage.blockSD.findDomain} >Thread-14::DEBUG::2014-07-24 10:20:30,894::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b6 -I default -p 10.35.160.106:3260,3 --op=new' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:30,907::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:30,908::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b6 -I default -p 10.35.160.106:3260,3 -l' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:30,925::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:30,934::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b6 -I default -p 10.35.160.106:3260,3 -n node.startup -v manual --op=update' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:30,948::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:30,948::hsm::2352::Storage.HSM::(__prefetchDomains) Found SD uuids: ('23aa0606-edc3-4882-a4aa-18aa1983458f',) >Thread-14::DEBUG::2014-07-24 10:20:30,948::hsm::2408::Storage.HSM::(connectStorageServer) knownSDs: {23aa0606-edc3-4882-a4aa-18aa1983458f: storage.blockSD.findDomain} >Thread-14::DEBUG::2014-07-24 10:20:30,949::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a6 -I default -p 10.35.160.104:3260,1 --op=new' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:30,963::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:30,963::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a6 -I default -p 10.35.160.104:3260,1 -l' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:30,979::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:30,979::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a6 -I default -p 10.35.160.104:3260,1 -n node.startup -v manual --op=update' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:30,993::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:30,993::hsm::2352::Storage.HSM::(__prefetchDomains) Found SD uuids: ('23aa0606-edc3-4882-a4aa-18aa1983458f',) >Thread-14::DEBUG::2014-07-24 10:20:30,994::hsm::2408::Storage.HSM::(connectStorageServer) knownSDs: {23aa0606-edc3-4882-a4aa-18aa1983458f: storage.blockSD.findDomain} >Thread-14::DEBUG::2014-07-24 10:20:30,994::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a7 -I default -p 10.35.160.105:3260,2 --op=new' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:31,014::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:31,015::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a7 -I default -p 10.35.160.105:3260,2 -l' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:31,032::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:31,033::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a7 -I default -p 10.35.160.105:3260,2 -n node.startup -v manual --op=update' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:31,046::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:31,047::hsm::2352::Storage.HSM::(__prefetchDomains) Found SD uuids: ('23aa0606-edc3-4882-a4aa-18aa1983458f',) >Thread-14::DEBUG::2014-07-24 10:20:31,047::hsm::2408::Storage.HSM::(connectStorageServer) knownSDs: {23aa0606-edc3-4882-a4aa-18aa1983458f: storage.blockSD.findDomain} >Thread-14::INFO::2014-07-24 10:20:31,047::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '1bc690b4-6656-40a4-8d35-914c7114052a'}, {'status': 0, 'id': '49335d7a-3418-4b02-90f8-d512eddbac73'}, {'status': 0, 'id': '9fdc4ae2-f9a0-4b01-bea6-e968aa130382'}, {'status': 0, 'id': 'c7c16a5e-4fcb-4f17-a04c-62c3bd3ea404'}]} >Thread-14::DEBUG::2014-07-24 10:20:31,048::task::1185::TaskManager.Task::(prepare) Task=`4f4ae5cb-31a9-4a88-8c7c-ffe4989f0558`::finished: {'statuslist': [{'status': 0, 'id': '1bc690b4-6656-40a4-8d35-914c7114052a'}, {'status': 0, 'id': '49335d7a-3418-4b02-90f8-d512eddbac73'}, {'status': 0, 'id': '9fdc4ae2-f9a0-4b01-bea6-e968aa130382'}, {'status': 0, 'id': 'c7c16a5e-4fcb-4f17-a04c-62c3bd3ea404'}]} >Thread-14::DEBUG::2014-07-24 10:20:31,048::task::595::TaskManager.Task::(_updateState) Task=`4f4ae5cb-31a9-4a88-8c7c-ffe4989f0558`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:20:31,048::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:20:31,048::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:20:31,048::task::990::TaskManager.Task::(_decref) Task=`4f4ae5cb-31a9-4a88-8c7c-ffe4989f0558`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:20:31,129::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [2b2525ca] >Thread-14::DEBUG::2014-07-24 10:20:31,129::task::595::TaskManager.Task::(_updateState) Task=`26bd2a07-6204-408d-aeaa-791f5053d1e4`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:20:31,129::logUtils::44::dispatcher::(wrapper) Run and protect: getVGInfo(vgUUID='NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', options=None) >Thread-14::INFO::2014-07-24 10:20:31,155::logUtils::47::dispatcher::(wrapper) Run and protect: getVGInfo, Return response: {'info': {'state': 'OK', 'vgsize': '42547019776', 'name': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'vgfree': '38386270208', 'vgUUID': 'NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', 'pvlist': [{'vendorID': 'DGC', 'capacity': '42547019776', 'fwrev': '0000', 'vgUUID': 'NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', 'pathlist': [{'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'portal': '3', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'portal': '4', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'portal': '2', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sdi', 'type': 'iSCSI', 'state': 'active', 'lun': '2'}, {'physdev': 'sdj', 'type': 'iSCSI', 'state': 'active', 'lun': '2'}, {'physdev': 'sdp', 'type': 'iSCSI', 'state': 'active', 'lun': '2'}, {'physdev': 'sdr', 'type': 'iSCSI', 'state': 'active', 'lun': '2'}], 'devtype': 'iSCSI', 'pvUUID': 'ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw', 'serial': 'SDGC_RAID_5_CKM00121000438', 'GUID': '360060160128230005ddddcba33f2e311', 'devcapacity': '42949672960', 'productID': 'RAID 5'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}}} >Thread-14::DEBUG::2014-07-24 10:20:31,155::task::1185::TaskManager.Task::(prepare) Task=`26bd2a07-6204-408d-aeaa-791f5053d1e4`::finished: {'info': {'state': 'OK', 'vgsize': '42547019776', 'name': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'vgfree': '38386270208', 'vgUUID': 'NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', 'pvlist': [{'vendorID': 'DGC', 'capacity': '42547019776', 'fwrev': '0000', 'vgUUID': 'NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', 'pathlist': [{'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'portal': '3', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'portal': '4', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'portal': '2', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sdi', 'type': 'iSCSI', 'state': 'active', 'lun': '2'}, {'physdev': 'sdj', 'type': 'iSCSI', 'state': 'active', 'lun': '2'}, {'physdev': 'sdp', 'type': 'iSCSI', 'state': 'active', 'lun': '2'}, {'physdev': 'sdr', 'type': 'iSCSI', 'state': 'active', 'lun': '2'}], 'devtype': 'iSCSI', 'pvUUID': 'ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw', 'serial': 'SDGC_RAID_5_CKM00121000438', 'GUID': '360060160128230005ddddcba33f2e311', 'devcapacity': '42949672960', 'productID': 'RAID 5'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}}} >Thread-14::DEBUG::2014-07-24 10:20:31,155::task::595::TaskManager.Task::(_updateState) Task=`26bd2a07-6204-408d-aeaa-791f5053d1e4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:20:31,155::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:20:31,156::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:20:31,156::task::990::TaskManager.Task::(_decref) Task=`26bd2a07-6204-408d-aeaa-791f5053d1e4`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:20:31,335::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [2b2525ca] >Thread-14::DEBUG::2014-07-24 10:20:31,335::task::595::TaskManager.Task::(_updateState) Task=`07f91dd8-9d20-49b0-8415-89ea70115599`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:20:31,335::logUtils::44::dispatcher::(wrapper) Run and protect: createStoragePool(poolType=None, spUUID='637ea13c-81a8-4b44-8cab-961458b01883', poolName='DS1', masterDom='23aa0606-edc3-4882-a4aa-18aa1983458f', domList=['23aa0606-edc3-4882-a4aa-18aa1983458f'], masterVersion=1, lockPolicy=None, lockRenewalIntervalSec=5, leaseTimeSec=60, ioOpTimeoutSec=10, leaseRetries=3, options=None) >Thread-14::DEBUG::2014-07-24 10:20:31,335::misc::738::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-14::DEBUG::2014-07-24 10:20:31,335::misc::740::SamplingMethod::(__call__) Got in to sampling method >Thread-14::DEBUG::2014-07-24 10:20:31,336::misc::738::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-14::DEBUG::2014-07-24 10:20:31,336::misc::740::SamplingMethod::(__call__) Got in to sampling method >Thread-14::DEBUG::2014-07-24 10:20:31,336::iscsi::407::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-14::DEBUG::2014-07-24 10:20:31,336::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:31,361::misc::748::SamplingMethod::(__call__) Returning last result >Thread-14::DEBUG::2014-07-24 10:20:31,361::multipath::109::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:31,476::multipath::109::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:31,477::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:31,477::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:31,477::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:31,478::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:31,478::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:31,478::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:31,478::misc::748::SamplingMethod::(__call__) Returning last result >Thread-14::DEBUG::2014-07-24 10:20:31,478::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:31,481::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:31,656::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:31,657::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:31,658::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-14::DEBUG::2014-07-24 10:20:31,658::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata count=1' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:31,664::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000686388 s, 3.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:31,665::misc::264::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000686388 s, 3.0 MB/s'], size: 2048 >Thread-14::DEBUG::2014-07-24 10:20:31,665::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-14::WARNING::2014-07-24 10:20:31,665::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-14::DEBUG::2014-07-24 10:20:31,665::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-14::DEBUG::2014-07-24 10:20:31,665::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:31,666::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:31,666::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:31,666::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:31,666::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:31,667::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:31,841::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:31,842::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:31,843::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=ISCSI', '_SHA_CKSUM=37794de8480bb16c68ca2d238d29ce64d44a92fc', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'POOL_UUID=', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'LOCKPOLICY='] >Thread-14::INFO::2014-07-24 10:20:31,844::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_imageNS already registered >Thread-14::INFO::2014-07-24 10:20:31,844::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_volumeNS already registered >Thread-14::INFO::2014-07-24 10:20:31,844::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_lvmActivationNS already registered >Thread-14::INFO::2014-07-24 10:20:31,844::blockSD::846::Storage.StorageDomain::(validate) sdUUID=23aa0606-edc3-4882-a4aa-18aa1983458f >Thread-14::DEBUG::2014-07-24 10:20:31,845::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:31,994::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:31,994::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:31,994::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:31,994::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:31,995::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:31,995::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:31,996::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:32,163::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:32,164::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:32,165::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=ISCSI', '_SHA_CKSUM=37794de8480bb16c68ca2d238d29ce64d44a92fc', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'POOL_UUID=', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'LOCKPOLICY='] >Thread-14::DEBUG::2014-07-24 10:20:32,166::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d7ed8364-2ada-44fc-975a-742857ea87dd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '980' at 'createStoragePool' >Thread-14::DEBUG::2014-07-24 10:20:32,166::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'exclusive' >Thread-14::DEBUG::2014-07-24 10:20:32,166::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'exclusive' (1 active user) >Thread-14::DEBUG::2014-07-24 10:20:32,166::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d7ed8364-2ada-44fc-975a-742857ea87dd`::Granted request >Thread-14::DEBUG::2014-07-24 10:20:32,167::task::827::TaskManager.Task::(resourceAcquired) Task=`07f91dd8-9d20-49b0-8415-89ea70115599`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (exclusive) >Thread-14::DEBUG::2014-07-24 10:20:32,167::task::990::TaskManager.Task::(_decref) Task=`07f91dd8-9d20-49b0-8415-89ea70115599`::ref 1 aborting False >Thread-14::DEBUG::2014-07-24 10:20:32,167::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.23aa0606-edc3-4882-a4aa-18aa1983458f`ReqID=`9ef7f683-7a1e-46d1-871c-3392912a7c85`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '982' at 'createStoragePool' >Thread-14::DEBUG::2014-07-24 10:20:32,167::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f' for lock type 'exclusive' >Thread-14::DEBUG::2014-07-24 10:20:32,167::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f' is free. Now locking as 'exclusive' (1 active user) >Thread-14::DEBUG::2014-07-24 10:20:32,168::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.23aa0606-edc3-4882-a4aa-18aa1983458f`ReqID=`9ef7f683-7a1e-46d1-871c-3392912a7c85`::Granted request >Thread-14::DEBUG::2014-07-24 10:20:32,168::task::827::TaskManager.Task::(resourceAcquired) Task=`07f91dd8-9d20-49b0-8415-89ea70115599`::_resourcesAcquired: Storage.23aa0606-edc3-4882-a4aa-18aa1983458f (exclusive) >Thread-14::DEBUG::2014-07-24 10:20:32,168::task::990::TaskManager.Task::(_decref) Task=`07f91dd8-9d20-49b0-8415-89ea70115599`::ref 1 aborting False >Thread-14::INFO::2014-07-24 10:20:32,168::sp::133::Storage.StoragePool::(setBackend) updating pool 637ea13c-81a8-4b44-8cab-961458b01883 backend from type NoneType instance 0x7f8b82527210 to type StoragePoolDiskBackend instance 0x7f8b2814ccb0 >Thread-14::INFO::2014-07-24 10:20:32,169::sp::548::Storage.StoragePool::(create) spUUID=637ea13c-81a8-4b44-8cab-961458b01883 poolName=DS1 master_sd=23aa0606-edc3-4882-a4aa-18aa1983458f domList=['23aa0606-edc3-4882-a4aa-18aa1983458f'] masterVersion=1 {'LEASETIMESEC': 60, 'IOOPTIMEOUTSEC': 10, 'LEASERETRIES': 3, 'LOCKRENEWALINTERVALSEC': 5} >Thread-14::INFO::2014-07-24 10:20:32,169::blockSD::846::Storage.StorageDomain::(validate) sdUUID=23aa0606-edc3-4882-a4aa-18aa1983458f >Thread-14::DEBUG::2014-07-24 10:20:32,169::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:32,321::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:32,321::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:32,321::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:32,321::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:32,322::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:32,322::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:32,323::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:32,495::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:32,497::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:32,497::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=ISCSI', '_SHA_CKSUM=37794de8480bb16c68ca2d238d29ce64d44a92fc', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'POOL_UUID=', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'LOCKPOLICY='] >Thread-14::DEBUG::2014-07-24 10:20:32,498::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:32,498::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:32,498::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:32,498::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:32,498::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:32,499::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:32,670::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:32,671::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:32,671::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=ISCSI', '_SHA_CKSUM=37794de8480bb16c68ca2d238d29ce64d44a92fc', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'POOL_UUID=', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'LOCKPOLICY='] >Thread-14::DEBUG::2014-07-24 10:20:32,672::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-14::DEBUG::2014-07-24 10:20:32,672::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-14::INFO::2014-07-24 10:20:32,672::clusterlock::184::SANLock::(acquireHostId) Acquiring host id for domain 23aa0606-edc3-4882-a4aa-18aa1983458f (id: 250) >Thread-13::DEBUG::2014-07-24 10:20:44,705::task::595::TaskManager.Task::(_updateState) Task=`3817ab55-6531-44c6-a645-aeeb0b2e8606`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:20:44,705::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:20:44,705::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-13::DEBUG::2014-07-24 10:20:44,705::task::1185::TaskManager.Task::(prepare) Task=`3817ab55-6531-44c6-a645-aeeb0b2e8606`::finished: {} >Thread-13::DEBUG::2014-07-24 10:20:44,706::task::595::TaskManager.Task::(_updateState) Task=`3817ab55-6531-44c6-a645-aeeb0b2e8606`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:20:44,706::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:20:44,706::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:20:44,706::task::990::TaskManager.Task::(_decref) Task=`3817ab55-6531-44c6-a645-aeeb0b2e8606`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:20:53,678::clusterlock::202::SANLock::(acquireHostId) Host id for domain 23aa0606-edc3-4882-a4aa-18aa1983458f successfully acquired (id: 250) >Thread-14::WARNING::2014-07-24 10:20:53,679::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/23aa0606-edc3-4882-a4aa-18aa1983458f/images already exists >Thread-14::WARNING::2014-07-24 10:20:53,679::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/23aa0606-edc3-4882-a4aa-18aa1983458f/dom_md already exists >Thread-14::DEBUG::2014-07-24 10:20:53,680::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:53,680::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:53,680::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:53,681::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:53,681::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-14::DEBUG::2014-07-24 10:20:53,681::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata count=1' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:53,687::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000708203 s, 2.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:53,688::misc::264::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000708203 s, 2.9 MB/s'], size: 2048 >Thread-14::DEBUG::2014-07-24 10:20:53,688::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-14::WARNING::2014-07-24 10:20:53,688::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-14::DEBUG::2014-07-24 10:20:53,688::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-14::DEBUG::2014-07-24 10:20:53,688::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:53,689::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:53,689::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:53,689::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:53,689::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:53,690::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:53,881::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:53,882::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:53,882::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=ISCSI', '_SHA_CKSUM=37794de8480bb16c68ca2d238d29ce64d44a92fc', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'POOL_UUID=', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'LOCKPOLICY='] >Thread-14::INFO::2014-07-24 10:20:53,883::clusterlock::235::SANLock::(acquire) Acquiring cluster lock for domain 23aa0606-edc3-4882-a4aa-18aa1983458f (id: 250) >Thread-14::DEBUG::2014-07-24 10:20:54,281::clusterlock::261::SANLock::(acquire) Cluster lock for domain 23aa0606-edc3-4882-a4aa-18aa1983458f successfully acquired (id: 250) >Thread-14::INFO::2014-07-24 10:20:54,281::sp::671::Storage.StoragePool::(createMaster) setting master domain for spUUID 637ea13c-81a8-4b44-8cab-961458b01883 on sdUUID=23aa0606-edc3-4882-a4aa-18aa1983458f >Thread-14::DEBUG::2014-07-24 10:20:54,282::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-14::DEBUG::2014-07-24 10:20:54,282::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-14::DEBUG::2014-07-24 10:20:54,282::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=ISCSI', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=DS1', 'POOL_DOMAINS=23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'ROLE=Regular', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', '_SHA_CKSUM=19b415d080c5b9fe25ccc52af03008e892dd8f3e'] >Thread-14::DEBUG::2014-07-24 10:20:54,282::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:54,283::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:54,283::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:54,283::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:54,283::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:54,284::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:54,466::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:54,467::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:54,473::blockSD::315::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT__SHA_CKSUM=19b415d080c5b9fe25ccc52af03008e892dd8f3e, MDT_POOL_DESCRIPTION=DS1, MDT_POOL_SPM_ID=-1, MDT_POOL_SPM_LVER=-1, MDT_MASTER_VERSION=1, MDT_POOL_DOMAINS=23aa0606-edc3-4882-a4aa-18aa1983458f:Active removing=MDT__SHA_CKSUM=37794de8480bb16c68ca2d238d29ce64d44a92fc >Thread-14::DEBUG::2014-07-24 10:20:54,473::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT__SHA_CKSUM=37794de8480bb16c68ca2d238d29ce64d44a92fc --addtag MDT_POOL_SPM_ID=-1 --addtag MDT_POOL_DOMAINS=23aa0606-edc3-4882-a4aa-18aa1983458f:Active --addtag MDT_POOL_DESCRIPTION=DS1 --addtag MDT__SHA_CKSUM=19b415d080c5b9fe25ccc52af03008e892dd8f3e --addtag MDT_POOL_SPM_LVER=-1 --addtag MDT_MASTER_VERSION=1 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:54,732::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:54,732::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:54,733::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:54,733::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-14::DEBUG::2014-07-24 10:20:54,733::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:54,733::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:54,734::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:54,734::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:54,734::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:54,735::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:54,902::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:54,903::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:54,904::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'ROLE=Regular', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'POOL_UUID=', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'LOCKPOLICY=', 'POOL_SPM_ID=-1', 'POOL_DOMAINS=23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'POOL_DESCRIPTION=DS1', '_SHA_CKSUM=19b415d080c5b9fe25ccc52af03008e892dd8f3e', 'POOL_SPM_LVER=-1', 'MASTER_VERSION=1'] >Thread-14::DEBUG::2014-07-24 10:20:54,904::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >Thread-14::DEBUG::2014-07-24 10:20:54,904::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-14::DEBUG::2014-07-24 10:20:54,905::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-14::DEBUG::2014-07-24 10:20:54,905::persistentDict::160::Storage.PersistentDict::(transaction) Reusing active transaction >Thread-14::DEBUG::2014-07-24 10:20:54,905::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >Thread-14::DEBUG::2014-07-24 10:20:54,905::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=ISCSI', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=DS1', 'POOL_DOMAINS=23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=637ea13c-81a8-4b44-8cab-961458b01883', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'ROLE=Master', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', '_SHA_CKSUM=54f11008c9429675aafb0c3cd0df376f589a7617'] >Thread-14::DEBUG::2014-07-24 10:20:54,905::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:54,906::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:54,906::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:54,906::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:54,906::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:54,907::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:55,073::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:55,074::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:55,075::blockSD::315::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT__SHA_CKSUM=54f11008c9429675aafb0c3cd0df376f589a7617, MDT_ROLE=Master, MDT_POOL_UUID=637ea13c-81a8-4b44-8cab-961458b01883 removing=MDT_ROLE=Regular, MDT__SHA_CKSUM=19b415d080c5b9fe25ccc52af03008e892dd8f3e, MDT_POOL_UUID= >Thread-14::DEBUG::2014-07-24 10:20:55,075::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT__SHA_CKSUM=19b415d080c5b9fe25ccc52af03008e892dd8f3e --deltag MDT_ROLE=Regular --deltag MDT_POOL_UUID= --addtag MDT__SHA_CKSUM=54f11008c9429675aafb0c3cd0df376f589a7617 --addtag MDT_ROLE=Master --addtag MDT_POOL_UUID=637ea13c-81a8-4b44-8cab-961458b01883 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:55,291::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:55,291::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:55,291::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:55,292::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >Thread-14::DEBUG::2014-07-24 10:20:55,292::sp::1375::Storage.StoragePool::(setMasterDomain) Master domain 23aa0606-edc3-4882-a4aa-18aa1983458f verified, version 1 >Thread-14::DEBUG::2014-07-24 10:20:55,292::misc::738::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-14::DEBUG::2014-07-24 10:20:55,292::misc::740::SamplingMethod::(__call__) Got in to sampling method >Thread-14::DEBUG::2014-07-24 10:20:55,293::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:55,293::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:55,293::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:55,293::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:55,294::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:55,294::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:55,459::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:55,461::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:55,462::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'LOCKPOLICY=', 'POOL_SPM_ID=-1', 'POOL_DOMAINS=23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'POOL_DESCRIPTION=DS1', 'POOL_SPM_LVER=-1', 'MASTER_VERSION=1', '_SHA_CKSUM=54f11008c9429675aafb0c3cd0df376f589a7617', 'ROLE=Master', 'POOL_UUID=637ea13c-81a8-4b44-8cab-961458b01883'] >Thread-14::INFO::2014-07-24 10:20:55,465::domainMonitor::99::Storage.DomainMonitor::(startMonitoring) Start monitoring 23aa0606-edc3-4882-a4aa-18aa1983458f >Thread-15::DEBUG::2014-07-24 10:20:55,466::domainMonitor::165::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 23aa0606-edc3-4882-a4aa-18aa1983458f >Thread-14::DEBUG::2014-07-24 10:20:55,466::sp::1404::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `637ea13c-81a8-4b44-8cab-961458b01883` started monitoring domain `23aa0606-edc3-4882-a4aa-18aa1983458f` >Thread-14::DEBUG::2014-07-24 10:20:55,470::misc::748::SamplingMethod::(__call__) Returning last result >Thread-14::WARNING::2014-07-24 10:20:55,473::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883 already exists >Thread-15::DEBUG::2014-07-24 10:20:55,482::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:55,497::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:55,499::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:55,501::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:55,501::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:55,503::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:55,512::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-15::DEBUG::2014-07-24 10:20:55,639::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-07-24 10:20:55,639::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-15::DEBUG::2014-07-24 10:20:55,646::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000487048 s, 8.4 MB/s\n'; <rc> = 0 >Thread-15::DEBUG::2014-07-24 10:20:55,647::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-15::DEBUG::2014-07-24 10:20:55,647::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:55,685::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:55,686::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'LOCKPOLICY=', 'POOL_SPM_ID=-1', 'POOL_DOMAINS=23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'POOL_DESCRIPTION=DS1', 'POOL_SPM_LVER=-1', 'MASTER_VERSION=1', '_SHA_CKSUM=54f11008c9429675aafb0c3cd0df376f589a7617', 'ROLE=Master', 'POOL_UUID=637ea13c-81a8-4b44-8cab-961458b01883'] >Thread-14::DEBUG::2014-07-24 10:20:55,687::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-14::DEBUG::2014-07-24 10:20:55,687::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >Thread-15::DEBUG::2014-07-24 10:20:55,819::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-15::DEBUG::2014-07-24 10:20:55,825::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain 23aa0606-edc3-4882-a4aa-18aa1983458f changed its status to Valid >Thread-16::DEBUG::2014-07-24 10:20:55,826::misc::860::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event >Thread-16::DEBUG::2014-07-24 10:20:55,827::misc::870::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `_onDomainStateChange` >Thread-16::DEBUG::2014-07-24 10:20:55,827::misc::880::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted >Thread-14::DEBUG::2014-07-24 10:20:55,880::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:55,882::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::WARNING::2014-07-24 10:20:55,883::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/23aa0606-edc3-4882-a4aa-18aa1983458f/images already exists >Thread-14::WARNING::2014-07-24 10:20:55,883::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/23aa0606-edc3-4882-a4aa-18aa1983458f/dom_md already exists >Thread-14::INFO::2014-07-24 10:20:55,883::sp::1113::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/23aa0606-edc3-4882-a4aa-18aa1983458f to /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/23aa0606-edc3-4882-a4aa-18aa1983458f >Thread-14::INFO::2014-07-24 10:20:55,884::sp::1113::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/23aa0606-edc3-4882-a4aa-18aa1983458f to /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd >Thread-14::INFO::2014-07-24 10:20:55,884::clusterlock::279::SANLock::(release) Releasing cluster lock for domain 23aa0606-edc3-4882-a4aa-18aa1983458f >Thread-14::DEBUG::2014-07-24 10:20:55,925::clusterlock::289::SANLock::(release) Cluster lock for domain 23aa0606-edc3-4882-a4aa-18aa1983458f successfully released >Thread-14::INFO::2014-07-24 10:20:55,926::clusterlock::207::SANLock::(releaseHostId) Releasing host id for domain 23aa0606-edc3-4882-a4aa-18aa1983458f (id: 250) >Thread-14::DEBUG::2014-07-24 10:20:57,926::clusterlock::217::SANLock::(releaseHostId) Host id for domain 23aa0606-edc3-4882-a4aa-18aa1983458f released successfully (id: 250) >Thread-14::INFO::2014-07-24 10:20:57,926::domainMonitor::113::Storage.DomainMonitor::(stopMonitoring) Stop monitoring 23aa0606-edc3-4882-a4aa-18aa1983458f >Thread-15::DEBUG::2014-07-24 10:20:57,927::domainMonitor::175::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 23aa0606-edc3-4882-a4aa-18aa1983458f >Thread-15::INFO::2014-07-24 10:20:57,927::clusterlock::207::SANLock::(releaseHostId) Releasing host id for domain 23aa0606-edc3-4882-a4aa-18aa1983458f (id: 250) >Thread-15::DEBUG::2014-07-24 10:20:57,927::clusterlock::217::SANLock::(releaseHostId) Host id for domain 23aa0606-edc3-4882-a4aa-18aa1983458f released successfully (id: 250) >Thread-14::INFO::2014-07-24 10:20:57,928::logUtils::47::dispatcher::(wrapper) Run and protect: createStoragePool, Return response: True >Thread-14::DEBUG::2014-07-24 10:20:57,928::task::1185::TaskManager.Task::(prepare) Task=`07f91dd8-9d20-49b0-8415-89ea70115599`::finished: True >Thread-14::DEBUG::2014-07-24 10:20:57,928::task::595::TaskManager.Task::(_updateState) Task=`07f91dd8-9d20-49b0-8415-89ea70115599`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:20:57,928::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f': < ResourceRef 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f', isValid: 'True' obj: 'None'>, 'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-14::DEBUG::2014-07-24 10:20:57,928::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:20:57,929::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f' >Thread-14::DEBUG::2014-07-24 10:20:57,929::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f' (0 active users) >Thread-14::DEBUG::2014-07-24 10:20:57,929::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f' is free, finding out if anyone is waiting for it. >Thread-14::DEBUG::2014-07-24 10:20:57,929::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f', Clearing records. >Thread-14::DEBUG::2014-07-24 10:20:57,929::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-14::DEBUG::2014-07-24 10:20:57,930::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-14::DEBUG::2014-07-24 10:20:57,930::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-14::DEBUG::2014-07-24 10:20:57,930::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-14::DEBUG::2014-07-24 10:20:57,930::task::990::TaskManager.Task::(_decref) Task=`07f91dd8-9d20-49b0-8415-89ea70115599`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:20:58,288::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [2c49c734] >Thread-14::DEBUG::2014-07-24 10:20:58,289::task::595::TaskManager.Task::(_updateState) Task=`5feb15fb-4321-4a34-bcba-befc4c100838`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:20:58,289::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=3, spUUID='637ea13c-81a8-4b44-8cab-961458b01883', conList=[{'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'user': '', 'tpgt': '4', 'password': '******', 'id': '1bc690b4-6656-40a4-8d35-914c7114052a', 'port': '3260'}, {'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'user': '', 'tpgt': '3', 'password': '******', 'id': '49335d7a-3418-4b02-90f8-d512eddbac73', 'port': '3260'}, {'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'user': '', 'tpgt': '1', 'password': '******', 'id': '9fdc4ae2-f9a0-4b01-bea6-e968aa130382', 'port': '3260'}, {'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'user': '', 'tpgt': '2', 'password': '******', 'id': 'c7c16a5e-4fcb-4f17-a04c-62c3bd3ea404', 'port': '3260'}], options=None) >Thread-14::DEBUG::2014-07-24 10:20:58,290::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b7 -I default -p 10.35.160.107:3260,4 --op=new' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:58,306::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:58,307::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b7 -I default -p 10.35.160.107:3260,4 -l' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:58,327::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:58,327::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b7 -I default -p 10.35.160.107:3260,4 -n node.startup -v manual --op=update' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:58,346::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:58,346::hsm::2352::Storage.HSM::(__prefetchDomains) Found SD uuids: ('23aa0606-edc3-4882-a4aa-18aa1983458f',) >Thread-14::DEBUG::2014-07-24 10:20:58,346::hsm::2408::Storage.HSM::(connectStorageServer) knownSDs: {23aa0606-edc3-4882-a4aa-18aa1983458f: storage.blockSD.findDomain} >Thread-14::DEBUG::2014-07-24 10:20:58,347::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b6 -I default -p 10.35.160.106:3260,3 --op=new' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:58,360::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:58,361::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b6 -I default -p 10.35.160.106:3260,3 -l' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:58,377::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:58,382::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.b6 -I default -p 10.35.160.106:3260,3 -n node.startup -v manual --op=update' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:58,394::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:58,395::hsm::2352::Storage.HSM::(__prefetchDomains) Found SD uuids: ('23aa0606-edc3-4882-a4aa-18aa1983458f',) >Thread-14::DEBUG::2014-07-24 10:20:58,396::hsm::2408::Storage.HSM::(connectStorageServer) knownSDs: {23aa0606-edc3-4882-a4aa-18aa1983458f: storage.blockSD.findDomain} >Thread-14::DEBUG::2014-07-24 10:20:58,396::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a6 -I default -p 10.35.160.104:3260,1 --op=new' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:58,408::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:58,409::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a6 -I default -p 10.35.160.104:3260,1 -l' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:58,423::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:58,423::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a6 -I default -p 10.35.160.104:3260,1 -n node.startup -v manual --op=update' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:58,435::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:58,435::hsm::2352::Storage.HSM::(__prefetchDomains) Found SD uuids: ('23aa0606-edc3-4882-a4aa-18aa1983458f',) >Thread-14::DEBUG::2014-07-24 10:20:58,435::hsm::2408::Storage.HSM::(connectStorageServer) knownSDs: {23aa0606-edc3-4882-a4aa-18aa1983458f: storage.blockSD.findDomain} >Thread-14::DEBUG::2014-07-24 10:20:58,436::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a7 -I default -p 10.35.160.105:3260,2 --op=new' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:58,461::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:58,461::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a7 -I default -p 10.35.160.105:3260,2 -l' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:58,477::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:58,477::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m node -T iqn.1992-04.com.emc:cx.ckm00121000438.a7 -I default -p 10.35.160.105:3260,2 -n node.startup -v manual --op=update' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:58,489::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:58,490::hsm::2352::Storage.HSM::(__prefetchDomains) Found SD uuids: ('23aa0606-edc3-4882-a4aa-18aa1983458f',) >Thread-14::DEBUG::2014-07-24 10:20:58,490::hsm::2408::Storage.HSM::(connectStorageServer) knownSDs: {23aa0606-edc3-4882-a4aa-18aa1983458f: storage.blockSD.findDomain} >Thread-14::INFO::2014-07-24 10:20:58,490::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '1bc690b4-6656-40a4-8d35-914c7114052a'}, {'status': 0, 'id': '49335d7a-3418-4b02-90f8-d512eddbac73'}, {'status': 0, 'id': '9fdc4ae2-f9a0-4b01-bea6-e968aa130382'}, {'status': 0, 'id': 'c7c16a5e-4fcb-4f17-a04c-62c3bd3ea404'}]} >Thread-14::DEBUG::2014-07-24 10:20:58,490::task::1185::TaskManager.Task::(prepare) Task=`5feb15fb-4321-4a34-bcba-befc4c100838`::finished: {'statuslist': [{'status': 0, 'id': '1bc690b4-6656-40a4-8d35-914c7114052a'}, {'status': 0, 'id': '49335d7a-3418-4b02-90f8-d512eddbac73'}, {'status': 0, 'id': '9fdc4ae2-f9a0-4b01-bea6-e968aa130382'}, {'status': 0, 'id': 'c7c16a5e-4fcb-4f17-a04c-62c3bd3ea404'}]} >Thread-14::DEBUG::2014-07-24 10:20:58,490::task::595::TaskManager.Task::(_updateState) Task=`5feb15fb-4321-4a34-bcba-befc4c100838`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:20:58,491::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:20:58,491::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:20:58,491::task::990::TaskManager.Task::(_decref) Task=`5feb15fb-4321-4a34-bcba-befc4c100838`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:20:58,550::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [48238419] >Thread-14::DEBUG::2014-07-24 10:20:58,551::task::595::TaskManager.Task::(_updateState) Task=`8f0fd2a5-c269-401d-8469-6cfa3e54dfc8`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:20:58,551::logUtils::44::dispatcher::(wrapper) Run and protect: getVGInfo(vgUUID='NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', options=None) >Thread-14::DEBUG::2014-07-24 10:20:58,597::lvm::325::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:58,597::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm pvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size /dev/mapper/360060160128230005ddddcba33f2e311' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:58,778::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:58,779::lvm::350::OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >Thread-14::INFO::2014-07-24 10:20:58,779::logUtils::47::dispatcher::(wrapper) Run and protect: getVGInfo, Return response: {'info': {'state': 'OK', 'vgsize': '42547019776', 'name': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'vgfree': '38386270208', 'vgUUID': 'NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', 'pvlist': [{'vendorID': 'DGC', 'capacity': '42547019776', 'fwrev': '0000', 'vgUUID': 'NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', 'pathlist': [{'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'portal': '3', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'portal': '4', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'portal': '2', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sdi', 'type': 'iSCSI', 'state': 'active', 'lun': '2'}, {'physdev': 'sdj', 'type': 'iSCSI', 'state': 'active', 'lun': '2'}, {'physdev': 'sdp', 'type': 'iSCSI', 'state': 'active', 'lun': '2'}, {'physdev': 'sdr', 'type': 'iSCSI', 'state': 'active', 'lun': '2'}], 'devtype': 'iSCSI', 'pvUUID': 'ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw', 'serial': 'SDGC_RAID_5_CKM00121000438', 'GUID': '360060160128230005ddddcba33f2e311', 'devcapacity': '42949672960', 'productID': 'RAID 5'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}}} >Thread-14::DEBUG::2014-07-24 10:20:58,779::task::1185::TaskManager.Task::(prepare) Task=`8f0fd2a5-c269-401d-8469-6cfa3e54dfc8`::finished: {'info': {'state': 'OK', 'vgsize': '42547019776', 'name': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'vgfree': '38386270208', 'vgUUID': 'NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', 'pvlist': [{'vendorID': 'DGC', 'capacity': '42547019776', 'fwrev': '0000', 'vgUUID': 'NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', 'pathlist': [{'connection': '10.35.160.106', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b6', 'portal': '3', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.107', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.b7', 'portal': '4', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.105', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a7', 'portal': '2', 'port': '3260', 'initiatorname': 'default'}, {'connection': '10.35.160.104', 'iqn': 'iqn.1992-04.com.emc:cx.ckm00121000438.a6', 'portal': '1', 'port': '3260', 'initiatorname': 'default'}], 'pathstatus': [{'physdev': 'sdi', 'type': 'iSCSI', 'state': 'active', 'lun': '2'}, {'physdev': 'sdj', 'type': 'iSCSI', 'state': 'active', 'lun': '2'}, {'physdev': 'sdp', 'type': 'iSCSI', 'state': 'active', 'lun': '2'}, {'physdev': 'sdr', 'type': 'iSCSI', 'state': 'active', 'lun': '2'}], 'devtype': 'iSCSI', 'pvUUID': 'ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw', 'serial': 'SDGC_RAID_5_CKM00121000438', 'GUID': '360060160128230005ddddcba33f2e311', 'devcapacity': '42949672960', 'productID': 'RAID 5'}], 'type': 3, 'attr': {'allocation': 'n', 'partial': '-', 'exported': '-', 'permission': 'w', 'clustered': '-', 'resizeable': 'z'}}} >Thread-14::DEBUG::2014-07-24 10:20:58,779::task::595::TaskManager.Task::(_updateState) Task=`8f0fd2a5-c269-401d-8469-6cfa3e54dfc8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:20:58,780::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:20:58,780::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:20:58,780::task::990::TaskManager.Task::(_decref) Task=`8f0fd2a5-c269-401d-8469-6cfa3e54dfc8`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:20:59,122::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [2d6aea48] >Thread-14::DEBUG::2014-07-24 10:20:59,123::task::595::TaskManager.Task::(_updateState) Task=`83e15e7c-2adb-40d9-8113-9c3902289c67`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:20:59,123::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::ERROR::2014-07-24 10:20:59,123::task::866::TaskManager.Task::(_setError) Task=`83e15e7c-2adb-40d9-8113-9c3902289c67`::Unexpected error >Traceback (most recent call last): > File "/usr/share/vdsm/storage/task.py", line 873, in _run > return fn(*args, **kargs) > File "/usr/share/vdsm/logUtils.py", line 45, in wrapper > res = f(*args, **kwargs) > File "/usr/share/vdsm/storage/hsm.py", line 629, in getSpmStatus > pool = self.getPool(spUUID) > File "/usr/share/vdsm/storage/hsm.py", line 326, in getPool > raise se.StoragePoolUnknown(spUUID) >StoragePoolUnknown: Unknown pool id, pool not connected: ('637ea13c-81a8-4b44-8cab-961458b01883',) >Thread-14::DEBUG::2014-07-24 10:20:59,124::task::885::TaskManager.Task::(_run) Task=`83e15e7c-2adb-40d9-8113-9c3902289c67`::Task._run: 83e15e7c-2adb-40d9-8113-9c3902289c67 ('637ea13c-81a8-4b44-8cab-961458b01883',) {} failed - stopping task >Thread-14::DEBUG::2014-07-24 10:20:59,124::task::1211::TaskManager.Task::(stop) Task=`83e15e7c-2adb-40d9-8113-9c3902289c67`::stopping in state preparing (force False) >Thread-14::DEBUG::2014-07-24 10:20:59,125::task::990::TaskManager.Task::(_decref) Task=`83e15e7c-2adb-40d9-8113-9c3902289c67`::ref 1 aborting True >Thread-14::INFO::2014-07-24 10:20:59,125::task::1168::TaskManager.Task::(prepare) Task=`83e15e7c-2adb-40d9-8113-9c3902289c67`::aborting: Task is aborted: 'Unknown pool id, pool not connected' - code 309 >Thread-14::DEBUG::2014-07-24 10:20:59,125::task::1173::TaskManager.Task::(prepare) Task=`83e15e7c-2adb-40d9-8113-9c3902289c67`::Prepare: aborted: Unknown pool id, pool not connected >Thread-14::DEBUG::2014-07-24 10:20:59,125::task::990::TaskManager.Task::(_decref) Task=`83e15e7c-2adb-40d9-8113-9c3902289c67`::ref 0 aborting True >Thread-14::DEBUG::2014-07-24 10:20:59,125::task::925::TaskManager.Task::(_doAbort) Task=`83e15e7c-2adb-40d9-8113-9c3902289c67`::Task._doAbort: force False >Thread-14::DEBUG::2014-07-24 10:20:59,125::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:20:59,125::task::595::TaskManager.Task::(_updateState) Task=`83e15e7c-2adb-40d9-8113-9c3902289c67`::moving from state preparing -> state aborting >Thread-14::DEBUG::2014-07-24 10:20:59,126::task::550::TaskManager.Task::(__state_aborting) Task=`83e15e7c-2adb-40d9-8113-9c3902289c67`::_aborting: recover policy none >Thread-14::DEBUG::2014-07-24 10:20:59,126::task::595::TaskManager.Task::(_updateState) Task=`83e15e7c-2adb-40d9-8113-9c3902289c67`::moving from state aborting -> state failed >Thread-14::DEBUG::2014-07-24 10:20:59,126::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:20:59,126::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::ERROR::2014-07-24 10:20:59,126::dispatcher::65::Storage.Dispatcher.Protect::(run) {'status': {'message': "Unknown pool id, pool not connected: ('637ea13c-81a8-4b44-8cab-961458b01883',)", 'code': 309}} >Thread-14::DEBUG::2014-07-24 10:20:59,249::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [2d6aea48] >Thread-14::DEBUG::2014-07-24 10:20:59,250::task::595::TaskManager.Task::(_updateState) Task=`6c81b0b3-8c06-4268-9e87-ce88db804a76`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:20:59,250::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', hostID=1, msdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', masterVersion=1, domainsMap=None, options=None) >Thread-14::DEBUG::2014-07-24 10:20:59,250::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`2453ea6b-1b3e-4bbb-a4bb-d842a8c7eaa9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1018' at 'connectStoragePool' >Thread-14::DEBUG::2014-07-24 10:20:59,250::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive' >Thread-14::DEBUG::2014-07-24 10:20:59,251::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user) >Thread-14::DEBUG::2014-07-24 10:20:59,251::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`2453ea6b-1b3e-4bbb-a4bb-d842a8c7eaa9`::Granted request >Thread-14::DEBUG::2014-07-24 10:20:59,251::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`a4d039da-e2b6-4217-bec1-c5cb669fa6b0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1066' at '_connectStoragePool' >Thread-14::DEBUG::2014-07-24 10:20:59,251::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'exclusive' >Thread-14::DEBUG::2014-07-24 10:20:59,252::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'exclusive' (1 active user) >Thread-14::DEBUG::2014-07-24 10:20:59,252::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`a4d039da-e2b6-4217-bec1-c5cb669fa6b0`::Granted request >Thread-14::INFO::2014-07-24 10:20:59,252::sp::133::Storage.StoragePool::(setBackend) updating pool 637ea13c-81a8-4b44-8cab-961458b01883 backend from type NoneType instance 0x7f8b82527210 to type StoragePoolDiskBackend instance 0x160f1b8 >Thread-14::INFO::2014-07-24 10:20:59,252::sp::623::Storage.StoragePool::(connect) Connect host #1 to the storage pool 637ea13c-81a8-4b44-8cab-961458b01883 with master domain: 23aa0606-edc3-4882-a4aa-18aa1983458f (ver = 1) >Thread-14::DEBUG::2014-07-24 10:20:59,252::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:59,253::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:59,253::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:59,253::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:59,253::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:59,254::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:59,254::misc::738::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-14::DEBUG::2014-07-24 10:20:59,254::misc::740::SamplingMethod::(__call__) Got in to sampling method >Thread-14::DEBUG::2014-07-24 10:20:59,254::misc::738::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-14::DEBUG::2014-07-24 10:20:59,254::misc::740::SamplingMethod::(__call__) Got in to sampling method >Thread-14::DEBUG::2014-07-24 10:20:59,254::iscsi::407::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-14::DEBUG::2014-07-24 10:20:59,255::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:59,277::misc::748::SamplingMethod::(__call__) Returning last result >Thread-14::DEBUG::2014-07-24 10:20:59,277::multipath::109::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:59,400::multipath::109::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:59,401::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:59,401::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:59,401::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:59,401::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:59,402::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:59,402::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:59,402::misc::748::SamplingMethod::(__call__) Returning last result >Thread-14::DEBUG::2014-07-24 10:20:59,402::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:59,404::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:59,573::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:59,575::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:59,575::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-14::DEBUG::2014-07-24 10:20:59,575::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata count=1' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:59,582::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000577609 s, 3.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:59,582::misc::264::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000577609 s, 3.5 MB/s'], size: 2048 >Thread-14::DEBUG::2014-07-24 10:20:59,582::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-14::WARNING::2014-07-24 10:20:59,582::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-14::DEBUG::2014-07-24 10:20:59,582::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-14::DEBUG::2014-07-24 10:20:59,583::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:59,583::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:59,583::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:59,583::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:59,584::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:59,584::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:59,747::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:59,748::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:59,748::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'LOCKPOLICY=', 'POOL_SPM_ID=-1', 'POOL_DOMAINS=23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'POOL_DESCRIPTION=DS1', 'POOL_SPM_LVER=-1', 'MASTER_VERSION=1', '_SHA_CKSUM=54f11008c9429675aafb0c3cd0df376f589a7617', 'ROLE=Master', 'POOL_UUID=637ea13c-81a8-4b44-8cab-961458b01883'] >Thread-14::INFO::2014-07-24 10:20:59,749::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_imageNS already registered >Thread-14::INFO::2014-07-24 10:20:59,749::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_volumeNS already registered >Thread-14::INFO::2014-07-24 10:20:59,750::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_lvmActivationNS already registered >Thread-14::DEBUG::2014-07-24 10:20:59,750::sp::1375::Storage.StoragePool::(setMasterDomain) Master domain 23aa0606-edc3-4882-a4aa-18aa1983458f verified, version 1 >Thread-14::DEBUG::2014-07-24 10:20:59,750::misc::738::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-14::DEBUG::2014-07-24 10:20:59,750::misc::740::SamplingMethod::(__call__) Got in to sampling method >Thread-14::DEBUG::2014-07-24 10:20:59,751::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:59,751::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:59,751::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:59,751::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:59,752::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:59,752::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:59,926::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:20:59,927::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:59,928::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'LOCKPOLICY=', 'POOL_SPM_ID=-1', 'POOL_DOMAINS=23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'POOL_DESCRIPTION=DS1', 'POOL_SPM_LVER=-1', 'MASTER_VERSION=1', '_SHA_CKSUM=54f11008c9429675aafb0c3cd0df376f589a7617', 'ROLE=Master', 'POOL_UUID=637ea13c-81a8-4b44-8cab-961458b01883'] >Thread-14::INFO::2014-07-24 10:20:59,928::domainMonitor::99::Storage.DomainMonitor::(startMonitoring) Start monitoring 23aa0606-edc3-4882-a4aa-18aa1983458f >Thread-14::DEBUG::2014-07-24 10:20:59,929::sp::1404::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `637ea13c-81a8-4b44-8cab-961458b01883` started monitoring domain `23aa0606-edc3-4882-a4aa-18aa1983458f` >Thread-18::DEBUG::2014-07-24 10:20:59,929::domainMonitor::165::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 23aa0606-edc3-4882-a4aa-18aa1983458f >Thread-14::DEBUG::2014-07-24 10:20:59,930::misc::748::SamplingMethod::(__call__) Returning last result >Thread-14::WARNING::2014-07-24 10:20:59,932::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883 already exists >Thread-14::DEBUG::2014-07-24 10:20:59,935::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:59,936::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:59,938::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 10:20:59,939::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-14::DEBUG::2014-07-24 10:20:59,946::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:59,948::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:20:59,949::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-13::DEBUG::2014-07-24 10:21:00,058::task::595::TaskManager.Task::(_updateState) Task=`b62969ed-5c95-4f1f-86d7-83eb8f695a21`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:21:00,058::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:21:00,058::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '0.1', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:21:00,058::task::1185::TaskManager.Task::(prepare) Task=`b62969ed-5c95-4f1f-86d7-83eb8f695a21`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': -1, 'acquired': False, 'delay': '0', 'lastCheck': '0.1', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:21:00,059::task::595::TaskManager.Task::(_updateState) Task=`b62969ed-5c95-4f1f-86d7-83eb8f695a21`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:21:00,059::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:21:00,059::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:21:00,059::task::990::TaskManager.Task::(_decref) Task=`b62969ed-5c95-4f1f-86d7-83eb8f695a21`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 10:21:00,106::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:21:00,106::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:21:00,114::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00121308 s, 3.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:21:00,115::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-18::DEBUG::2014-07-24 10:21:00,115::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-14::DEBUG::2014-07-24 10:21:00,156::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:21:00,157::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'LOCKPOLICY=', 'POOL_SPM_ID=-1', 'POOL_DOMAINS=23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'POOL_DESCRIPTION=DS1', 'POOL_SPM_LVER=-1', 'MASTER_VERSION=1', '_SHA_CKSUM=54f11008c9429675aafb0c3cd0df376f589a7617', 'ROLE=Master', 'POOL_UUID=637ea13c-81a8-4b44-8cab-961458b01883'] >Thread-14::DEBUG::2014-07-24 10:21:00,158::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-14::DEBUG::2014-07-24 10:21:00,158::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >Thread-18::DEBUG::2014-07-24 10:21:00,358::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:21:00,362::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain 23aa0606-edc3-4882-a4aa-18aa1983458f changed its status to Valid >Thread-18::INFO::2014-07-24 10:21:00,363::clusterlock::184::SANLock::(acquireHostId) Acquiring host id for domain 23aa0606-edc3-4882-a4aa-18aa1983458f (id: 1) >Thread-19::DEBUG::2014-07-24 10:21:00,363::misc::860::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event >Thread-19::DEBUG::2014-07-24 10:21:00,364::misc::870::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `_onDomainStateChange` >Thread-18::DEBUG::2014-07-24 10:21:00,365::clusterlock::202::SANLock::(acquireHostId) Host id for domain 23aa0606-edc3-4882-a4aa-18aa1983458f successfully acquired (id: 1) >Thread-19::DEBUG::2014-07-24 10:21:00,367::misc::870::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms` >Thread-19::DEBUG::2014-07-24 10:21:00,368::misc::880::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted >Thread-21::INFO::2014-07-24 10:21:00,376::clientIF::126::vds::(contEIOVms) vmContainerLock acquired >Thread-14::DEBUG::2014-07-24 10:21:00,525::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:21:00,527::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::WARNING::2014-07-24 10:21:00,528::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/23aa0606-edc3-4882-a4aa-18aa1983458f/images already exists >Thread-14::WARNING::2014-07-24 10:21:00,528::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/23aa0606-edc3-4882-a4aa-18aa1983458f/dom_md already exists >Thread-14::INFO::2014-07-24 10:21:00,528::sp::1113::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/23aa0606-edc3-4882-a4aa-18aa1983458f to /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/23aa0606-edc3-4882-a4aa-18aa1983458f >Thread-14::INFO::2014-07-24 10:21:00,528::sp::1113::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/23aa0606-edc3-4882-a4aa-18aa1983458f to /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd >Thread-14::DEBUG::2014-07-24 10:21:00,529::threadPool::35::Misc.ThreadPool::(__init__) Enter - numThreads: 5.0, waitTimeout: 3, maxTasks: 500.0 >Thread-14::DEBUG::2014-07-24 10:21:00,533::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-14::DEBUG::2014-07-24 10:21:00,820::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.280695 s, 14.6 kB/s\n'; <rc> = 0 >Thread-14::INFO::2014-07-24 10:21:00,820::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-14::DEBUG::2014-07-24 10:21:00,821::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-14::DEBUG::2014-07-24 10:21:01,828::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00154 s, 4.1 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:21:01,828::storage_mailbox::207::Storage.Mailbox.HSM::(__init__) HSM_MailboxMonitor created for pool 637ea13c-81a8-4b44-8cab-961458b01883 >Thread-14::DEBUG::2014-07-24 10:21:01,829::sp::465::Storage.StoragePool::(__createMailboxMonitor) HSM mailbox ready for pool 637ea13c-81a8-4b44-8cab-961458b01883 on master domain 23aa0606-edc3-4882-a4aa-18aa1983458f >Thread-14::DEBUG::2014-07-24 10:21:01,829::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-14::DEBUG::2014-07-24 10:21:01,829::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-14::DEBUG::2014-07-24 10:21:01,829::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-14::DEBUG::2014-07-24 10:21:01,830::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-14::DEBUG::2014-07-24 10:21:01,830::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock' >Thread-14::DEBUG::2014-07-24 10:21:01,830::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users) >Thread-14::DEBUG::2014-07-24 10:21:01,830::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it. >Thread-14::DEBUG::2014-07-24 10:21:01,830::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records. >Thread-14::INFO::2014-07-24 10:21:01,831::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-14::DEBUG::2014-07-24 10:21:01,831::task::1185::TaskManager.Task::(prepare) Task=`6c81b0b3-8c06-4268-9e87-ce88db804a76`::finished: True >Thread-14::DEBUG::2014-07-24 10:21:01,831::task::595::TaskManager.Task::(_updateState) Task=`6c81b0b3-8c06-4268-9e87-ce88db804a76`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:21:01,831::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:21:01,831::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:21:01,832::task::990::TaskManager.Task::(_decref) Task=`6c81b0b3-8c06-4268-9e87-ce88db804a76`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:21:01,865::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [2d6aea48] >Thread-14::DEBUG::2014-07-24 10:21:01,866::task::595::TaskManager.Task::(_updateState) Task=`10a9dc2d-f084-4088-8780-67c0ca36df31`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:21:01,866::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:21:01,866::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': -1}} >Thread-14::DEBUG::2014-07-24 10:21:01,866::task::1185::TaskManager.Task::(prepare) Task=`10a9dc2d-f084-4088-8780-67c0ca36df31`::finished: {'spm_st': {'spmId': -1, 'spmStatus': 'Free', 'spmLver': -1}} >Thread-14::DEBUG::2014-07-24 10:21:01,867::task::595::TaskManager.Task::(_updateState) Task=`10a9dc2d-f084-4088-8780-67c0ca36df31`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:21:01,867::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:21:01,867::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:21:01,867::task::990::TaskManager.Task::(_decref) Task=`10a9dc2d-f084-4088-8780-67c0ca36df31`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:21:01,987::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [2d6aea48] >Thread-14::DEBUG::2014-07-24 10:21:01,987::task::595::TaskManager.Task::(_updateState) Task=`2d699b85-9eca-4445-9348-322fa8c008a7`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:21:01,987::logUtils::44::dispatcher::(wrapper) Run and protect: spmStart(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', prevID=-1, prevLVER='-1', maxHostID=250, domVersion='3', options=None) >Thread-14::DEBUG::2014-07-24 10:21:01,988::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`eafc4a50-6eee-4a66-a645-639f76ada8d8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '588' at 'spmStart' >Thread-14::DEBUG::2014-07-24 10:21:01,988::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'exclusive' >Thread-14::DEBUG::2014-07-24 10:21:01,988::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'exclusive' (1 active user) >Thread-14::DEBUG::2014-07-24 10:21:01,988::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`eafc4a50-6eee-4a66-a645-639f76ada8d8`::Granted request >Thread-14::DEBUG::2014-07-24 10:21:01,989::task::827::TaskManager.Task::(resourceAcquired) Task=`2d699b85-9eca-4445-9348-322fa8c008a7`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (exclusive) >Thread-14::DEBUG::2014-07-24 10:21:01,989::task::990::TaskManager.Task::(_decref) Task=`2d699b85-9eca-4445-9348-322fa8c008a7`::ref 1 aborting False >Thread-14::INFO::2014-07-24 10:21:01,989::logUtils::47::dispatcher::(wrapper) Run and protect: spmStart, Return response: None >Thread-14::DEBUG::2014-07-24 10:21:01,989::task::1180::TaskManager.Task::(prepare) Task=`2d699b85-9eca-4445-9348-322fa8c008a7`::Prepare: 1 jobs exist, move to acquiring >Thread-14::DEBUG::2014-07-24 10:21:01,989::task::595::TaskManager.Task::(_updateState) Task=`2d699b85-9eca-4445-9348-322fa8c008a7`::moving from state preparing -> state acquiring >Thread-14::DEBUG::2014-07-24 10:21:01,989::task::595::TaskManager.Task::(_updateState) Task=`2d699b85-9eca-4445-9348-322fa8c008a7`::moving from state acquiring -> state queued >Thread-14::DEBUG::2014-07-24 10:21:01,990::taskManager::50::TaskManager::(_queueTask) queuing task: 2d699b85-9eca-4445-9348-322fa8c008a7 >Thread-14::DEBUG::2014-07-24 10:21:01,990::taskManager::56::TaskManager::(_queueTask) task queued: 2d699b85-9eca-4445-9348-322fa8c008a7 >Thread-7::DEBUG::2014-07-24 10:21:01,991::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-14::DEBUG::2014-07-24 10:21:01,991::task::1182::TaskManager.Task::(prepare) Task=`2d699b85-9eca-4445-9348-322fa8c008a7`::returning >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:01,992::threadPool::200::Misc.ThreadPool.WorkerThread::(_processNextTask) Task: 2d699b85-9eca-4445-9348-322fa8c008a7 running: <bound method Task.commit of <storage.task.Task instance at 0x7f8b280556c8>> with: None >Thread-14::DEBUG::2014-07-24 10:21:01,993::task::990::TaskManager.Task::(_decref) Task=`2d699b85-9eca-4445-9348-322fa8c008a7`::ref 0 aborting False >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:01,994::task::1194::TaskManager.Task::(commit) Task=`2d699b85-9eca-4445-9348-322fa8c008a7`::committing task: 2d699b85-9eca-4445-9348-322fa8c008a7 >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:01,995::task::595::TaskManager.Task::(_updateState) Task=`2d699b85-9eca-4445-9348-322fa8c008a7`::moving from state queued -> state running >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:01,995::task::905::TaskManager.Task::(_runJobs) Task=`2d699b85-9eca-4445-9348-322fa8c008a7`::Task.run: running job 0: spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x7f8b280cc8d0>> (args: (-1, '-1', 250, 3) kwargs: {}) >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:01,996::task::331::TaskManager.Task::(run) Task=`2d699b85-9eca-4445-9348-322fa8c008a7`::Job.run: running spmStart: <bound method StoragePool.startSpm of <storage.sp.StoragePool object at 0x7f8b280cc8d0>> (args: (-1, '-1', 250, 3) kwargs: {}) callback None >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:01,997::misc::738::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:01,997::misc::740::SamplingMethod::(__call__) Got in to sampling method >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:01,997::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:01,998::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:01,998::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:01,998::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:01,998::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:01,999::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:02,171::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:02,173::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:02,173::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'LOCKPOLICY=', 'POOL_SPM_ID=-1', 'POOL_DOMAINS=23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'POOL_DESCRIPTION=DS1', 'POOL_SPM_LVER=-1', 'MASTER_VERSION=1', '_SHA_CKSUM=54f11008c9429675aafb0c3cd0df376f589a7617', 'ROLE=Master', 'POOL_UUID=637ea13c-81a8-4b44-8cab-961458b01883'] >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:02,174::misc::748::SamplingMethod::(__call__) Returning last result >2d699b85-9eca-4445-9348-322fa8c008a7::INFO::2014-07-24 10:21:02,174::clusterlock::184::SANLock::(acquireHostId) Acquiring host id for domain 23aa0606-edc3-4882-a4aa-18aa1983458f (id: 1) >Thread-14::DEBUG::2014-07-24 10:21:03,035::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [2d6aea48] >Thread-14::DEBUG::2014-07-24 10:21:03,035::task::595::TaskManager.Task::(_updateState) Task=`1d936bdc-79b8-4621-ab04-f640f264b257`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:21:03,036::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2d699b85-9eca-4445-9348-322fa8c008a7', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-24 10:21:03,036::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2d699b85-9eca-4445-9348-322fa8c008a7 >Thread-14::DEBUG::2014-07-24 10:21:03,036::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'} >Thread-14::INFO::2014-07-24 10:21:03,036::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-14::DEBUG::2014-07-24 10:21:03,036::task::1185::TaskManager.Task::(prepare) Task=`1d936bdc-79b8-4621-ab04-f640f264b257`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-14::DEBUG::2014-07-24 10:21:03,036::task::595::TaskManager.Task::(_updateState) Task=`1d936bdc-79b8-4621-ab04-f640f264b257`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:21:03,037::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:21:03,037::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:21:03,037::task::990::TaskManager.Task::(_decref) Task=`1d936bdc-79b8-4621-ab04-f640f264b257`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:21:04,073::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [2d6aea48] >Thread-14::DEBUG::2014-07-24 10:21:04,073::task::595::TaskManager.Task::(_updateState) Task=`17ebce27-2a7f-4d90-a13f-0586ce354eea`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:21:04,073::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2d699b85-9eca-4445-9348-322fa8c008a7', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-24 10:21:04,074::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2d699b85-9eca-4445-9348-322fa8c008a7 >Thread-14::DEBUG::2014-07-24 10:21:04,074::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'} >Thread-14::INFO::2014-07-24 10:21:04,074::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-14::DEBUG::2014-07-24 10:21:04,074::task::1185::TaskManager.Task::(prepare) Task=`17ebce27-2a7f-4d90-a13f-0586ce354eea`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-14::DEBUG::2014-07-24 10:21:04,074::task::595::TaskManager.Task::(_updateState) Task=`17ebce27-2a7f-4d90-a13f-0586ce354eea`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:21:04,074::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:21:04,074::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:21:04,075::task::990::TaskManager.Task::(_decref) Task=`17ebce27-2a7f-4d90-a13f-0586ce354eea`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:21:05,107::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [2d6aea48] >Thread-14::DEBUG::2014-07-24 10:21:05,107::task::595::TaskManager.Task::(_updateState) Task=`276c1bc2-58c5-4c03-a2af-410cd8b82a98`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:21:05,107::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2d699b85-9eca-4445-9348-322fa8c008a7', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-24 10:21:05,107::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2d699b85-9eca-4445-9348-322fa8c008a7 >Thread-14::DEBUG::2014-07-24 10:21:05,107::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'} >Thread-14::INFO::2014-07-24 10:21:05,108::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-14::DEBUG::2014-07-24 10:21:05,108::task::1185::TaskManager.Task::(prepare) Task=`276c1bc2-58c5-4c03-a2af-410cd8b82a98`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-14::DEBUG::2014-07-24 10:21:05,108::task::595::TaskManager.Task::(_updateState) Task=`276c1bc2-58c5-4c03-a2af-410cd8b82a98`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:21:05,108::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:21:05,108::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:21:05,108::task::990::TaskManager.Task::(_decref) Task=`276c1bc2-58c5-4c03-a2af-410cd8b82a98`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:21:06,142::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [2d6aea48] >Thread-14::DEBUG::2014-07-24 10:21:06,142::task::595::TaskManager.Task::(_updateState) Task=`ec59926b-4825-4c02-bec0-c866c1c29497`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:21:06,142::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2d699b85-9eca-4445-9348-322fa8c008a7', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-24 10:21:06,142::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2d699b85-9eca-4445-9348-322fa8c008a7 >Thread-14::DEBUG::2014-07-24 10:21:06,142::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'} >Thread-14::INFO::2014-07-24 10:21:06,142::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-14::DEBUG::2014-07-24 10:21:06,143::task::1185::TaskManager.Task::(prepare) Task=`ec59926b-4825-4c02-bec0-c866c1c29497`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-14::DEBUG::2014-07-24 10:21:06,143::task::595::TaskManager.Task::(_updateState) Task=`ec59926b-4825-4c02-bec0-c866c1c29497`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:21:06,143::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:21:06,143::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:21:06,143::task::990::TaskManager.Task::(_decref) Task=`ec59926b-4825-4c02-bec0-c866c1c29497`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:21:07,179::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [2d6aea48] >Thread-14::DEBUG::2014-07-24 10:21:07,179::task::595::TaskManager.Task::(_updateState) Task=`3b0515d5-7616-4739-bffa-e144aea7dd19`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:21:07,179::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2d699b85-9eca-4445-9348-322fa8c008a7', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-24 10:21:07,179::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2d699b85-9eca-4445-9348-322fa8c008a7 >Thread-14::DEBUG::2014-07-24 10:21:07,179::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'} >Thread-14::INFO::2014-07-24 10:21:07,180::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-14::DEBUG::2014-07-24 10:21:07,180::task::1185::TaskManager.Task::(prepare) Task=`3b0515d5-7616-4739-bffa-e144aea7dd19`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-14::DEBUG::2014-07-24 10:21:07,180::task::595::TaskManager.Task::(_updateState) Task=`3b0515d5-7616-4739-bffa-e144aea7dd19`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:21:07,180::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:21:07,180::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:21:07,180::task::990::TaskManager.Task::(_decref) Task=`3b0515d5-7616-4739-bffa-e144aea7dd19`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:21:08,217::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [2d6aea48] >Thread-14::DEBUG::2014-07-24 10:21:08,217::task::595::TaskManager.Task::(_updateState) Task=`e12ac46e-8a3b-4077-8d22-bb2dea4c2ec9`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:21:08,217::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2d699b85-9eca-4445-9348-322fa8c008a7', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-24 10:21:08,217::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2d699b85-9eca-4445-9348-322fa8c008a7 >Thread-14::DEBUG::2014-07-24 10:21:08,217::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'} >Thread-14::INFO::2014-07-24 10:21:08,218::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-14::DEBUG::2014-07-24 10:21:08,218::task::1185::TaskManager.Task::(prepare) Task=`e12ac46e-8a3b-4077-8d22-bb2dea4c2ec9`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-14::DEBUG::2014-07-24 10:21:08,218::task::595::TaskManager.Task::(_updateState) Task=`e12ac46e-8a3b-4077-8d22-bb2dea4c2ec9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:21:08,218::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:21:08,218::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:21:08,218::task::990::TaskManager.Task::(_decref) Task=`e12ac46e-8a3b-4077-8d22-bb2dea4c2ec9`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:21:09,254::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [2d6aea48] >Thread-14::DEBUG::2014-07-24 10:21:09,255::task::595::TaskManager.Task::(_updateState) Task=`2e9189a9-dc8b-4c75-9e58-6098e24e5830`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:21:09,255::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2d699b85-9eca-4445-9348-322fa8c008a7', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-24 10:21:09,255::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2d699b85-9eca-4445-9348-322fa8c008a7 >Thread-14::DEBUG::2014-07-24 10:21:09,255::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'} >Thread-14::INFO::2014-07-24 10:21:09,256::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-14::DEBUG::2014-07-24 10:21:09,256::task::1185::TaskManager.Task::(prepare) Task=`2e9189a9-dc8b-4c75-9e58-6098e24e5830`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-14::DEBUG::2014-07-24 10:21:09,256::task::595::TaskManager.Task::(_updateState) Task=`2e9189a9-dc8b-4c75-9e58-6098e24e5830`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:21:09,256::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:21:09,256::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:21:09,256::task::990::TaskManager.Task::(_decref) Task=`2e9189a9-dc8b-4c75-9e58-6098e24e5830`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:21:10,289::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [2d6aea48] >Thread-14::DEBUG::2014-07-24 10:21:10,290::task::595::TaskManager.Task::(_updateState) Task=`bc0c103e-2857-4ea6-a5d3-f3e0c69cf83e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:21:10,290::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2d699b85-9eca-4445-9348-322fa8c008a7', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-24 10:21:10,290::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2d699b85-9eca-4445-9348-322fa8c008a7 >Thread-14::DEBUG::2014-07-24 10:21:10,290::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'} >Thread-14::INFO::2014-07-24 10:21:10,291::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-14::DEBUG::2014-07-24 10:21:10,291::task::1185::TaskManager.Task::(prepare) Task=`bc0c103e-2857-4ea6-a5d3-f3e0c69cf83e`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-14::DEBUG::2014-07-24 10:21:10,291::task::595::TaskManager.Task::(_updateState) Task=`bc0c103e-2857-4ea6-a5d3-f3e0c69cf83e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:21:10,291::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:21:10,291::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:21:10,291::task::990::TaskManager.Task::(_decref) Task=`bc0c103e-2857-4ea6-a5d3-f3e0c69cf83e`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 10:21:10,368::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:21:10,376::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000854709 s, 4.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:21:11,332::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [2d6aea48] >Thread-14::DEBUG::2014-07-24 10:21:11,352::task::595::TaskManager.Task::(_updateState) Task=`b1024f59-8f5c-4ca2-aa6f-c1c4be4ca215`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:21:11,353::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2d699b85-9eca-4445-9348-322fa8c008a7', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-24 10:21:11,353::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2d699b85-9eca-4445-9348-322fa8c008a7 >Thread-14::DEBUG::2014-07-24 10:21:11,353::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'} >Thread-14::INFO::2014-07-24 10:21:11,353::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-14::DEBUG::2014-07-24 10:21:11,353::task::1185::TaskManager.Task::(prepare) Task=`b1024f59-8f5c-4ca2-aa6f-c1c4be4ca215`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-14::DEBUG::2014-07-24 10:21:11,354::task::595::TaskManager.Task::(_updateState) Task=`b1024f59-8f5c-4ca2-aa6f-c1c4be4ca215`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:21:11,354::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:21:11,354::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:21:11,354::task::990::TaskManager.Task::(_decref) Task=`b1024f59-8f5c-4ca2-aa6f-c1c4be4ca215`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:21:12,399::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [2d6aea48] >Thread-13::DEBUG::2014-07-24 10:21:12,399::task::595::TaskManager.Task::(_updateState) Task=`182af3c7-aab4-43c3-afd1-751243366db3`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:21:12,399::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2d699b85-9eca-4445-9348-322fa8c008a7', spUUID=None, options=None) >Thread-13::DEBUG::2014-07-24 10:21:12,400::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2d699b85-9eca-4445-9348-322fa8c008a7 >Thread-13::DEBUG::2014-07-24 10:21:12,400::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'} >Thread-13::INFO::2014-07-24 10:21:12,400::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-13::DEBUG::2014-07-24 10:21:12,400::task::1185::TaskManager.Task::(prepare) Task=`182af3c7-aab4-43c3-afd1-751243366db3`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-13::DEBUG::2014-07-24 10:21:12,400::task::595::TaskManager.Task::(_updateState) Task=`182af3c7-aab4-43c3-afd1-751243366db3`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:21:12,400::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:21:12,401::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:21:12,401::task::990::TaskManager.Task::(_decref) Task=`182af3c7-aab4-43c3-afd1-751243366db3`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:21:13,435::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [2d6aea48] >Thread-13::DEBUG::2014-07-24 10:21:13,436::task::595::TaskManager.Task::(_updateState) Task=`a0ca0ac2-147f-4484-800c-db2bde037108`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:21:13,436::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2d699b85-9eca-4445-9348-322fa8c008a7', spUUID=None, options=None) >Thread-13::DEBUG::2014-07-24 10:21:13,436::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2d699b85-9eca-4445-9348-322fa8c008a7 >Thread-13::DEBUG::2014-07-24 10:21:13,436::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'} >Thread-13::INFO::2014-07-24 10:21:13,437::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-13::DEBUG::2014-07-24 10:21:13,437::task::1185::TaskManager.Task::(prepare) Task=`a0ca0ac2-147f-4484-800c-db2bde037108`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-13::DEBUG::2014-07-24 10:21:13,437::task::595::TaskManager.Task::(_updateState) Task=`a0ca0ac2-147f-4484-800c-db2bde037108`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:21:13,437::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:21:13,437::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:21:13,437::task::990::TaskManager.Task::(_decref) Task=`a0ca0ac2-147f-4484-800c-db2bde037108`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:21:14,469::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [2d6aea48] >Thread-13::DEBUG::2014-07-24 10:21:14,470::task::595::TaskManager.Task::(_updateState) Task=`25ece8a4-8944-4961-9a47-f7427d547111`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:21:14,470::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2d699b85-9eca-4445-9348-322fa8c008a7', spUUID=None, options=None) >Thread-13::DEBUG::2014-07-24 10:21:14,470::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2d699b85-9eca-4445-9348-322fa8c008a7 >Thread-13::DEBUG::2014-07-24 10:21:14,470::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'} >Thread-13::INFO::2014-07-24 10:21:14,470::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-13::DEBUG::2014-07-24 10:21:14,470::task::1185::TaskManager.Task::(prepare) Task=`25ece8a4-8944-4961-9a47-f7427d547111`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-13::DEBUG::2014-07-24 10:21:14,471::task::595::TaskManager.Task::(_updateState) Task=`25ece8a4-8944-4961-9a47-f7427d547111`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:21:14,471::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:21:14,471::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:21:14,471::task::990::TaskManager.Task::(_decref) Task=`25ece8a4-8944-4961-9a47-f7427d547111`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:21:15,424::task::595::TaskManager.Task::(_updateState) Task=`3555c188-1f10-4054-af6a-ca9fdcf00f38`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:21:15,424::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:21:15,424::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00121308', 'lastCheck': '15.1', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:21:15,424::task::1185::TaskManager.Task::(prepare) Task=`3555c188-1f10-4054-af6a-ca9fdcf00f38`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.00121308', 'lastCheck': '15.1', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:21:15,424::task::595::TaskManager.Task::(_updateState) Task=`3555c188-1f10-4054-af6a-ca9fdcf00f38`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:21:15,424::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:21:15,425::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:21:15,425::task::990::TaskManager.Task::(_decref) Task=`3555c188-1f10-4054-af6a-ca9fdcf00f38`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:21:15,530::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [2d6aea48] >Thread-13::DEBUG::2014-07-24 10:21:15,531::task::595::TaskManager.Task::(_updateState) Task=`aec5b909-f0dc-4100-aa7f-5f718aeb9e1e`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:21:15,531::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2d699b85-9eca-4445-9348-322fa8c008a7', spUUID=None, options=None) >Thread-13::DEBUG::2014-07-24 10:21:15,531::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2d699b85-9eca-4445-9348-322fa8c008a7 >Thread-13::DEBUG::2014-07-24 10:21:15,531::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'} >Thread-13::INFO::2014-07-24 10:21:15,533::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-13::DEBUG::2014-07-24 10:21:15,534::task::1185::TaskManager.Task::(prepare) Task=`aec5b909-f0dc-4100-aa7f-5f718aeb9e1e`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-13::DEBUG::2014-07-24 10:21:15,534::task::595::TaskManager.Task::(_updateState) Task=`aec5b909-f0dc-4100-aa7f-5f718aeb9e1e`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:21:15,534::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:21:15,534::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:21:15,534::task::990::TaskManager.Task::(_decref) Task=`aec5b909-f0dc-4100-aa7f-5f718aeb9e1e`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:21:16,589::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [2d6aea48] >Thread-14::DEBUG::2014-07-24 10:21:16,603::task::595::TaskManager.Task::(_updateState) Task=`99f28fd6-86bc-4750-8895-2f9a510b5bf0`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:21:16,603::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2d699b85-9eca-4445-9348-322fa8c008a7', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-24 10:21:16,603::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2d699b85-9eca-4445-9348-322fa8c008a7 >Thread-14::DEBUG::2014-07-24 10:21:16,603::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'} >Thread-14::INFO::2014-07-24 10:21:16,603::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-14::DEBUG::2014-07-24 10:21:16,603::task::1185::TaskManager.Task::(prepare) Task=`99f28fd6-86bc-4750-8895-2f9a510b5bf0`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-14::DEBUG::2014-07-24 10:21:16,604::task::595::TaskManager.Task::(_updateState) Task=`99f28fd6-86bc-4750-8895-2f9a510b5bf0`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:21:16,604::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:21:16,604::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:21:16,604::task::990::TaskManager.Task::(_decref) Task=`99f28fd6-86bc-4750-8895-2f9a510b5bf0`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:21:17,641::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [2d6aea48] >Thread-14::DEBUG::2014-07-24 10:21:17,641::task::595::TaskManager.Task::(_updateState) Task=`fd911627-5b5e-4ec2-b7d1-4e7f83048a3d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:21:17,641::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2d699b85-9eca-4445-9348-322fa8c008a7', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-24 10:21:17,642::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2d699b85-9eca-4445-9348-322fa8c008a7 >Thread-14::DEBUG::2014-07-24 10:21:17,642::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'} >Thread-14::INFO::2014-07-24 10:21:17,642::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-14::DEBUG::2014-07-24 10:21:17,642::task::1185::TaskManager.Task::(prepare) Task=`fd911627-5b5e-4ec2-b7d1-4e7f83048a3d`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-14::DEBUG::2014-07-24 10:21:17,642::task::595::TaskManager.Task::(_updateState) Task=`fd911627-5b5e-4ec2-b7d1-4e7f83048a3d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:21:17,642::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:21:17,642::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:21:17,643::task::990::TaskManager.Task::(_decref) Task=`fd911627-5b5e-4ec2-b7d1-4e7f83048a3d`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:21:18,678::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [2d6aea48] >Thread-14::DEBUG::2014-07-24 10:21:18,679::task::595::TaskManager.Task::(_updateState) Task=`de9e7a47-0e8e-4735-bae1-9975b0f4b09c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:21:18,679::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2d699b85-9eca-4445-9348-322fa8c008a7', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-24 10:21:18,679::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2d699b85-9eca-4445-9348-322fa8c008a7 >Thread-14::DEBUG::2014-07-24 10:21:18,680::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'} >Thread-14::INFO::2014-07-24 10:21:18,680::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-14::DEBUG::2014-07-24 10:21:18,680::task::1185::TaskManager.Task::(prepare) Task=`de9e7a47-0e8e-4735-bae1-9975b0f4b09c`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-14::DEBUG::2014-07-24 10:21:18,680::task::595::TaskManager.Task::(_updateState) Task=`de9e7a47-0e8e-4735-bae1-9975b0f4b09c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:21:18,680::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:21:18,680::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:21:18,680::task::990::TaskManager.Task::(_decref) Task=`de9e7a47-0e8e-4735-bae1-9975b0f4b09c`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:21:19,764::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [2d6aea48] >Thread-14::DEBUG::2014-07-24 10:21:19,764::task::595::TaskManager.Task::(_updateState) Task=`0ca77245-4937-4376-bb0c-59c616ac5702`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:21:19,765::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2d699b85-9eca-4445-9348-322fa8c008a7', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-24 10:21:19,765::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2d699b85-9eca-4445-9348-322fa8c008a7 >Thread-14::DEBUG::2014-07-24 10:21:19,765::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'} >Thread-14::INFO::2014-07-24 10:21:19,765::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-14::DEBUG::2014-07-24 10:21:19,765::task::1185::TaskManager.Task::(prepare) Task=`0ca77245-4937-4376-bb0c-59c616ac5702`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-14::DEBUG::2014-07-24 10:21:19,765::task::595::TaskManager.Task::(_updateState) Task=`0ca77245-4937-4376-bb0c-59c616ac5702`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:21:19,766::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:21:19,766::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:21:19,766::task::990::TaskManager.Task::(_decref) Task=`0ca77245-4937-4376-bb0c-59c616ac5702`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:21:20,845::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [2d6aea48] >Thread-14::DEBUG::2014-07-24 10:21:20,845::task::595::TaskManager.Task::(_updateState) Task=`f23468e6-e984-4f7c-9c06-33a3ccb91851`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:21:20,845::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2d699b85-9eca-4445-9348-322fa8c008a7', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-24 10:21:20,845::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2d699b85-9eca-4445-9348-322fa8c008a7 >Thread-14::DEBUG::2014-07-24 10:21:20,846::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'} >Thread-14::INFO::2014-07-24 10:21:20,846::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-14::DEBUG::2014-07-24 10:21:20,846::task::1185::TaskManager.Task::(prepare) Task=`f23468e6-e984-4f7c-9c06-33a3ccb91851`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-14::DEBUG::2014-07-24 10:21:20,846::task::595::TaskManager.Task::(_updateState) Task=`f23468e6-e984-4f7c-9c06-33a3ccb91851`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:21:20,846::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:21:20,846::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:21:20,847::task::990::TaskManager.Task::(_decref) Task=`f23468e6-e984-4f7c-9c06-33a3ccb91851`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:21:21,881::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [2d6aea48] >Thread-14::DEBUG::2014-07-24 10:21:21,881::task::595::TaskManager.Task::(_updateState) Task=`c3a32717-9484-47a8-b4a3-d3c18523c9da`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:21:21,882::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2d699b85-9eca-4445-9348-322fa8c008a7', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-24 10:21:21,882::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2d699b85-9eca-4445-9348-322fa8c008a7 >Thread-14::DEBUG::2014-07-24 10:21:21,882::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'} >Thread-14::INFO::2014-07-24 10:21:21,882::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-14::DEBUG::2014-07-24 10:21:21,882::task::1185::TaskManager.Task::(prepare) Task=`c3a32717-9484-47a8-b4a3-d3c18523c9da`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-14::DEBUG::2014-07-24 10:21:21,882::task::595::TaskManager.Task::(_updateState) Task=`c3a32717-9484-47a8-b4a3-d3c18523c9da`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:21:21,883::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:21:21,883::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:21:21,883::task::990::TaskManager.Task::(_decref) Task=`c3a32717-9484-47a8-b4a3-d3c18523c9da`::ref 0 aborting False >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,177::clusterlock::202::SANLock::(acquireHostId) Host id for domain 23aa0606-edc3-4882-a4aa-18aa1983458f successfully acquired (id: 1) >2d699b85-9eca-4445-9348-322fa8c008a7::WARNING::2014-07-24 10:21:22,178::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/23aa0606-edc3-4882-a4aa-18aa1983458f/images already exists >2d699b85-9eca-4445-9348-322fa8c008a7::WARNING::2014-07-24 10:21:22,178::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/23aa0606-edc3-4882-a4aa-18aa1983458f/dom_md already exists >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,179::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,180::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,180::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,181::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,181::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,182::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata count=1' (cwd None) >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,190::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000612022 s, 3.3 MB/s\n'; <rc> = 0 >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,190::misc::264::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000612022 s, 3.3 MB/s'], size: 2048 >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,191::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >2d699b85-9eca-4445-9348-322fa8c008a7::WARNING::2014-07-24 10:21:22,191::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,191::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,191::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,191::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,192::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,192::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,192::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,193::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,380::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,382::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,382::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'LOCKPOLICY=', 'POOL_SPM_ID=-1', 'POOL_DOMAINS=23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'POOL_DESCRIPTION=DS1', 'POOL_SPM_LVER=-1', 'MASTER_VERSION=1', '_SHA_CKSUM=54f11008c9429675aafb0c3cd0df376f589a7617', 'ROLE=Master', 'POOL_UUID=637ea13c-81a8-4b44-8cab-961458b01883'] >2d699b85-9eca-4445-9348-322fa8c008a7::INFO::2014-07-24 10:21:22,383::clusterlock::235::SANLock::(acquire) Acquiring cluster lock for domain 23aa0606-edc3-4882-a4aa-18aa1983458f (id: 1) >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,426::clusterlock::261::SANLock::(acquire) Cluster lock for domain 23aa0606-edc3-4882-a4aa-18aa1983458f successfully acquired (id: 1) >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,426::sp::275::Storage.StoragePool::(startSpm) spm lock acquired successfully >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,426::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,427::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,427::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,427::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,428::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,428::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,611::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,612::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,613::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'LOCKPOLICY=', 'POOL_SPM_ID=-1', 'POOL_DOMAINS=23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'POOL_DESCRIPTION=DS1', 'POOL_SPM_LVER=-1', 'MASTER_VERSION=1', '_SHA_CKSUM=54f11008c9429675aafb0c3cd0df376f589a7617', 'ROLE=Master', 'POOL_UUID=637ea13c-81a8-4b44-8cab-961458b01883'] >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,613::persistentDict::167::Storage.PersistentDict::(transaction) Starting transaction >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,613::persistentDict::173::Storage.PersistentDict::(transaction) Flushing changes >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,613::persistentDict::299::Storage.PersistentDict::(flush) about to write lines (VGTagMetadataRW)=['CLASS=Data', 'DESCRIPTION=ISCSI', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'LOGBLKSIZE=512', 'MASTER_VERSION=1', 'PHYBLKSIZE=512', 'POOL_DESCRIPTION=DS1', 'POOL_DOMAINS=23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'POOL_SPM_ID=1', 'POOL_SPM_LVER=0', 'POOL_UUID=637ea13c-81a8-4b44-8cab-961458b01883', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'ROLE=Master', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'TYPE=ISCSI', 'VERSION=3', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', '_SHA_CKSUM=a749afdc7119a2d6aad840af5c63c9b28c0b612c'] >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,614::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,614::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,614::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,614::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,615::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,615::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,784::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,786::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,786::blockSD::315::storage.Metadata.VGTagMetadataRW::(writelines) Updating metadata adding=MDT_POOL_SPM_LVER=0, MDT_POOL_SPM_ID=1, MDT__SHA_CKSUM=a749afdc7119a2d6aad840af5c63c9b28c0b612c removing=MDT_POOL_SPM_ID=-1, MDT_POOL_SPM_LVER=-1, MDT__SHA_CKSUM=54f11008c9429675aafb0c3cd0df376f589a7617 >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:22,787::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --deltag MDT__SHA_CKSUM=54f11008c9429675aafb0c3cd0df376f589a7617 --deltag MDT_POOL_SPM_ID=-1 --deltag MDT_POOL_SPM_LVER=-1 --addtag MDT_POOL_SPM_ID=1 --addtag MDT__SHA_CKSUM=a749afdc7119a2d6aad840af5c63c9b28c0b612c --addtag MDT_POOL_SPM_LVER=0 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-14::DEBUG::2014-07-24 10:21:22,917::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [2d6aea48] >Thread-14::DEBUG::2014-07-24 10:21:22,918::task::595::TaskManager.Task::(_updateState) Task=`782779d5-228b-4f62-b136-90b39198d3b2`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:21:22,918::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2d699b85-9eca-4445-9348-322fa8c008a7', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-24 10:21:22,918::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2d699b85-9eca-4445-9348-322fa8c008a7 >Thread-14::DEBUG::2014-07-24 10:21:22,918::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'} >Thread-14::INFO::2014-07-24 10:21:22,919::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-14::DEBUG::2014-07-24 10:21:22,919::task::1185::TaskManager.Task::(prepare) Task=`782779d5-228b-4f62-b136-90b39198d3b2`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-14::DEBUG::2014-07-24 10:21:22,919::task::595::TaskManager.Task::(_updateState) Task=`782779d5-228b-4f62-b136-90b39198d3b2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:21:22,919::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:21:22,920::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:21:22,920::task::990::TaskManager.Task::(_decref) Task=`782779d5-228b-4f62-b136-90b39198d3b2`::ref 0 aborting False >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,037::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,037::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,037::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,038::persistentDict::175::Storage.PersistentDict::(transaction) Finished transaction >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,038::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.upgrade_637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b77f7190-3eb9-4f2e-9c44-c8196f41e748`::Request was made in '/usr/share/vdsm/storage/sp.py' line '429' at '_upgradePool' >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,038::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.upgrade_637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'exclusive' >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,039::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.upgrade_637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'exclusive' (1 active user) >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,039::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.upgrade_637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b77f7190-3eb9-4f2e-9c44-c8196f41e748`::Granted request >2d699b85-9eca-4445-9348-322fa8c008a7::INFO::2014-07-24 10:21:23,039::sp::435::Storage.StoragePool::(_upgradePool) Trying to upgrade master domain `23aa0606-edc3-4882-a4aa-18aa1983458f` >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,039::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.23aa0606-edc3-4882-a4aa-18aa1983458f`ReqID=`ea8ad49a-f37f-4702-bdf3-979258601395`::Request was made in '/usr/share/vdsm/storage/sp.py' line '437' at '_upgradePool' >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,040::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f' for lock type 'exclusive' >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,040::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f' is free. Now locking as 'exclusive' (1 active user) >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,040::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.23aa0606-edc3-4882-a4aa-18aa1983458f`ReqID=`ea8ad49a-f37f-4702-bdf3-979258601395`::Granted request >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,041::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,041::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,207::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,209::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,209::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,209::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata count=1' (cwd None) >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,216::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000554604 s, 3.7 MB/s\n'; <rc> = 0 >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,217::misc::264::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000554604 s, 3.7 MB/s'], size: 2048 >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,217::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >2d699b85-9eca-4445-9348-322fa8c008a7::WARNING::2014-07-24 10:21:23,217::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,217::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,217::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,218::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,218::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,218::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,218::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,219::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,385::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,386::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,387::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'LOCKPOLICY=', 'POOL_DOMAINS=23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'POOL_DESCRIPTION=DS1', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_UUID=637ea13c-81a8-4b44-8cab-961458b01883', 'POOL_SPM_ID=1', '_SHA_CKSUM=a749afdc7119a2d6aad840af5c63c9b28c0b612c', 'POOL_SPM_LVER=0'] >2d699b85-9eca-4445-9348-322fa8c008a7::INFO::2014-07-24 10:21:23,388::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_imageNS already registered >2d699b85-9eca-4445-9348-322fa8c008a7::INFO::2014-07-24 10:21:23,388::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_volumeNS already registered >2d699b85-9eca-4445-9348-322fa8c008a7::INFO::2014-07-24 10:21:23,388::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_lvmActivationNS already registered >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,388::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f' >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,388::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f' (0 active users) >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,389::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f' is free, finding out if anyone is waiting for it. >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,389::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f', Clearing records. >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,389::sp::440::Storage.StoragePool::(_upgradePool) Marking all domains for upgrade >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,389::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,390::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,390::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,390::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,390::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,391::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,557::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,558::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,558::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'LOCKPOLICY=', 'POOL_DOMAINS=23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'POOL_DESCRIPTION=DS1', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_UUID=637ea13c-81a8-4b44-8cab-961458b01883', 'POOL_SPM_ID=1', '_SHA_CKSUM=a749afdc7119a2d6aad840af5c63c9b28c0b612c', 'POOL_SPM_LVER=0'] >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,559::sp::447::Storage.StoragePool::(_upgradePool) Registering with state change event >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,559::sp::450::Storage.StoragePool::(_upgradePool) Running initial domain upgrade threads >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,559::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.upgrade_637ea13c-81a8-4b44-8cab-961458b01883' >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,560::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.upgrade_637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,560::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.upgrade_637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,560::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.upgrade_637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,560::blockSD::1131::Storage.Misc.excCmd::(mountMaster) '/usr/bin/sudo -n /sbin/fsck -p /dev/23aa0606-edc3-4882-a4aa-18aa1983458f/master' (cwd None) >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,644::blockSD::1131::Storage.Misc.excCmd::(mountMaster) SUCCESS: <err> = ''; <rc> = 0 >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,645::blockSD::1156::Storage.Misc.excCmd::(mountMaster) '/usr/bin/sudo -n /sbin/tune2fs -j /dev/23aa0606-edc3-4882-a4aa-18aa1983458f/master' (cwd None) >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,658::blockSD::1156::Storage.Misc.excCmd::(mountMaster) FAILED: <err> = 'The filesystem already has a journal.\n'; <rc> = 1 >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,658::mount::202::Storage.Misc.excCmd::(_runcmd) '/usr/bin/sudo -n /bin/mount -t ext3 /dev/23aa0606-edc3-4882-a4aa-18aa1983458f/master /rhev/data-center/mnt/blockSD/23aa0606-edc3-4882-a4aa-18aa1983458f/master' (cwd None) >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,783::blockSD::1168::Storage.Misc.excCmd::(mountMaster) '/usr/bin/sudo -n /bin/chown vdsm:kvm /rhev/data-center/mnt/blockSD/23aa0606-edc3-4882-a4aa-18aa1983458f/master' (cwd None) >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,803::blockSD::1168::Storage.Misc.excCmd::(mountMaster) SUCCESS: <err> = ''; <rc> = 0 >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,803::sd::633::Storage.StorageDomain::(createMasterTree) creating vms dir: /rhev/data-center/mnt/blockSD/23aa0606-edc3-4882-a4aa-18aa1983458f/master/vms >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,926::sd::636::Storage.StorageDomain::(createMasterTree) creating task dir: /rhev/data-center/mnt/blockSD/23aa0606-edc3-4882-a4aa-18aa1983458f/master/tasks >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,928::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,928::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,928::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,929::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,929::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:23,930::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-14::DEBUG::2014-07-24 10:21:23,951::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [2d6aea48] >Thread-14::DEBUG::2014-07-24 10:21:23,952::task::595::TaskManager.Task::(_updateState) Task=`5d026e8a-3b75-4d78-bf51-b618496c200c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:21:23,952::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2d699b85-9eca-4445-9348-322fa8c008a7', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-24 10:21:23,952::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2d699b85-9eca-4445-9348-322fa8c008a7 >Thread-14::DEBUG::2014-07-24 10:21:23,952::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'} >Thread-14::INFO::2014-07-24 10:21:23,953::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-14::DEBUG::2014-07-24 10:21:23,953::task::1185::TaskManager.Task::(prepare) Task=`5d026e8a-3b75-4d78-bf51-b618496c200c`::finished: {'taskStatus': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-14::DEBUG::2014-07-24 10:21:23,953::task::595::TaskManager.Task::(_updateState) Task=`5d026e8a-3b75-4d78-bf51-b618496c200c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:21:23,953::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:21:23,953::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:21:23,953::task::990::TaskManager.Task::(_decref) Task=`5d026e8a-3b75-4d78-bf51-b618496c200c`::ref 0 aborting False >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:24,105::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:24,106::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:24,107::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'LOCKPOLICY=', 'POOL_DOMAINS=23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'POOL_DESCRIPTION=DS1', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_UUID=637ea13c-81a8-4b44-8cab-961458b01883', 'POOL_SPM_ID=1', '_SHA_CKSUM=a749afdc7119a2d6aad840af5c63c9b28c0b612c', 'POOL_SPM_LVER=0'] >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:24,108::threadPool::35::Misc.ThreadPool::(__init__) Enter - numThreads: 5.0, waitTimeout: 3, maxTasks: 500.0 >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:24,111::storage_mailbox::574::Storage.MailBox.SpmMailMonitor::(__init__) SPM_MailMonitor - clearing outgoing mail, command is: ['dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox', 'oflag=direct', 'iflag=fullblock', 'conv=notrunc', 'count=1'] >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:24,112::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) 'dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox oflag=direct iflag=fullblock conv=notrunc count=1 bs=1024000' (cwd None) >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:24,163::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357654 s, 28.6 MB/s\n'; <rc> = 0 >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:24,163::storage_mailbox::582::Storage.MailBox.SpmMailMonitor::(__init__) SPM_MailMonitor created for pool 637ea13c-81a8-4b44-8cab-961458b01883 >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:24,164::sp::322::Storage.StoragePool::(startSpm) SPM mailbox ready for pool 637ea13c-81a8-4b44-8cab-961458b01883 on master domain 23aa0606-edc3-4882-a4aa-18aa1983458f >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:24,165::sp::330::Storage.StoragePool::(startSpm) ended. >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:24,166::task::595::TaskManager.Task::(_updateState) Task=`2d699b85-9eca-4445-9348-322fa8c008a7`::moving from state running -> state finished >Dummy-33::DEBUG::2014-07-24 10:21:24,166::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:24,168::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:24,177::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:24,178::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:24,179::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:24,179::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:24,179::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:24,179::task::913::TaskManager.Task::(_runJobs) Task=`2d699b85-9eca-4445-9348-322fa8c008a7`::Task.run: exit - success: result >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:24,180::task::990::TaskManager.Task::(_decref) Task=`2d699b85-9eca-4445-9348-322fa8c008a7`::ref 0 aborting False >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:21:24,180::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-33::DEBUG::2014-07-24 10:21:24,251::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0440555 s, 23.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:21:24,984::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [2d6aea48] >Thread-14::DEBUG::2014-07-24 10:21:24,984::task::595::TaskManager.Task::(_updateState) Task=`a658e022-88a3-41ce-98b5-c67dcb2a78b1`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:21:24,984::logUtils::44::dispatcher::(wrapper) Run and protect: getTaskStatus(taskID='2d699b85-9eca-4445-9348-322fa8c008a7', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-24 10:21:24,984::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 2d699b85-9eca-4445-9348-322fa8c008a7 >Thread-14::DEBUG::2014-07-24 10:21:24,985::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'} >Thread-14::INFO::2014-07-24 10:21:24,985::logUtils::47::dispatcher::(wrapper) Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-14::DEBUG::2014-07-24 10:21:24,985::task::1185::TaskManager.Task::(prepare) Task=`a658e022-88a3-41ce-98b5-c67dcb2a78b1`::finished: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '2d699b85-9eca-4445-9348-322fa8c008a7'}} >Thread-14::DEBUG::2014-07-24 10:21:24,985::task::595::TaskManager.Task::(_updateState) Task=`a658e022-88a3-41ce-98b5-c67dcb2a78b1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:21:24,985::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:21:24,985::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:21:24,986::task::990::TaskManager.Task::(_decref) Task=`a658e022-88a3-41ce-98b5-c67dcb2a78b1`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:21:25,023::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [2d6aea48] >Thread-14::DEBUG::2014-07-24 10:21:25,023::task::595::TaskManager.Task::(_updateState) Task=`a9c9f845-17ee-432f-89be-c287533c9570`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:21:25,023::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:21:25,024::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:21:25,024::task::1185::TaskManager.Task::(prepare) Task=`a9c9f845-17ee-432f-89be-c287533c9570`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:21:25,024::task::595::TaskManager.Task::(_updateState) Task=`a9c9f845-17ee-432f-89be-c287533c9570`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:21:25,024::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:21:25,024::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:21:25,025::task::990::TaskManager.Task::(_decref) Task=`a9c9f845-17ee-432f-89be-c287533c9570`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:21:25,099::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [2d6aea48] >Thread-14::DEBUG::2014-07-24 10:21:25,099::task::595::TaskManager.Task::(_updateState) Task=`7df73422-2341-4212-ad28-f3277f5773c7`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:21:25,099::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='2d699b85-9eca-4445-9348-322fa8c008a7', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-24 10:21:25,099::taskManager::161::TaskManager::(clearTask) Entry. taskID: 2d699b85-9eca-4445-9348-322fa8c008a7 >Thread-14::DEBUG::2014-07-24 10:21:25,100::taskManager::166::TaskManager::(clearTask) Return. >Thread-14::INFO::2014-07-24 10:21:25,100::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-14::DEBUG::2014-07-24 10:21:25,100::task::1185::TaskManager.Task::(prepare) Task=`7df73422-2341-4212-ad28-f3277f5773c7`::finished: None >Thread-14::DEBUG::2014-07-24 10:21:25,100::task::595::TaskManager.Task::(_updateState) Task=`7df73422-2341-4212-ad28-f3277f5773c7`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:21:25,100::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:21:25,100::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:21:25,100::task::990::TaskManager.Task::(_decref) Task=`7df73422-2341-4212-ad28-f3277f5773c7`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:21:25,292::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [2d6aea48] >Thread-34::DEBUG::2014-07-24 10:21:25,293::task::595::TaskManager.Task::(_updateState) Task=`bfedac85-9ee6-4709-8a4a-7d5409b47d48`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:21:25,293::logUtils::44::dispatcher::(wrapper) Run and protect: activateStorageDomain(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:21:25,293::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`730e2a8a-bfc4-446c-9d8b-3da1337faacf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1256' at 'activateStorageDomain' >Thread-34::DEBUG::2014-07-24 10:21:25,293::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'exclusive' >Thread-34::DEBUG::2014-07-24 10:21:25,294::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'exclusive' (1 active user) >Thread-34::DEBUG::2014-07-24 10:21:25,294::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`730e2a8a-bfc4-446c-9d8b-3da1337faacf`::Granted request >Thread-34::DEBUG::2014-07-24 10:21:25,294::task::827::TaskManager.Task::(resourceAcquired) Task=`bfedac85-9ee6-4709-8a4a-7d5409b47d48`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (exclusive) >Thread-34::DEBUG::2014-07-24 10:21:25,294::task::990::TaskManager.Task::(_decref) Task=`bfedac85-9ee6-4709-8a4a-7d5409b47d48`::ref 1 aborting False >Thread-34::DEBUG::2014-07-24 10:21:25,295::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.23aa0606-edc3-4882-a4aa-18aa1983458f`ReqID=`1530001c-dc46-4368-a0e8-430b3b1ef13b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1257' at 'activateStorageDomain' >Thread-34::DEBUG::2014-07-24 10:21:25,295::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f' for lock type 'exclusive' >Thread-34::DEBUG::2014-07-24 10:21:25,295::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f' is free. Now locking as 'exclusive' (1 active user) >Thread-34::DEBUG::2014-07-24 10:21:25,295::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.23aa0606-edc3-4882-a4aa-18aa1983458f`ReqID=`1530001c-dc46-4368-a0e8-430b3b1ef13b`::Granted request >Thread-34::DEBUG::2014-07-24 10:21:25,296::task::827::TaskManager.Task::(resourceAcquired) Task=`bfedac85-9ee6-4709-8a4a-7d5409b47d48`::_resourcesAcquired: Storage.23aa0606-edc3-4882-a4aa-18aa1983458f (exclusive) >Thread-34::DEBUG::2014-07-24 10:21:25,297::task::990::TaskManager.Task::(_decref) Task=`bfedac85-9ee6-4709-8a4a-7d5409b47d48`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:21:25,297::sp::1024::Storage.StoragePool::(activateSD) sdUUID=23aa0606-edc3-4882-a4aa-18aa1983458f spUUID=637ea13c-81a8-4b44-8cab-961458b01883 >Thread-34::INFO::2014-07-24 10:21:25,297::logUtils::47::dispatcher::(wrapper) Run and protect: activateStorageDomain, Return response: None >Thread-34::DEBUG::2014-07-24 10:21:25,297::task::1185::TaskManager.Task::(prepare) Task=`bfedac85-9ee6-4709-8a4a-7d5409b47d48`::finished: None >Thread-34::DEBUG::2014-07-24 10:21:25,297::task::595::TaskManager.Task::(_updateState) Task=`bfedac85-9ee6-4709-8a4a-7d5409b47d48`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:21:25,298::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f': < ResourceRef 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f', isValid: 'True' obj: 'None'>, 'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:21:25,298::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:21:25,298::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f' >Thread-34::DEBUG::2014-07-24 10:21:25,298::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f' (0 active users) >Thread-34::DEBUG::2014-07-24 10:21:25,298::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:21:25,298::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f', Clearing records. >Thread-34::DEBUG::2014-07-24 10:21:25,299::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:21:25,299::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:21:25,299::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:21:25,299::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:21:25,299::task::990::TaskManager.Task::(_decref) Task=`bfedac85-9ee6-4709-8a4a-7d5409b47d48`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:21:25,407::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [2d6aea48] >Thread-14::DEBUG::2014-07-24 10:21:25,407::task::595::TaskManager.Task::(_updateState) Task=`9844afc6-c991-4229-86dd-77902e924be1`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:21:25,407::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', hostID=1, msdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', masterVersion=1, domainsMap=None, options=None) >Thread-14::DEBUG::2014-07-24 10:21:25,408::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`e79bd3b8-741d-4e4d-a864-e5054ad37a5d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1018' at 'connectStoragePool' >Thread-14::DEBUG::2014-07-24 10:21:25,408::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive' >Thread-14::DEBUG::2014-07-24 10:21:25,408::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user) >Thread-14::DEBUG::2014-07-24 10:21:25,408::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`e79bd3b8-741d-4e4d-a864-e5054ad37a5d`::Granted request >Thread-14::DEBUG::2014-07-24 10:21:25,409::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e8d9919d-149f-4923-ad56-648f5e82ab82`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1056' at '_connectStoragePool' >Thread-14::DEBUG::2014-07-24 10:21:25,409::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-14::DEBUG::2014-07-24 10:21:25,409::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-14::DEBUG::2014-07-24 10:21:25,409::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e8d9919d-149f-4923-ad56-648f5e82ab82`::Granted request >Thread-14::DEBUG::2014-07-24 10:21:25,409::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:21:25,410::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:21:25,410::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:21:25,410::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:21:25,410::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:21:25,410::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:21:25,411::misc::738::SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-14::DEBUG::2014-07-24 10:21:25,411::misc::740::SamplingMethod::(__call__) Got in to sampling method >Thread-14::DEBUG::2014-07-24 10:21:25,411::misc::738::SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-14::DEBUG::2014-07-24 10:21:25,411::misc::740::SamplingMethod::(__call__) Got in to sampling method >Thread-14::DEBUG::2014-07-24 10:21:25,411::iscsi::407::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-14::DEBUG::2014-07-24 10:21:25,412::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) '/usr/bin/sudo -n /sbin/iscsiadm -m session -R' (cwd None) >Thread-14::DEBUG::2014-07-24 10:21:25,438::misc::748::SamplingMethod::(__call__) Returning last result >Thread-14::DEBUG::2014-07-24 10:21:25,438::multipath::109::Storage.Misc.excCmd::(rescan) '/usr/bin/sudo -n /sbin/multipath' (cwd None) >Thread-14::DEBUG::2014-07-24 10:21:25,573::multipath::109::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:21:25,574::lvm::497::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:21:25,574::lvm::499::OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:21:25,574::lvm::508::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:21:25,575::lvm::510::OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:21:25,575::lvm::528::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:21:25,575::lvm::530::OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:21:25,575::misc::748::SamplingMethod::(__call__) Returning last result >Thread-14::DEBUG::2014-07-24 10:21:25,575::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:21:25,578::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-14::DEBUG::2014-07-24 10:21:25,750::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:21:25,751::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:21:25,751::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-14::DEBUG::2014-07-24 10:21:25,752::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata count=1' (cwd None) >Thread-14::DEBUG::2014-07-24 10:21:25,759::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000496282 s, 4.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:21:25,759::misc::264::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000496282 s, 4.1 MB/s'], size: 2048 >Thread-14::DEBUG::2014-07-24 10:21:25,760::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-14::WARNING::2014-07-24 10:21:25,760::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-14::DEBUG::2014-07-24 10:21:25,760::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-14::DEBUG::2014-07-24 10:21:25,760::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:21:25,761::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:21:25,761::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:21:25,761::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:21:25,761::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:21:25,762::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-14::DEBUG::2014-07-24 10:21:25,931::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:21:25,932::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::DEBUG::2014-07-24 10:21:25,933::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'LOCKPOLICY=', 'POOL_DOMAINS=23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'POOL_DESCRIPTION=DS1', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_UUID=637ea13c-81a8-4b44-8cab-961458b01883', 'POOL_SPM_ID=1', '_SHA_CKSUM=a749afdc7119a2d6aad840af5c63c9b28c0b612c', 'POOL_SPM_LVER=0'] >Thread-14::INFO::2014-07-24 10:21:25,934::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_imageNS already registered >Thread-14::INFO::2014-07-24 10:21:25,934::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_volumeNS already registered >Thread-14::INFO::2014-07-24 10:21:25,934::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_lvmActivationNS already registered >Thread-14::DEBUG::2014-07-24 10:21:25,934::sp::1375::Storage.StoragePool::(setMasterDomain) Master domain 23aa0606-edc3-4882-a4aa-18aa1983458f verified, version 1 >Thread-14::DEBUG::2014-07-24 10:21:25,934::misc::738::SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-14::DEBUG::2014-07-24 10:21:25,934::misc::740::SamplingMethod::(__call__) Got in to sampling method >Thread-14::DEBUG::2014-07-24 10:21:25,935::misc::748::SamplingMethod::(__call__) Returning last result >Thread-14::WARNING::2014-07-24 10:21:25,935::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883 already exists >Thread-14::DEBUG::2014-07-24 10:21:25,935::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-14::DEBUG::2014-07-24 10:21:25,936::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name' (cwd None) >Thread-14::DEBUG::2014-07-24 10:21:26,130::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:21:26,132::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-14::WARNING::2014-07-24 10:21:26,133::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/23aa0606-edc3-4882-a4aa-18aa1983458f/images already exists >Thread-14::WARNING::2014-07-24 10:21:26,133::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/23aa0606-edc3-4882-a4aa-18aa1983458f/dom_md already exists >Thread-14::INFO::2014-07-24 10:21:26,134::sp::1113::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/23aa0606-edc3-4882-a4aa-18aa1983458f to /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/23aa0606-edc3-4882-a4aa-18aa1983458f >Thread-14::INFO::2014-07-24 10:21:26,134::sp::1113::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/23aa0606-edc3-4882-a4aa-18aa1983458f to /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd >Thread-14::DEBUG::2014-07-24 10:21:26,134::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-14::DEBUG::2014-07-24 10:21:26,135::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-14::DEBUG::2014-07-24 10:21:26,135::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-14::DEBUG::2014-07-24 10:21:26,135::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-14::DEBUG::2014-07-24 10:21:26,135::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock' >Thread-14::DEBUG::2014-07-24 10:21:26,136::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users) >Thread-14::DEBUG::2014-07-24 10:21:26,136::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it. >Thread-14::DEBUG::2014-07-24 10:21:26,136::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records. >Thread-14::INFO::2014-07-24 10:21:26,136::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-14::DEBUG::2014-07-24 10:21:26,136::task::1185::TaskManager.Task::(prepare) Task=`9844afc6-c991-4229-86dd-77902e924be1`::finished: True >Thread-14::DEBUG::2014-07-24 10:21:26,137::task::595::TaskManager.Task::(_updateState) Task=`9844afc6-c991-4229-86dd-77902e924be1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:21:26,137::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:21:26,137::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:21:26,137::task::990::TaskManager.Task::(_decref) Task=`9844afc6-c991-4229-86dd-77902e924be1`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:21:26,263::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:21:26,335::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337706 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:21:28,347::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:21:28,425::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372233 s, 27.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:21:30,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:21:30,513::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369042 s, 27.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:21:30,764::task::595::TaskManager.Task::(_updateState) Task=`7421d1a7-f334-44b5-9cf7-b5ff7934865e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:21:30,764::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:21:30,764::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000854709', 'lastCheck': '8.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:21:30,764::task::1185::TaskManager.Task::(prepare) Task=`7421d1a7-f334-44b5-9cf7-b5ff7934865e`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000854709', 'lastCheck': '8.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:21:30,765::task::595::TaskManager.Task::(_updateState) Task=`7421d1a7-f334-44b5-9cf7-b5ff7934865e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:21:30,765::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:21:30,765::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:21:30,765::task::990::TaskManager.Task::(_decref) Task=`7421d1a7-f334-44b5-9cf7-b5ff7934865e`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 10:21:32,190::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-18::DEBUG::2014-07-24 10:21:32,344::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:21:32,344::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:21:32,353::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000652124 s, 6.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:21:32,525::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:21:32,599::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359022 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:21:34,612::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:21:34,686::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359082 s, 28.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:21:35,382::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:21:35,383::task::595::TaskManager.Task::(_updateState) Task=`ad8637e6-e1b6-48ca-aaa8-d62937d8bdfd`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:21:35,383::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:21:35,383::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:21:35,383::task::1185::TaskManager.Task::(prepare) Task=`ad8637e6-e1b6-48ca-aaa8-d62937d8bdfd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:21:35,384::task::595::TaskManager.Task::(_updateState) Task=`ad8637e6-e1b6-48ca-aaa8-d62937d8bdfd`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:21:35,384::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:21:35,384::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:21:35,384::task::990::TaskManager.Task::(_decref) Task=`ad8637e6-e1b6-48ca-aaa8-d62937d8bdfd`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:21:35,426::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:21:35,426::task::595::TaskManager.Task::(_updateState) Task=`8dd86c14-51ba-4779-97ad-f9c023c1c491`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:21:35,426::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:21:35,427::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`53c6c430-6f8a-4a3a-8ae2-e89ab7dc1ff8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:21:35,427::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:21:35,427::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:21:35,427::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`53c6c430-6f8a-4a3a-8ae2-e89ab7dc1ff8`::Granted request >Thread-34::DEBUG::2014-07-24 10:21:35,428::task::827::TaskManager.Task::(resourceAcquired) Task=`8dd86c14-51ba-4779-97ad-f9c023c1c491`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:21:35,428::task::990::TaskManager.Task::(_decref) Task=`8dd86c14-51ba-4779-97ad-f9c023c1c491`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:21:35,428::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '38386270208', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:21:35,429::task::1185::TaskManager.Task::(prepare) Task=`8dd86c14-51ba-4779-97ad-f9c023c1c491`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '38386270208', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:21:35,429::task::595::TaskManager.Task::(_updateState) Task=`8dd86c14-51ba-4779-97ad-f9c023c1c491`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:21:35,429::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:21:35,429::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:21:35,429::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:21:35,430::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:21:35,430::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:21:35,430::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:21:35,430::task::990::TaskManager.Task::(_decref) Task=`8dd86c14-51ba-4779-97ad-f9c023c1c491`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:21:36,698::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:21:36,775::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346322 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:21:38,788::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:21:39,152::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.323564 s, 3.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:21:41,164::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:21:41,272::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.069624 s, 14.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:21:42,359::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:21:42,367::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000682754 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:21:43,284::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:21:43,358::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361187 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:21:45,371::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:21:45,444::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354606 s, 28.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:21:45,499::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:21:45,500::task::595::TaskManager.Task::(_updateState) Task=`3f57b949-f46e-4574-92a9-5c6abd42b5ee`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:21:45,500::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:21:45,500::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:21:45,500::task::1185::TaskManager.Task::(prepare) Task=`3f57b949-f46e-4574-92a9-5c6abd42b5ee`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:21:45,501::task::595::TaskManager.Task::(_updateState) Task=`3f57b949-f46e-4574-92a9-5c6abd42b5ee`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:21:45,501::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:21:45,501::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:21:45,501::task::990::TaskManager.Task::(_decref) Task=`3f57b949-f46e-4574-92a9-5c6abd42b5ee`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:21:45,534::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:21:45,535::task::595::TaskManager.Task::(_updateState) Task=`754cd305-6dfa-42b3-879b-c13526c99e9a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:21:45,535::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:21:45,535::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ad92a2fc-50ff-4f94-bd03-f9af0ffff231`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:21:45,536::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:21:45,538::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:21:45,538::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ad92a2fc-50ff-4f94-bd03-f9af0ffff231`::Granted request >Thread-34::DEBUG::2014-07-24 10:21:45,539::task::827::TaskManager.Task::(resourceAcquired) Task=`754cd305-6dfa-42b3-879b-c13526c99e9a`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:21:45,539::task::990::TaskManager.Task::(_decref) Task=`754cd305-6dfa-42b3-879b-c13526c99e9a`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:21:45,539::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '38386270208', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:21:45,540::task::1185::TaskManager.Task::(prepare) Task=`754cd305-6dfa-42b3-879b-c13526c99e9a`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '38386270208', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:21:45,540::task::595::TaskManager.Task::(_updateState) Task=`754cd305-6dfa-42b3-879b-c13526c99e9a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:21:45,540::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:21:45,540::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:21:45,540::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:21:45,541::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:21:45,541::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:21:45,541::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:21:45,541::task::990::TaskManager.Task::(_decref) Task=`754cd305-6dfa-42b3-879b-c13526c99e9a`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:21:46,105::task::595::TaskManager.Task::(_updateState) Task=`b61522a4-1263-48e8-bc71-6637906f51b3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:21:46,105::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:21:46,105::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000682754', 'lastCheck': '3.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:21:46,106::task::1185::TaskManager.Task::(prepare) Task=`b61522a4-1263-48e8-bc71-6637906f51b3`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000682754', 'lastCheck': '3.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:21:46,106::task::595::TaskManager.Task::(_updateState) Task=`b61522a4-1263-48e8-bc71-6637906f51b3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:21:46,106::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:21:46,106::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:21:46,106::task::990::TaskManager.Task::(_decref) Task=`b61522a4-1263-48e8-bc71-6637906f51b3`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:21:47,457::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:21:47,529::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345216 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:21:49,542::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:21:49,613::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332053 s, 30.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:21:51,625::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:21:51,709::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0455507 s, 22.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:21:52,378::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:21:52,386::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000706725 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:21:53,721::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:21:53,802::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0411468 s, 24.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:21:55,606::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:21:55,606::task::595::TaskManager.Task::(_updateState) Task=`6c7a2da0-b3ef-450b-b8ff-d2f9e934e168`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:21:55,607::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:21:55,607::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:21:55,607::task::1185::TaskManager.Task::(prepare) Task=`6c7a2da0-b3ef-450b-b8ff-d2f9e934e168`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:21:55,607::task::595::TaskManager.Task::(_updateState) Task=`6c7a2da0-b3ef-450b-b8ff-d2f9e934e168`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:21:55,607::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:21:55,608::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:21:55,608::task::990::TaskManager.Task::(_decref) Task=`6c7a2da0-b3ef-450b-b8ff-d2f9e934e168`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:21:55,656::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:21:55,656::task::595::TaskManager.Task::(_updateState) Task=`4d48aa15-c07c-46fb-a3df-0b4732a11a9d`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:21:55,656::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:21:55,657::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1c9a0d47-e341-4312-8fc9-562f73675a2d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:21:55,657::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:21:55,657::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:21:55,657::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1c9a0d47-e341-4312-8fc9-562f73675a2d`::Granted request >Thread-34::DEBUG::2014-07-24 10:21:55,658::task::827::TaskManager.Task::(resourceAcquired) Task=`4d48aa15-c07c-46fb-a3df-0b4732a11a9d`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:21:55,658::task::990::TaskManager.Task::(_decref) Task=`4d48aa15-c07c-46fb-a3df-0b4732a11a9d`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:21:55,659::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '38386270208', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:21:55,659::task::1185::TaskManager.Task::(prepare) Task=`4d48aa15-c07c-46fb-a3df-0b4732a11a9d`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '38386270208', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:21:55,659::task::595::TaskManager.Task::(_updateState) Task=`4d48aa15-c07c-46fb-a3df-0b4732a11a9d`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:21:55,659::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:21:55,659::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:21:55,660::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:21:55,660::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:21:55,660::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:21:55,660::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:21:55,660::task::990::TaskManager.Task::(_decref) Task=`4d48aa15-c07c-46fb-a3df-0b4732a11a9d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:21:55,815::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:21:55,887::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340732 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:21:57,899::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:21:57,970::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332251 s, 30.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:21:59,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:22:00,055::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334378 s, 30.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:22:01,439::task::595::TaskManager.Task::(_updateState) Task=`b3a56038-0e9f-4709-bce0-d67716122769`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:22:01,439::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:22:01,440::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000706725', 'lastCheck': '9.0', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:22:01,440::task::1185::TaskManager.Task::(prepare) Task=`b3a56038-0e9f-4709-bce0-d67716122769`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000706725', 'lastCheck': '9.0', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:22:01,440::task::595::TaskManager.Task::(_updateState) Task=`b3a56038-0e9f-4709-bce0-d67716122769`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:22:01,440::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:22:01,440::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:22:01,441::task::990::TaskManager.Task::(_decref) Task=`b3a56038-0e9f-4709-bce0-d67716122769`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:22:02,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:22:02,141::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357926 s, 28.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:22:02,391::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:22:02,400::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000628062 s, 6.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:22:04,153::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:22:04,228::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367618 s, 27.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:22:05,749::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:22:05,749::task::595::TaskManager.Task::(_updateState) Task=`20440962-2b4d-4f3e-8aa6-5382abb0a69e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:22:05,749::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:22:05,750::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:22:05,750::task::1185::TaskManager.Task::(prepare) Task=`20440962-2b4d-4f3e-8aa6-5382abb0a69e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:22:05,750::task::595::TaskManager.Task::(_updateState) Task=`20440962-2b4d-4f3e-8aa6-5382abb0a69e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:22:05,750::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:22:05,750::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:22:05,750::task::990::TaskManager.Task::(_decref) Task=`20440962-2b4d-4f3e-8aa6-5382abb0a69e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:22:05,785::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:22:05,785::task::595::TaskManager.Task::(_updateState) Task=`04f5db1a-1762-4ee8-87de-de19ca6fb611`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:22:05,785::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:22:05,786::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`6f6fb4be-ec76-4fad-b080-53d105754186`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:22:05,786::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:22:05,786::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:22:05,786::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`6f6fb4be-ec76-4fad-b080-53d105754186`::Granted request >Thread-34::DEBUG::2014-07-24 10:22:05,787::task::827::TaskManager.Task::(resourceAcquired) Task=`04f5db1a-1762-4ee8-87de-de19ca6fb611`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:22:05,787::task::990::TaskManager.Task::(_decref) Task=`04f5db1a-1762-4ee8-87de-de19ca6fb611`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:22:05,788::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '38386270208', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:22:05,788::task::1185::TaskManager.Task::(prepare) Task=`04f5db1a-1762-4ee8-87de-de19ca6fb611`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '38386270208', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:22:05,788::task::595::TaskManager.Task::(_updateState) Task=`04f5db1a-1762-4ee8-87de-de19ca6fb611`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:22:05,788::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:22:05,788::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:22:05,788::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:22:05,789::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:22:05,789::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:22:05,789::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:22:05,789::task::990::TaskManager.Task::(_decref) Task=`04f5db1a-1762-4ee8-87de-de19ca6fb611`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:22:06,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:22:06,313::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343794 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:22:08,325::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:22:08,400::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361343 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:22:10,412::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:22:10,491::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0405101 s, 25.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:22:12,405::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:22:12,413::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000732297 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:22:12,504::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:22:12,581::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0386784 s, 26.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:22:14,593::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:22:14,666::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342993 s, 29.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:22:15,848::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:22:15,848::task::595::TaskManager.Task::(_updateState) Task=`4ea704cd-6a96-4676-9445-63323129e6b4`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:22:15,848::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:22:15,849::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:22:15,849::task::1185::TaskManager.Task::(prepare) Task=`4ea704cd-6a96-4676-9445-63323129e6b4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:22:15,849::task::595::TaskManager.Task::(_updateState) Task=`4ea704cd-6a96-4676-9445-63323129e6b4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:22:15,849::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:22:15,849::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:22:15,849::task::990::TaskManager.Task::(_decref) Task=`4ea704cd-6a96-4676-9445-63323129e6b4`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:22:15,882::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:22:15,882::task::595::TaskManager.Task::(_updateState) Task=`2f0dca10-e811-4a38-a7fe-41854b1eaa49`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:22:15,883::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:22:15,883::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4d6605f1-be81-4115-8c17-79ecc1c5fc3e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:22:15,883::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:22:15,883::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:22:15,883::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4d6605f1-be81-4115-8c17-79ecc1c5fc3e`::Granted request >Thread-34::DEBUG::2014-07-24 10:22:15,884::task::827::TaskManager.Task::(resourceAcquired) Task=`2f0dca10-e811-4a38-a7fe-41854b1eaa49`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:22:15,884::task::990::TaskManager.Task::(_decref) Task=`2f0dca10-e811-4a38-a7fe-41854b1eaa49`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:22:15,885::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '38386270208', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:22:15,885::task::1185::TaskManager.Task::(prepare) Task=`2f0dca10-e811-4a38-a7fe-41854b1eaa49`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '38386270208', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:22:15,885::task::595::TaskManager.Task::(_updateState) Task=`2f0dca10-e811-4a38-a7fe-41854b1eaa49`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:22:15,885::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:22:15,885::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:22:15,886::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:22:15,886::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:22:15,886::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:22:15,886::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:22:15,886::task::990::TaskManager.Task::(_decref) Task=`2f0dca10-e811-4a38-a7fe-41854b1eaa49`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:22:16,679::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:22:16,751::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341081 s, 30.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:22:16,805::task::595::TaskManager.Task::(_updateState) Task=`f1995283-7c41-46f0-81be-90ca1a555d58`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:22:16,805::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:22:16,805::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000732297', 'lastCheck': '4.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:22:16,805::task::1185::TaskManager.Task::(prepare) Task=`f1995283-7c41-46f0-81be-90ca1a555d58`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000732297', 'lastCheck': '4.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:22:16,805::task::595::TaskManager.Task::(_updateState) Task=`f1995283-7c41-46f0-81be-90ca1a555d58`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:22:16,805::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:22:16,806::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:22:16,806::task::990::TaskManager.Task::(_decref) Task=`f1995283-7c41-46f0-81be-90ca1a555d58`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:22:18,763::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:22:18,836::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343194 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:22:20,848::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:22:20,922::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355108 s, 28.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:22:22,418::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:22:22,426::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00072234 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:22:22,935::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:22:23,010::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336007 s, 30.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:22:25,023::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:22:25,095::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03412 s, 30.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:22:25,942::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:22:25,947::task::595::TaskManager.Task::(_updateState) Task=`948f1a6c-d9e3-494b-b35a-3a7b592ad510`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:22:25,947::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:22:25,948::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:22:25,948::task::1185::TaskManager.Task::(prepare) Task=`948f1a6c-d9e3-494b-b35a-3a7b592ad510`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:22:25,948::task::595::TaskManager.Task::(_updateState) Task=`948f1a6c-d9e3-494b-b35a-3a7b592ad510`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:22:25,948::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:22:25,948::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:22:25,949::task::990::TaskManager.Task::(_decref) Task=`948f1a6c-d9e3-494b-b35a-3a7b592ad510`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:22:25,982::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:22:25,982::task::595::TaskManager.Task::(_updateState) Task=`a6e94b52-264b-4e98-b745-3c1fa9b39627`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:22:25,982::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:22:25,983::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7d09a8c2-acc3-49ea-96d9-c0c418772271`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:22:25,984::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:22:25,984::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:22:25,984::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7d09a8c2-acc3-49ea-96d9-c0c418772271`::Granted request >Thread-34::DEBUG::2014-07-24 10:22:25,984::task::827::TaskManager.Task::(resourceAcquired) Task=`a6e94b52-264b-4e98-b745-3c1fa9b39627`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:22:25,985::task::990::TaskManager.Task::(_decref) Task=`a6e94b52-264b-4e98-b745-3c1fa9b39627`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:22:25,985::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '38386270208', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:22:25,985::task::1185::TaskManager.Task::(prepare) Task=`a6e94b52-264b-4e98-b745-3c1fa9b39627`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '38386270208', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:22:25,986::task::595::TaskManager.Task::(_updateState) Task=`a6e94b52-264b-4e98-b745-3c1fa9b39627`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:22:25,986::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:22:25,986::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:22:25,986::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:22:25,986::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:22:25,986::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:22:25,987::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:22:25,987::task::990::TaskManager.Task::(_decref) Task=`a6e94b52-264b-4e98-b745-3c1fa9b39627`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:22:27,107::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:22:27,179::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343204 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:22:29,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:22:29,267::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362511 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:22:31,279::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:22:31,352::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353018 s, 29.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:22:32,121::task::595::TaskManager.Task::(_updateState) Task=`d10f6a22-66eb-487c-92a0-514c57586b73`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:22:32,121::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:22:32,122::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00072234', 'lastCheck': '9.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:22:32,122::task::1185::TaskManager.Task::(prepare) Task=`d10f6a22-66eb-487c-92a0-514c57586b73`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00072234', 'lastCheck': '9.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:22:32,122::task::595::TaskManager.Task::(_updateState) Task=`d10f6a22-66eb-487c-92a0-514c57586b73`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:22:32,122::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:22:32,122::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:22:32,123::task::990::TaskManager.Task::(_decref) Task=`d10f6a22-66eb-487c-92a0-514c57586b73`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 10:22:32,431::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:22:32,439::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000787428 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:22:33,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:22:33,436::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333071 s, 30.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:22:35,449::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:22:35,521::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342761 s, 29.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:22:36,084::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:22:36,084::task::595::TaskManager.Task::(_updateState) Task=`20def534-4773-46b3-942c-ea763a957734`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:22:36,085::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:22:36,085::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:22:36,085::task::1185::TaskManager.Task::(prepare) Task=`20def534-4773-46b3-942c-ea763a957734`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:22:36,085::task::595::TaskManager.Task::(_updateState) Task=`20def534-4773-46b3-942c-ea763a957734`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:22:36,086::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:22:36,086::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:22:36,086::task::990::TaskManager.Task::(_decref) Task=`20def534-4773-46b3-942c-ea763a957734`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:22:36,136::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:22:36,136::task::595::TaskManager.Task::(_updateState) Task=`984e56d3-2e09-4cd0-a6fe-4f99cc3ece97`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:22:36,137::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:22:36,137::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c3fe2ce3-7953-42a0-8df8-21e9d3728bb5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:22:36,137::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:22:36,137::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:22:36,137::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c3fe2ce3-7953-42a0-8df8-21e9d3728bb5`::Granted request >Thread-34::DEBUG::2014-07-24 10:22:36,138::task::827::TaskManager.Task::(resourceAcquired) Task=`984e56d3-2e09-4cd0-a6fe-4f99cc3ece97`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:22:36,138::task::990::TaskManager.Task::(_decref) Task=`984e56d3-2e09-4cd0-a6fe-4f99cc3ece97`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:22:36,139::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '38386270208', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:22:36,139::task::1185::TaskManager.Task::(prepare) Task=`984e56d3-2e09-4cd0-a6fe-4f99cc3ece97`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '38386270208', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:22:36,139::task::595::TaskManager.Task::(_updateState) Task=`984e56d3-2e09-4cd0-a6fe-4f99cc3ece97`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:22:36,139::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:22:36,139::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:22:36,140::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:22:36,140::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:22:36,140::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:22:36,140::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:22:36,140::task::990::TaskManager.Task::(_decref) Task=`984e56d3-2e09-4cd0-a6fe-4f99cc3ece97`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:22:37,534::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:22:37,608::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349535 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:22:39,622::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:22:39,694::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342607 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:22:41,706::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:22:41,777::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329839 s, 31.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:22:42,444::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:22:42,452::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000720137 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:22:43,789::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:22:43,875::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0470223 s, 21.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:22:45,887::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:22:45,958::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329488 s, 31.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:22:46,250::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:22:46,250::task::595::TaskManager.Task::(_updateState) Task=`b5fc0fd9-3ee3-4fa8-9369-ba5b79361980`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:22:46,250::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:22:46,251::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:22:46,251::task::1185::TaskManager.Task::(prepare) Task=`b5fc0fd9-3ee3-4fa8-9369-ba5b79361980`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:22:46,251::task::595::TaskManager.Task::(_updateState) Task=`b5fc0fd9-3ee3-4fa8-9369-ba5b79361980`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:22:46,251::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:22:46,251::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:22:46,251::task::990::TaskManager.Task::(_decref) Task=`b5fc0fd9-3ee3-4fa8-9369-ba5b79361980`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:22:46,303::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:22:46,303::task::595::TaskManager.Task::(_updateState) Task=`2fc6ec80-b917-4aa3-841d-b7b77f317ada`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:22:46,303::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:22:46,304::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`a6911237-5322-46e9-a577-11a9803ee786`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:22:46,304::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:22:46,304::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:22:46,304::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`a6911237-5322-46e9-a577-11a9803ee786`::Granted request >Thread-34::DEBUG::2014-07-24 10:22:46,305::task::827::TaskManager.Task::(resourceAcquired) Task=`2fc6ec80-b917-4aa3-841d-b7b77f317ada`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:22:46,305::task::990::TaskManager.Task::(_decref) Task=`2fc6ec80-b917-4aa3-841d-b7b77f317ada`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:22:46,306::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '38386270208', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:22:46,306::task::1185::TaskManager.Task::(prepare) Task=`2fc6ec80-b917-4aa3-841d-b7b77f317ada`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '38386270208', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:22:46,306::task::595::TaskManager.Task::(_updateState) Task=`2fc6ec80-b917-4aa3-841d-b7b77f317ada`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:22:46,306::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:22:46,306::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:22:46,307::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:22:46,307::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:22:46,307::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:22:46,307::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:22:46,307::task::990::TaskManager.Task::(_decref) Task=`2fc6ec80-b917-4aa3-841d-b7b77f317ada`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:22:47,565::task::595::TaskManager.Task::(_updateState) Task=`83bd8462-3d18-4a8e-abea-a7b4a2177215`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:22:47,565::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:22:47,565::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000720137', 'lastCheck': '5.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:22:47,565::task::1185::TaskManager.Task::(prepare) Task=`83bd8462-3d18-4a8e-abea-a7b4a2177215`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000720137', 'lastCheck': '5.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:22:47,566::task::595::TaskManager.Task::(_updateState) Task=`83bd8462-3d18-4a8e-abea-a7b4a2177215`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:22:47,566::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:22:47,566::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:22:47,566::task::990::TaskManager.Task::(_decref) Task=`83bd8462-3d18-4a8e-abea-a7b4a2177215`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:22:47,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:22:48,042::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337219 s, 30.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:22:50,055::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:22:50,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362365 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:22:52,141::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:22:52,214::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348145 s, 29.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:22:52,457::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:22:52,465::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000693213 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:22:54,226::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:22:54,298::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334511 s, 30.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:22:56,311::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:22:56,384::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359006 s, 28.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:22:56,412::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:22:56,413::task::595::TaskManager.Task::(_updateState) Task=`d82fc420-db51-4d17-a0b8-f3975817f9c4`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:22:56,413::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:22:56,414::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:22:56,414::task::1185::TaskManager.Task::(prepare) Task=`d82fc420-db51-4d17-a0b8-f3975817f9c4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:22:56,414::task::595::TaskManager.Task::(_updateState) Task=`d82fc420-db51-4d17-a0b8-f3975817f9c4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:22:56,414::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:22:56,414::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:22:56,414::task::990::TaskManager.Task::(_decref) Task=`d82fc420-db51-4d17-a0b8-f3975817f9c4`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:22:56,446::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:22:56,446::task::595::TaskManager.Task::(_updateState) Task=`9e0f8f8e-48c0-4be0-b8a5-bf08b546dd70`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:22:56,446::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:22:56,447::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ed44fd86-90ca-40f3-acc2-9f6bc22b5ec7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:22:56,447::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:22:56,447::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:22:56,447::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ed44fd86-90ca-40f3-acc2-9f6bc22b5ec7`::Granted request >Thread-34::DEBUG::2014-07-24 10:22:56,448::task::827::TaskManager.Task::(resourceAcquired) Task=`9e0f8f8e-48c0-4be0-b8a5-bf08b546dd70`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:22:56,448::task::990::TaskManager.Task::(_decref) Task=`9e0f8f8e-48c0-4be0-b8a5-bf08b546dd70`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:22:56,449::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '38386270208', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:22:56,449::task::1185::TaskManager.Task::(prepare) Task=`9e0f8f8e-48c0-4be0-b8a5-bf08b546dd70`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '38386270208', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:22:56,449::task::595::TaskManager.Task::(_updateState) Task=`9e0f8f8e-48c0-4be0-b8a5-bf08b546dd70`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:22:56,449::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:22:56,449::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:22:56,450::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:22:56,450::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:22:56,450::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:22:56,450::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:22:56,450::task::990::TaskManager.Task::(_decref) Task=`9e0f8f8e-48c0-4be0-b8a5-bf08b546dd70`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:22:58,397::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:22:58,471::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362577 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:23:00,483::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:23:00,558::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349882 s, 29.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:23:02,470::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:23:02,478::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000839886 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:23:02,571::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:23:02,645::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358957 s, 28.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:23:03,069::task::595::TaskManager.Task::(_updateState) Task=`c99034ee-cdf0-4f86-88ef-3bb365516e3a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:23:03,070::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:23:03,070::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000839886', 'lastCheck': '0.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:23:03,070::task::1185::TaskManager.Task::(prepare) Task=`c99034ee-cdf0-4f86-88ef-3bb365516e3a`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000839886', 'lastCheck': '0.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:23:03,070::task::595::TaskManager.Task::(_updateState) Task=`c99034ee-cdf0-4f86-88ef-3bb365516e3a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:23:03,070::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:23:03,070::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:23:03,071::task::990::TaskManager.Task::(_decref) Task=`c99034ee-cdf0-4f86-88ef-3bb365516e3a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:23:04,657::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:23:04,732::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359526 s, 28.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:23:06,512::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:23:06,512::task::595::TaskManager.Task::(_updateState) Task=`feed0991-d025-4ff6-8635-b6b6fe8bff40`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:23:06,512::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:23:06,513::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:23:06,513::task::1185::TaskManager.Task::(prepare) Task=`feed0991-d025-4ff6-8635-b6b6fe8bff40`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:23:06,513::task::595::TaskManager.Task::(_updateState) Task=`feed0991-d025-4ff6-8635-b6b6fe8bff40`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:23:06,513::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:23:06,513::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:23:06,514::task::990::TaskManager.Task::(_decref) Task=`feed0991-d025-4ff6-8635-b6b6fe8bff40`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:23:06,548::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:23:06,549::task::595::TaskManager.Task::(_updateState) Task=`856938aa-b240-40c9-aac7-d6f605943f6f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:23:06,549::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:23:06,549::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c53317dd-2026-4f97-8d1b-759dfc59b089`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:23:06,549::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:23:06,550::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:23:06,550::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c53317dd-2026-4f97-8d1b-759dfc59b089`::Granted request >Thread-34::DEBUG::2014-07-24 10:23:06,550::task::827::TaskManager.Task::(resourceAcquired) Task=`856938aa-b240-40c9-aac7-d6f605943f6f`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:23:06,550::task::990::TaskManager.Task::(_decref) Task=`856938aa-b240-40c9-aac7-d6f605943f6f`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:23:06,551::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '38386270208', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:23:06,551::task::1185::TaskManager.Task::(prepare) Task=`856938aa-b240-40c9-aac7-d6f605943f6f`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '38386270208', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:23:06,551::task::595::TaskManager.Task::(_updateState) Task=`856938aa-b240-40c9-aac7-d6f605943f6f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:23:06,551::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:23:06,552::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:23:06,554::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:23:06,554::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:23:06,554::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:23:06,554::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:23:06,555::task::990::TaskManager.Task::(_decref) Task=`856938aa-b240-40c9-aac7-d6f605943f6f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:23:06,744::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:23:06,816::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033724 s, 30.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:23:08,828::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:23:08,899::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336987 s, 30.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:23:10,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:23:10,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332589 s, 30.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:23:12,483::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:23:12,492::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000651298 s, 6.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:23:12,995::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:23:13,068::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343937 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:23:15,080::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:23:15,155::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351394 s, 29.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:23:16,609::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:23:16,610::task::595::TaskManager.Task::(_updateState) Task=`824e0169-9e4a-4d39-a99d-059e14ea4868`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:23:16,610::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:23:16,610::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:23:16,611::task::1185::TaskManager.Task::(prepare) Task=`824e0169-9e4a-4d39-a99d-059e14ea4868`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:23:16,611::task::595::TaskManager.Task::(_updateState) Task=`824e0169-9e4a-4d39-a99d-059e14ea4868`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:23:16,611::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:23:16,611::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:23:16,611::task::990::TaskManager.Task::(_decref) Task=`824e0169-9e4a-4d39-a99d-059e14ea4868`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:23:16,655::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:23:16,655::task::595::TaskManager.Task::(_updateState) Task=`4b6c54b6-6ce4-4eed-b1c0-cbb63a8ff43f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:23:16,655::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:23:16,655::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d0336ddc-7eeb-4791-8d2c-ced0d141972e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:23:16,656::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:23:16,656::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:23:16,656::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d0336ddc-7eeb-4791-8d2c-ced0d141972e`::Granted request >Thread-34::DEBUG::2014-07-24 10:23:16,656::task::827::TaskManager.Task::(resourceAcquired) Task=`4b6c54b6-6ce4-4eed-b1c0-cbb63a8ff43f`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:23:16,657::task::990::TaskManager.Task::(_decref) Task=`4b6c54b6-6ce4-4eed-b1c0-cbb63a8ff43f`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:23:16,657::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '38386270208', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:23:16,657::task::1185::TaskManager.Task::(prepare) Task=`4b6c54b6-6ce4-4eed-b1c0-cbb63a8ff43f`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '38386270208', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:23:16,658::task::595::TaskManager.Task::(_updateState) Task=`4b6c54b6-6ce4-4eed-b1c0-cbb63a8ff43f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:23:16,658::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:23:16,658::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:23:16,658::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:23:16,658::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:23:16,658::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:23:16,659::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:23:16,659::task::990::TaskManager.Task::(_decref) Task=`4b6c54b6-6ce4-4eed-b1c0-cbb63a8ff43f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:23:17,167::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:23:17,238::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332649 s, 30.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:23:18,441::task::595::TaskManager.Task::(_updateState) Task=`7558a8f6-7fad-4272-8ea4-2c8a719dc798`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:23:18,441::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:23:18,441::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000651298', 'lastCheck': '5.9', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:23:18,441::task::1185::TaskManager.Task::(prepare) Task=`7558a8f6-7fad-4272-8ea4-2c8a719dc798`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000651298', 'lastCheck': '5.9', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:23:18,441::task::595::TaskManager.Task::(_updateState) Task=`7558a8f6-7fad-4272-8ea4-2c8a719dc798`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:23:18,442::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:23:18,442::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:23:18,442::task::990::TaskManager.Task::(_decref) Task=`7558a8f6-7fad-4272-8ea4-2c8a719dc798`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:23:19,250::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:23:19,322::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335769 s, 30.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:23:21,335::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:23:21,487::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.114916 s, 8.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:23:22,496::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:23:22,505::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000707992 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:23:23,500::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:23:23,572::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336825 s, 30.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:23:25,584::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:23:25,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358103 s, 28.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:23:26,716::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:23:26,726::task::595::TaskManager.Task::(_updateState) Task=`4468a007-510f-4b6b-863d-c398354ccf24`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:23:26,726::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:23:26,727::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:23:26,727::task::1185::TaskManager.Task::(prepare) Task=`4468a007-510f-4b6b-863d-c398354ccf24`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:23:26,727::task::595::TaskManager.Task::(_updateState) Task=`4468a007-510f-4b6b-863d-c398354ccf24`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:23:26,727::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:23:26,727::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:23:26,727::task::990::TaskManager.Task::(_decref) Task=`4468a007-510f-4b6b-863d-c398354ccf24`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:23:26,759::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:23:26,760::task::595::TaskManager.Task::(_updateState) Task=`74f2b7c0-ab4f-44a2-96bd-3dc2dc02ae0a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:23:26,760::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:23:26,760::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`8ad118cd-2614-4036-9a8b-626fd641efc1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:23:26,760::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:23:26,761::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:23:26,761::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`8ad118cd-2614-4036-9a8b-626fd641efc1`::Granted request >Thread-34::DEBUG::2014-07-24 10:23:26,761::task::827::TaskManager.Task::(resourceAcquired) Task=`74f2b7c0-ab4f-44a2-96bd-3dc2dc02ae0a`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:23:26,761::task::990::TaskManager.Task::(_decref) Task=`74f2b7c0-ab4f-44a2-96bd-3dc2dc02ae0a`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:23:26,762::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '38386270208', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:23:26,762::task::1185::TaskManager.Task::(prepare) Task=`74f2b7c0-ab4f-44a2-96bd-3dc2dc02ae0a`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '38386270208', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:23:26,762::task::595::TaskManager.Task::(_updateState) Task=`74f2b7c0-ab4f-44a2-96bd-3dc2dc02ae0a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:23:26,762::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:23:26,763::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:23:26,763::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:23:26,763::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:23:26,763::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:23:26,763::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:23:26,763::task::990::TaskManager.Task::(_decref) Task=`74f2b7c0-ab4f-44a2-96bd-3dc2dc02ae0a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:23:27,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:23:27,747::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365983 s, 28.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:23:29,759::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:23:29,832::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342805 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:23:31,844::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:23:31,916::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338053 s, 30.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:23:32,509::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:23:32,517::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000730159 s, 5.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:23:33,800::task::595::TaskManager.Task::(_updateState) Task=`36666dca-4041-446e-88d7-a13d67af2f14`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:23:33,800::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:23:33,801::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000730159', 'lastCheck': '1.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:23:33,801::task::1185::TaskManager.Task::(prepare) Task=`36666dca-4041-446e-88d7-a13d67af2f14`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000730159', 'lastCheck': '1.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:23:33,801::task::595::TaskManager.Task::(_updateState) Task=`36666dca-4041-446e-88d7-a13d67af2f14`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:23:33,801::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:23:33,801::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:23:33,801::task::990::TaskManager.Task::(_decref) Task=`36666dca-4041-446e-88d7-a13d67af2f14`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:23:33,929::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:23:34,015::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0473595 s, 21.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:23:36,027::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:23:36,101::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354086 s, 28.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:23:36,826::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:23:36,826::task::595::TaskManager.Task::(_updateState) Task=`5a9d255e-55b5-48f5-923e-8fe2ec9a6ac5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:23:36,827::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:23:36,827::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:23:36,827::task::1185::TaskManager.Task::(prepare) Task=`5a9d255e-55b5-48f5-923e-8fe2ec9a6ac5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:23:36,827::task::595::TaskManager.Task::(_updateState) Task=`5a9d255e-55b5-48f5-923e-8fe2ec9a6ac5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:23:36,828::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:23:36,828::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:23:36,828::task::990::TaskManager.Task::(_decref) Task=`5a9d255e-55b5-48f5-923e-8fe2ec9a6ac5`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:23:36,863::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:23:36,863::task::595::TaskManager.Task::(_updateState) Task=`eb2eed62-04d2-4706-a228-73a56a62c539`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:23:36,863::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:23:36,863::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`8ec035bf-f687-482c-bcf3-58e0d03072c5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:23:36,864::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:23:36,864::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:23:36,864::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`8ec035bf-f687-482c-bcf3-58e0d03072c5`::Granted request >Thread-34::DEBUG::2014-07-24 10:23:36,865::task::827::TaskManager.Task::(resourceAcquired) Task=`eb2eed62-04d2-4706-a228-73a56a62c539`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:23:36,865::task::990::TaskManager.Task::(_decref) Task=`eb2eed62-04d2-4706-a228-73a56a62c539`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:23:36,866::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '38386270208', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:23:36,866::task::1185::TaskManager.Task::(prepare) Task=`eb2eed62-04d2-4706-a228-73a56a62c539`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '38386270208', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:23:36,867::task::595::TaskManager.Task::(_updateState) Task=`eb2eed62-04d2-4706-a228-73a56a62c539`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:23:36,867::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:23:36,867::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:23:36,867::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:23:36,867::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:23:36,867::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:23:36,868::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:23:36,868::task::990::TaskManager.Task::(_decref) Task=`eb2eed62-04d2-4706-a228-73a56a62c539`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:23:38,113::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:23:38,187::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356978 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:23:40,199::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:23:40,272::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034254 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:23:42,284::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:23:42,357::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347735 s, 29.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:23:42,522::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:23:42,531::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000727001 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:23:44,369::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:23:44,444::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372378 s, 27.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:23:46,457::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:23:46,530::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346761 s, 29.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:23:46,962::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:23:46,962::task::595::TaskManager.Task::(_updateState) Task=`a2de4734-def3-465e-8a92-0e5bcc36954a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:23:46,962::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:23:46,963::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:23:46,963::task::1185::TaskManager.Task::(prepare) Task=`a2de4734-def3-465e-8a92-0e5bcc36954a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:23:46,963::task::595::TaskManager.Task::(_updateState) Task=`a2de4734-def3-465e-8a92-0e5bcc36954a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:23:46,963::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:23:46,963::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:23:46,964::task::990::TaskManager.Task::(_decref) Task=`a2de4734-def3-465e-8a92-0e5bcc36954a`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:23:47,061::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:23:47,061::task::595::TaskManager.Task::(_updateState) Task=`6fc71cc6-b7dc-4c6c-9dfd-7519f4128278`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:23:47,061::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:23:47,062::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`a6a4e0ec-1830-4f39-81c4-c4c30f92274b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:23:47,062::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:23:47,062::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:23:47,062::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`a6a4e0ec-1830-4f39-81c4-c4c30f92274b`::Granted request >Thread-34::DEBUG::2014-07-24 10:23:47,063::task::827::TaskManager.Task::(resourceAcquired) Task=`6fc71cc6-b7dc-4c6c-9dfd-7519f4128278`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:23:47,063::task::990::TaskManager.Task::(_decref) Task=`6fc71cc6-b7dc-4c6c-9dfd-7519f4128278`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:23:47,064::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '38386270208', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:23:47,064::task::1185::TaskManager.Task::(prepare) Task=`6fc71cc6-b7dc-4c6c-9dfd-7519f4128278`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '38386270208', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:23:47,064::task::595::TaskManager.Task::(_updateState) Task=`6fc71cc6-b7dc-4c6c-9dfd-7519f4128278`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:23:47,064::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:23:47,064::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:23:47,065::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:23:47,065::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:23:47,065::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:23:47,065::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:23:47,065::task::990::TaskManager.Task::(_decref) Task=`6fc71cc6-b7dc-4c6c-9dfd-7519f4128278`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:23:48,543::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:23:48,616::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354816 s, 28.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:23:49,120::task::595::TaskManager.Task::(_updateState) Task=`3e6d6460-57cf-4a6e-855a-23507d47610a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:23:49,120::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:23:49,120::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000727001', 'lastCheck': '6.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:23:49,120::task::1185::TaskManager.Task::(prepare) Task=`3e6d6460-57cf-4a6e-855a-23507d47610a`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000727001', 'lastCheck': '6.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:23:49,121::task::595::TaskManager.Task::(_updateState) Task=`3e6d6460-57cf-4a6e-855a-23507d47610a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:23:49,121::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:23:49,121::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:23:49,121::task::990::TaskManager.Task::(_decref) Task=`3e6d6460-57cf-4a6e-855a-23507d47610a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:23:50,628::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:23:50,702::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357445 s, 28.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:23:52,536::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:23:52,544::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000802826 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:23:52,714::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:23:52,789::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364552 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:23:54,801::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:23:54,875::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354984 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:23:56,887::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:23:56,964::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.039744 s, 25.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:23:57,137::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:23:57,137::task::595::TaskManager.Task::(_updateState) Task=`7292c8f9-073b-485c-b158-607215fca02f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:23:57,137::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:23:57,138::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:23:57,138::task::1185::TaskManager.Task::(prepare) Task=`7292c8f9-073b-485c-b158-607215fca02f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:23:57,138::task::595::TaskManager.Task::(_updateState) Task=`7292c8f9-073b-485c-b158-607215fca02f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:23:57,138::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:23:57,138::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:23:57,138::task::990::TaskManager.Task::(_decref) Task=`7292c8f9-073b-485c-b158-607215fca02f`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:23:57,183::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:23:57,183::task::595::TaskManager.Task::(_updateState) Task=`a960763b-762a-44b7-ba7f-b4ce91f7358c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:23:57,183::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:23:57,184::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`9b511131-21ff-4f3e-b984-72966138e399`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:23:57,184::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:23:57,184::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:23:57,184::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`9b511131-21ff-4f3e-b984-72966138e399`::Granted request >Thread-34::DEBUG::2014-07-24 10:23:57,185::task::827::TaskManager.Task::(resourceAcquired) Task=`a960763b-762a-44b7-ba7f-b4ce91f7358c`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:23:57,185::task::990::TaskManager.Task::(_decref) Task=`a960763b-762a-44b7-ba7f-b4ce91f7358c`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:23:57,185::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '38386270208', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:23:57,186::task::1185::TaskManager.Task::(prepare) Task=`a960763b-762a-44b7-ba7f-b4ce91f7358c`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '38386270208', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:23:57,186::task::595::TaskManager.Task::(_updateState) Task=`a960763b-762a-44b7-ba7f-b4ce91f7358c`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:23:57,186::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:23:57,186::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:23:57,186::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:23:57,187::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:23:57,187::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:23:57,187::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:23:57,187::task::990::TaskManager.Task::(_decref) Task=`a960763b-762a-44b7-ba7f-b4ce91f7358c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:23:58,977::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:23:59,048::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337682 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:24:01,060::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:24:01,135::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364565 s, 28.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:24:02,549::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:24:02,557::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000717709 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:24:03,147::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:24:03,221::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034941 s, 29.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:24:04,510::task::595::TaskManager.Task::(_updateState) Task=`1859f816-5e74-491d-8fed-5e72927089cf`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:24:04,510::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:24:04,511::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000717709', 'lastCheck': '1.9', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:24:04,511::task::1185::TaskManager.Task::(prepare) Task=`1859f816-5e74-491d-8fed-5e72927089cf`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000717709', 'lastCheck': '1.9', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:24:04,511::task::595::TaskManager.Task::(_updateState) Task=`1859f816-5e74-491d-8fed-5e72927089cf`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:24:04,511::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:24:04,511::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:24:04,511::task::990::TaskManager.Task::(_decref) Task=`1859f816-5e74-491d-8fed-5e72927089cf`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:24:05,233::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:24:05,306::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352938 s, 29.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:24:07,287::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:24:07,288::task::595::TaskManager.Task::(_updateState) Task=`c04bcba5-3124-4f46-9abf-58ce06fea7f4`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:24:07,288::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:24:07,288::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:24:07,289::task::1185::TaskManager.Task::(prepare) Task=`c04bcba5-3124-4f46-9abf-58ce06fea7f4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:24:07,289::task::595::TaskManager.Task::(_updateState) Task=`c04bcba5-3124-4f46-9abf-58ce06fea7f4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:24:07,289::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:24:07,289::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:24:07,289::task::990::TaskManager.Task::(_decref) Task=`c04bcba5-3124-4f46-9abf-58ce06fea7f4`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:24:07,319::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-34::DEBUG::2014-07-24 10:24:07,347::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:24:07,349::task::595::TaskManager.Task::(_updateState) Task=`38036486-3ee8-45fa-b920-485adc0f7609`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:24:07,350::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:24:07,352::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`04cd5764-89cf-452a-8cbd-d40f1e9e6e27`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:24:07,353::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:24:07,355::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:24:07,356::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`04cd5764-89cf-452a-8cbd-d40f1e9e6e27`::Granted request >Thread-34::DEBUG::2014-07-24 10:24:07,358::task::827::TaskManager.Task::(resourceAcquired) Task=`38036486-3ee8-45fa-b920-485adc0f7609`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:24:07,359::task::990::TaskManager.Task::(_decref) Task=`38036486-3ee8-45fa-b920-485adc0f7609`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:24:07,363::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '38386270208', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:24:07,364::task::1185::TaskManager.Task::(prepare) Task=`38036486-3ee8-45fa-b920-485adc0f7609`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '38386270208', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:24:07,365::task::595::TaskManager.Task::(_updateState) Task=`38036486-3ee8-45fa-b920-485adc0f7609`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:24:07,366::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:24:07,367::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:24:07,368::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:24:07,370::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:24:07,370::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:24:07,371::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:24:07,373::task::990::TaskManager.Task::(_decref) Task=`38036486-3ee8-45fa-b920-485adc0f7609`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:24:07,424::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0625568 s, 16.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:24:09,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:24:09,797::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.321942 s, 3.2 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-24 10:24:11,724::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [142f2ad6] >Thread-34::DEBUG::2014-07-24 10:24:11,724::task::595::TaskManager.Task::(_updateState) Task=`1adadaed-198f-4fbb-86c4-f49772a8116f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:24:11,725::logUtils::44::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', size='10737418240', volFormat=4, preallocate=2, diskType=2, volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', desc='', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000') >Thread-34::DEBUG::2014-07-24 10:24:11,725::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.23aa0606-edc3-4882-a4aa-18aa1983458f`ReqID=`c8049bb4-a40d-46a1-b254-a96adc3bca5c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1464' at 'createVolume' >Thread-34::DEBUG::2014-07-24 10:24:11,725::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:24:11,725::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:24:11,726::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.23aa0606-edc3-4882-a4aa-18aa1983458f`ReqID=`c8049bb4-a40d-46a1-b254-a96adc3bca5c`::Granted request >Thread-34::DEBUG::2014-07-24 10:24:11,726::task::827::TaskManager.Task::(resourceAcquired) Task=`1adadaed-198f-4fbb-86c4-f49772a8116f`::_resourcesAcquired: Storage.23aa0606-edc3-4882-a4aa-18aa1983458f (shared) >Thread-34::DEBUG::2014-07-24 10:24:11,726::task::990::TaskManager.Task::(_decref) Task=`1adadaed-198f-4fbb-86c4-f49772a8116f`::ref 1 aborting False >Dummy-33::DEBUG::2014-07-24 10:24:11,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-34::DEBUG::2014-07-24 10:24:11,858::task::752::TaskManager.Task::(_save) Task=`1adadaed-198f-4fbb-86c4-f49772a8116f`::_save: orig /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/master/tasks/1adadaed-198f-4fbb-86c4-f49772a8116f temp /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/master/tasks/1adadaed-198f-4fbb-86c4-f49772a8116f.temp >Thread-34::DEBUG::2014-07-24 10:24:11,878::taskManager::68::TaskManager::(scheduleJob) scheduled job createVolume for task 1adadaed-198f-4fbb-86c4-f49772a8116f >Thread-34::INFO::2014-07-24 10:24:11,879::logUtils::47::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-34::DEBUG::2014-07-24 10:24:11,880::task::1180::TaskManager.Task::(prepare) Task=`1adadaed-198f-4fbb-86c4-f49772a8116f`::Prepare: 1 jobs exist, move to acquiring >Thread-34::DEBUG::2014-07-24 10:24:11,881::task::595::TaskManager.Task::(_updateState) Task=`1adadaed-198f-4fbb-86c4-f49772a8116f`::moving from state preparing -> state acquiring >Thread-34::DEBUG::2014-07-24 10:24:11,883::task::752::TaskManager.Task::(_save) Task=`1adadaed-198f-4fbb-86c4-f49772a8116f`::_save: orig /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/master/tasks/1adadaed-198f-4fbb-86c4-f49772a8116f temp /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/master/tasks/1adadaed-198f-4fbb-86c4-f49772a8116f.temp >Thread-34::DEBUG::2014-07-24 10:24:11,900::task::595::TaskManager.Task::(_updateState) Task=`1adadaed-198f-4fbb-86c4-f49772a8116f`::moving from state acquiring -> state queued >Thread-34::DEBUG::2014-07-24 10:24:11,902::task::752::TaskManager.Task::(_save) Task=`1adadaed-198f-4fbb-86c4-f49772a8116f`::_save: orig /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/master/tasks/1adadaed-198f-4fbb-86c4-f49772a8116f temp /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/master/tasks/1adadaed-198f-4fbb-86c4-f49772a8116f.temp >Thread-34::DEBUG::2014-07-24 10:24:11,921::taskManager::50::TaskManager::(_queueTask) queuing task: 1adadaed-198f-4fbb-86c4-f49772a8116f >Thread-34::DEBUG::2014-07-24 10:24:11,922::taskManager::56::TaskManager::(_queueTask) task queued: 1adadaed-198f-4fbb-86c4-f49772a8116f >2d699b85-9eca-4445-9348-322fa8c008a7::DEBUG::2014-07-24 10:24:11,922::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-34::DEBUG::2014-07-24 10:24:11,924::task::1182::TaskManager.Task::(prepare) Task=`1adadaed-198f-4fbb-86c4-f49772a8116f`::returning >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:11,926::threadPool::200::Misc.ThreadPool.WorkerThread::(_processNextTask) Task: 1adadaed-198f-4fbb-86c4-f49772a8116f running: <bound method Task.commit of <storage.task.Task instance at 0x7f8b2809cf80>> with: None >Thread-34::DEBUG::2014-07-24 10:24:11,927::task::990::TaskManager.Task::(_decref) Task=`1adadaed-198f-4fbb-86c4-f49772a8116f`::ref 0 aborting False >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:11,929::task::1194::TaskManager.Task::(commit) Task=`1adadaed-198f-4fbb-86c4-f49772a8116f`::committing task: 1adadaed-198f-4fbb-86c4-f49772a8116f >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:11,932::task::595::TaskManager.Task::(_updateState) Task=`1adadaed-198f-4fbb-86c4-f49772a8116f`::moving from state queued -> state running >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:11,937::task::752::TaskManager.Task::(_save) Task=`1adadaed-198f-4fbb-86c4-f49772a8116f`::_save: orig /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/master/tasks/1adadaed-198f-4fbb-86c4-f49772a8116f temp /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/master/tasks/1adadaed-198f-4fbb-86c4-f49772a8116f.temp >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:11,961::task::905::TaskManager.Task::(_runJobs) Task=`1adadaed-198f-4fbb-86c4-f49772a8116f`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7f8b280cc8d0>> (args: ('23aa0606-edc3-4882-a4aa-18aa1983458f', '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 20971520, 4, 2, 2, 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:11,962::task::331::TaskManager.Task::(run) Task=`1adadaed-198f-4fbb-86c4-f49772a8116f`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7f8b280cc8d0>> (args: ('23aa0606-edc3-4882-a4aa-18aa1983458f', '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 20971520, 4, 2, 2, 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) callback None >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:11,965::resourceManager::198::ResourceManager.Request::(__init__) ResName=`23aa0606-edc3-4882-a4aa-18aa1983458f_imageNS.7afbd34c-3fd8-438a-964b-ff0a25fc709c`ReqID=`0fae85c9-c0c3-4bb0-be32-2356432f30dd`::Request was made in '/usr/share/vdsm/storage/sp.py' line '1767' at 'createVolume' >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:11,966::resourceManager::542::ResourceManager::(registerResource) Trying to register resource '23aa0606-edc3-4882-a4aa-18aa1983458f_imageNS.7afbd34c-3fd8-438a-964b-ff0a25fc709c' for lock type 'exclusive' >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:11,970::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:11,976::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:24:11,987::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369521 s, 27.7 MB/s\n'; <rc> = 0 >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:12,165::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:12,169::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:12,170::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:12,170::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image 7afbd34c-3fd8-438a-964b-ff0a25fc709c does not exist in domain 23aa0606-edc3-4882-a4aa-18aa1983458f >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:12,170::resourceManager::601::ResourceManager::(registerResource) Resource '23aa0606-edc3-4882-a4aa-18aa1983458f_imageNS.7afbd34c-3fd8-438a-964b-ff0a25fc709c' is free. Now locking as 'exclusive' (1 active user) >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:12,170::resourceManager::238::ResourceManager.Request::(grant) ResName=`23aa0606-edc3-4882-a4aa-18aa1983458f_imageNS.7afbd34c-3fd8-438a-964b-ff0a25fc709c`ReqID=`0fae85c9-c0c3-4bb0-be32-2356432f30dd`::Granted request >1adadaed-198f-4fbb-86c4-f49772a8116f::INFO::2014-07-24 10:24:12,171::image::123::Storage.Image::(create) Create placeholder /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/23aa0606-edc3-4882-a4aa-18aa1983458f/images/7afbd34c-3fd8-438a-964b-ff0a25fc709c for image's volumes >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:12,172::task::752::TaskManager.Task::(_save) Task=`1adadaed-198f-4fbb-86c4-f49772a8116f`::_save: orig /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/master/tasks/1adadaed-198f-4fbb-86c4-f49772a8116f temp /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/master/tasks/1adadaed-198f-4fbb-86c4-f49772a8116f.temp >1adadaed-198f-4fbb-86c4-f49772a8116f::INFO::2014-07-24 10:24:12,179::volume::443::Storage.Volume::(create) Creating volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:12,180::task::752::TaskManager.Task::(_save) Task=`1adadaed-198f-4fbb-86c4-f49772a8116f`::_save: orig /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/master/tasks/1adadaed-198f-4fbb-86c4-f49772a8116f temp /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/master/tasks/1adadaed-198f-4fbb-86c4-f49772a8116f.temp >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:12,187::task::752::TaskManager.Task::(_save) Task=`1adadaed-198f-4fbb-86c4-f49772a8116f`::_save: orig /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/master/tasks/1adadaed-198f-4fbb-86c4-f49772a8116f temp /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/master/tasks/1adadaed-198f-4fbb-86c4-f49772a8116f.temp >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:12,195::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvcreate --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --contiguous n --size 1024m --addtag OVIRT_VOL_INITIALIZING --name e18ca0ee-e29f-4b85-b352-62c5aeed9be2 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:12,440::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:12,441::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:12,446::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:12,446::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:12,447::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >1adadaed-198f-4fbb-86c4-f49772a8116f::WARNING::2014-07-24 10:24:12,447::utils::129::root::(rmFile) File: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/23aa0606-edc3-4882-a4aa-18aa1983458f/images/7afbd34c-3fd8-438a-964b-ff0a25fc709c/e18ca0ee-e29f-4b85-b352-62c5aeed9be2 already removed >1adadaed-198f-4fbb-86c4-f49772a8116f::INFO::2014-07-24 10:24:12,448::blockVolume::161::Storage.Volume::(_create) Request to create COW volume /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/23aa0606-edc3-4882-a4aa-18aa1983458f/images/7afbd34c-3fd8-438a-964b-ff0a25fc709c/e18ca0ee-e29f-4b85-b352-62c5aeed9be2 with size = 20971520 sectors >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:12,448::volume::1042::Storage.Misc.excCmd::(createVolume) '/usr/bin/qemu-img create -f qcow2 /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/23aa0606-edc3-4882-a4aa-18aa1983458f/images/7afbd34c-3fd8-438a-964b-ff0a25fc709c/e18ca0ee-e29f-4b85-b352-62c5aeed9be2 10485760K' (cwd None) >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:12,466::volume::1042::Storage.Misc.excCmd::(createVolume) SUCCESS: <err> = ''; <rc> = 0 >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:12,467::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:12,468::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-18::DEBUG::2014-07-24 10:24:12,562::lvm::373::OperationMutex::(_reloadvgs) Got the operational mutex >Thread-18::DEBUG::2014-07-24 10:24:12,564::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:12,640::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:12,645::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >1adadaed-198f-4fbb-86c4-f49772a8116f::WARNING::2014-07-24 10:24:12,645::blockSD::761::Storage.StorageDomain::(_getOccupiedMetadataSlots) Could not find mapping for lv 23aa0606-edc3-4882-a4aa-18aa1983458f/e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:12,645::blockSD::784::Storage.StorageDomain::(getFreeMetadataSlot) Found freeSlot 4 in VG 23aa0606-edc3-4882-a4aa-18aa1983458f >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:12,646::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --deltag OVIRT_VOL_INITIALIZING --addtag MD_4 --addtag PU_00000000-0000-0000-0000-000000000000 --addtag IU_7afbd34c-3fd8-438a-964b-ff0a25fc709c 23aa0606-edc3-4882-a4aa-18aa1983458f/e18ca0ee-e29f-4b85-b352-62c5aeed9be2' (cwd None) >Thread-18::DEBUG::2014-07-24 10:24:12,774::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:24:12,775::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 10:24:12,776::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:24:12,784::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000564168 s, 7.3 MB/s\n'; <rc> = 0 >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:12,840::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:12,840::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:12,841::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:12,841::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available n 23aa0606-edc3-4882-a4aa-18aa1983458f/e18ca0ee-e29f-4b85-b352-62c5aeed9be2' (cwd None) >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:13,009::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:13,009::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:13,010::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:13,010::task::752::TaskManager.Task::(_save) Task=`1adadaed-198f-4fbb-86c4-f49772a8116f`::_save: orig /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/master/tasks/1adadaed-198f-4fbb-86c4-f49772a8116f temp /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/master/tasks/1adadaed-198f-4fbb-86c4-f49772a8116f.temp >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:13,021::blockVolume::604::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=e18ca0ee-e29f-4b85-b352-62c5aeed9be2 sdUUID=23aa0606-edc3-4882-a4aa-18aa1983458f, metaId=('23aa0606-edc3-4882-a4aa-18aa1983458f', 4) >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:13,032::task::752::TaskManager.Task::(_save) Task=`1adadaed-198f-4fbb-86c4-f49772a8116f`::_save: orig /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/master/tasks/1adadaed-198f-4fbb-86c4-f49772a8116f temp /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/master/tasks/1adadaed-198f-4fbb-86c4-f49772a8116f.temp >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:13,039::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource '23aa0606-edc3-4882-a4aa-18aa1983458f_imageNS.7afbd34c-3fd8-438a-964b-ff0a25fc709c' >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:13,039::resourceManager::635::ResourceManager::(releaseResource) Released resource '23aa0606-edc3-4882-a4aa-18aa1983458f_imageNS.7afbd34c-3fd8-438a-964b-ff0a25fc709c' (0 active users) >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:13,040::resourceManager::641::ResourceManager::(releaseResource) Resource '23aa0606-edc3-4882-a4aa-18aa1983458f_imageNS.7afbd34c-3fd8-438a-964b-ff0a25fc709c' is free, finding out if anyone is waiting for it. >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:13,040::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource '23aa0606-edc3-4882-a4aa-18aa1983458f_imageNS.7afbd34c-3fd8-438a-964b-ff0a25fc709c', Clearing records. >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:13,040::task::595::TaskManager.Task::(_updateState) Task=`1adadaed-198f-4fbb-86c4-f49772a8116f`::moving from state running -> state finished >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:13,040::task::752::TaskManager.Task::(_save) Task=`1adadaed-198f-4fbb-86c4-f49772a8116f`::_save: orig /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/master/tasks/1adadaed-198f-4fbb-86c4-f49772a8116f temp /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/master/tasks/1adadaed-198f-4fbb-86c4-f49772a8116f.temp >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:13,048::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f': < ResourceRef 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f', isValid: 'True' obj: 'None'>} >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:13,048::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:13,048::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f' >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:13,048::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f' (0 active users) >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:13,049::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f' is free, finding out if anyone is waiting for it. >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:13,049::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f', Clearing records. >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:13,049::task::913::TaskManager.Task::(_runJobs) Task=`1adadaed-198f-4fbb-86c4-f49772a8116f`::Task.run: exit - success: result {'uuid': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2'} >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:13,049::task::990::TaskManager.Task::(_decref) Task=`1adadaed-198f-4fbb-86c4-f49772a8116f`::ref 0 aborting False >1adadaed-198f-4fbb-86c4-f49772a8116f::DEBUG::2014-07-24 10:24:13,049::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-33::DEBUG::2014-07-24 10:24:14,001::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:24:14,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353576 s, 29.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:24:15,898::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:24:15,898::task::595::TaskManager.Task::(_updateState) Task=`41c10694-64c9-4aa9-85a6-bb7d2246081b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:24:15,899::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-14::DEBUG::2014-07-24 10:24:15,899::taskManager::102::TaskManager::(getAllTasksStatuses) Entry. >Thread-14::DEBUG::2014-07-24 10:24:15,899::taskManager::93::TaskManager::(getTaskStatus) Entry. taskID: 1adadaed-198f-4fbb-86c4-f49772a8116f >Thread-14::DEBUG::2014-07-24 10:24:15,899::taskManager::96::TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '1adadaed-198f-4fbb-86c4-f49772a8116f'} >Thread-14::DEBUG::2014-07-24 10:24:15,899::taskManager::113::TaskManager::(getAllTasksStatuses) Return: {'1adadaed-198f-4fbb-86c4-f49772a8116f': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '1adadaed-198f-4fbb-86c4-f49772a8116f'}} >Thread-14::INFO::2014-07-24 10:24:15,899::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'1adadaed-198f-4fbb-86c4-f49772a8116f': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '1adadaed-198f-4fbb-86c4-f49772a8116f'}}} >Thread-14::DEBUG::2014-07-24 10:24:15,900::task::1185::TaskManager.Task::(prepare) Task=`41c10694-64c9-4aa9-85a6-bb7d2246081b`::finished: {'allTasksStatus': {'1adadaed-198f-4fbb-86c4-f49772a8116f': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '1adadaed-198f-4fbb-86c4-f49772a8116f'}}} >Thread-14::DEBUG::2014-07-24 10:24:15,900::task::595::TaskManager.Task::(_updateState) Task=`41c10694-64c9-4aa9-85a6-bb7d2246081b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:24:15,900::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:24:15,900::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:24:15,900::task::990::TaskManager.Task::(_decref) Task=`41c10694-64c9-4aa9-85a6-bb7d2246081b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:24:16,089::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [142f2ad6] >Thread-34::DEBUG::2014-07-24 10:24:16,089::task::595::TaskManager.Task::(_updateState) Task=`437565c1-d6a0-4afe-9cc3-38f39546237e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:24:16,090::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeInfo(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-34::DEBUG::2014-07-24 10:24:16,090::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.23aa0606-edc3-4882-a4aa-18aa1983458f`ReqID=`caf495ef-85ff-4538-8298-ec6c9487b6ee`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3089' at 'getVolumeInfo' >Thread-34::DEBUG::2014-07-24 10:24:16,090::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:24:16,090::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:24:16,091::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.23aa0606-edc3-4882-a4aa-18aa1983458f`ReqID=`caf495ef-85ff-4538-8298-ec6c9487b6ee`::Granted request >Thread-34::DEBUG::2014-07-24 10:24:16,091::task::827::TaskManager.Task::(resourceAcquired) Task=`437565c1-d6a0-4afe-9cc3-38f39546237e`::_resourcesAcquired: Storage.23aa0606-edc3-4882-a4aa-18aa1983458f (shared) >Thread-34::DEBUG::2014-07-24 10:24:16,091::task::990::TaskManager.Task::(_decref) Task=`437565c1-d6a0-4afe-9cc3-38f39546237e`::ref 1 aborting False >Thread-34::DEBUG::2014-07-24 10:24:16,091::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-34::DEBUG::2014-07-24 10:24:16,092::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:24:16,105::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:24:16,179::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346449 s, 29.6 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-24 10:24:16,249::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-34::DEBUG::2014-07-24 10:24:16,254::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-34::DEBUG::2014-07-24 10:24:16,255::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-34::INFO::2014-07-24 10:24:16,255::volume::879::Storage.Volume::(getInfo) Info request: sdUUID=23aa0606-edc3-4882-a4aa-18aa1983458f imgUUID=7afbd34c-3fd8-438a-964b-ff0a25fc709c volUUID = e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-34::DEBUG::2014-07-24 10:24:16,255::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata count=1' (cwd None) >Thread-34::DEBUG::2014-07-24 10:24:16,263::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.000431646 s, 1.2 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-24 10:24:16,264::misc::264::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.000431646 s, 1.2 MB/s'], size: 512 >Thread-34::DEBUG::2014-07-24 10:24:16,264::blockVolume::572::Storage.Misc.excCmd::(getMetadata) '/bin/dd iflag=direct skip=4 bs=512 if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata count=1' (cwd None) >Thread-34::DEBUG::2014-07-24 10:24:16,305::blockVolume::572::Storage.Misc.excCmd::(getMetadata) SUCCESS: <err> = '1+0 records in\n1+0 records out\n512 bytes (512 B) copied, 0.0343983 s, 14.9 kB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-24 10:24:16,306::misc::264::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '512 bytes (512 B) copied, 0.0343983 s, 14.9 kB/s'], size: 512 >Thread-34::INFO::2014-07-24 10:24:16,306::volume::909::Storage.Volume::(getInfo) 23aa0606-edc3-4882-a4aa-18aa1983458f/7afbd34c-3fd8-438a-964b-ff0a25fc709c/e18ca0ee-e29f-4b85-b352-62c5aeed9be2 info is {'status': 'OK', 'domain': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'ctime': '1406186653', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1406186653', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'truesize': '1073741824', 'type': 'SPARSE'} >Thread-34::INFO::2014-07-24 10:24:16,306::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeInfo, Return response: {'info': {'status': 'OK', 'domain': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'ctime': '1406186653', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1406186653', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-34::DEBUG::2014-07-24 10:24:16,306::task::1185::TaskManager.Task::(prepare) Task=`437565c1-d6a0-4afe-9cc3-38f39546237e`::finished: {'info': {'status': 'OK', 'domain': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'voltype': 'LEAF', 'description': '', 'parent': '00000000-0000-0000-0000-000000000000', 'format': 'COW', 'image': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'ctime': '1406186653', 'disktype': '2', 'legality': 'LEGAL', 'mtime': '1406186653', 'apparentsize': '1073741824', 'children': [], 'pool': '', 'capacity': '10737418240', 'uuid': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'truesize': '1073741824', 'type': 'SPARSE'}} >Thread-34::DEBUG::2014-07-24 10:24:16,306::task::595::TaskManager.Task::(_updateState) Task=`437565c1-d6a0-4afe-9cc3-38f39546237e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:24:16,307::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f': < ResourceRef 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:24:16,307::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:24:16,307::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f' >Thread-34::DEBUG::2014-07-24 10:24:16,307::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f' (0 active users) >Thread-34::DEBUG::2014-07-24 10:24:16,307::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:24:16,308::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f', Clearing records. >Thread-34::DEBUG::2014-07-24 10:24:16,308::task::990::TaskManager.Task::(_decref) Task=`437565c1-d6a0-4afe-9cc3-38f39546237e`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:24:16,478::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:24:16,479::task::595::TaskManager.Task::(_updateState) Task=`e2c2e80b-2e88-40b4-a2d4-19a2db170f51`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:24:16,479::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='1adadaed-198f-4fbb-86c4-f49772a8116f', spUUID=None, options=None) >Thread-14::DEBUG::2014-07-24 10:24:16,479::taskManager::161::TaskManager::(clearTask) Entry. taskID: 1adadaed-198f-4fbb-86c4-f49772a8116f >Thread-14::DEBUG::2014-07-24 10:24:16,480::taskManager::166::TaskManager::(clearTask) Return. >Thread-14::INFO::2014-07-24 10:24:16,480::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-14::DEBUG::2014-07-24 10:24:16,480::task::1185::TaskManager.Task::(prepare) Task=`e2c2e80b-2e88-40b4-a2d4-19a2db170f51`::finished: None >Thread-14::DEBUG::2014-07-24 10:24:16,481::task::595::TaskManager.Task::(_updateState) Task=`e2c2e80b-2e88-40b4-a2d4-19a2db170f51`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:24:16,481::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:24:16,481::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:24:16,481::task::990::TaskManager.Task::(_decref) Task=`e2c2e80b-2e88-40b4-a2d4-19a2db170f51`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:24:17,461::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:24:17,461::task::595::TaskManager.Task::(_updateState) Task=`bdf349ec-2012-49da-9a96-7a99569bbc5c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:24:17,461::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:24:17,461::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:24:17,462::task::1185::TaskManager.Task::(prepare) Task=`bdf349ec-2012-49da-9a96-7a99569bbc5c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:24:17,462::task::595::TaskManager.Task::(_updateState) Task=`bdf349ec-2012-49da-9a96-7a99569bbc5c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:24:17,462::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:24:17,462::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:24:17,462::task::990::TaskManager.Task::(_decref) Task=`bdf349ec-2012-49da-9a96-7a99569bbc5c`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:24:17,507::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:24:17,507::task::595::TaskManager.Task::(_updateState) Task=`b1352944-cbcd-45a6-a73c-020af6eee302`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:24:17,507::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:24:17,508::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`cae5609b-5cfc-41e8-bcfc-4f0329422fbd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:24:17,508::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:24:17,508::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:24:17,508::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`cae5609b-5cfc-41e8-bcfc-4f0329422fbd`::Granted request >Thread-34::DEBUG::2014-07-24 10:24:17,509::task::827::TaskManager.Task::(resourceAcquired) Task=`b1352944-cbcd-45a6-a73c-020af6eee302`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:24:17,509::task::990::TaskManager.Task::(_decref) Task=`b1352944-cbcd-45a6-a73c-020af6eee302`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:24:17,509::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:24:17,510::task::1185::TaskManager.Task::(prepare) Task=`b1352944-cbcd-45a6-a73c-020af6eee302`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:24:17,510::task::595::TaskManager.Task::(_updateState) Task=`b1352944-cbcd-45a6-a73c-020af6eee302`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:24:17,510::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:24:17,510::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:24:17,510::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:24:17,510::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:24:17,511::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:24:17,511::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:24:17,511::task::990::TaskManager.Task::(_decref) Task=`b1352944-cbcd-45a6-a73c-020af6eee302`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:24:18,191::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:24:18,264::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361209 s, 28.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:24:20,042::task::595::TaskManager.Task::(_updateState) Task=`ab020dd6-2cff-4050-bd5f-1f5166d9d696`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:24:20,043::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:24:20,043::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000564168', 'lastCheck': '7.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:24:20,043::task::1185::TaskManager.Task::(prepare) Task=`ab020dd6-2cff-4050-bd5f-1f5166d9d696`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000564168', 'lastCheck': '7.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:24:20,043::task::595::TaskManager.Task::(_updateState) Task=`ab020dd6-2cff-4050-bd5f-1f5166d9d696`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:24:20,044::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:24:20,044::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:24:20,044::task::990::TaskManager.Task::(_decref) Task=`ab020dd6-2cff-4050-bd5f-1f5166d9d696`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:24:20,276::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:24:20,350::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348679 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:24:22,362::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:24:22,439::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354398 s, 28.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:24:22,791::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:24:22,807::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00076744 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:24:24,452::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:24:24,525::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033699 s, 30.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:24:26,537::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:24:26,610::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350688 s, 29.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:24:27,597::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:24:27,598::task::595::TaskManager.Task::(_updateState) Task=`fb9f7871-7582-41d5-8c24-a4798c97b069`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:24:27,598::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:24:27,598::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:24:27,598::task::1185::TaskManager.Task::(prepare) Task=`fb9f7871-7582-41d5-8c24-a4798c97b069`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:24:27,599::task::595::TaskManager.Task::(_updateState) Task=`fb9f7871-7582-41d5-8c24-a4798c97b069`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:24:27,599::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:24:27,599::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:24:27,599::task::990::TaskManager.Task::(_decref) Task=`fb9f7871-7582-41d5-8c24-a4798c97b069`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:24:27,655::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:24:27,656::task::595::TaskManager.Task::(_updateState) Task=`c95cfa1a-b59b-4d55-96d3-99d3127f9f9d`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:24:27,656::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:24:27,656::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1624f2be-edd4-4153-8cea-add3f50e032f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:24:27,656::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:24:27,657::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:24:27,657::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1624f2be-edd4-4153-8cea-add3f50e032f`::Granted request >Thread-34::DEBUG::2014-07-24 10:24:27,657::task::827::TaskManager.Task::(resourceAcquired) Task=`c95cfa1a-b59b-4d55-96d3-99d3127f9f9d`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:24:27,657::task::990::TaskManager.Task::(_decref) Task=`c95cfa1a-b59b-4d55-96d3-99d3127f9f9d`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:24:27,658::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:24:27,658::task::1185::TaskManager.Task::(prepare) Task=`c95cfa1a-b59b-4d55-96d3-99d3127f9f9d`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:24:27,659::task::595::TaskManager.Task::(_updateState) Task=`c95cfa1a-b59b-4d55-96d3-99d3127f9f9d`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:24:27,659::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:24:27,659::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:24:27,659::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:24:27,659::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:24:27,659::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:24:27,660::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:24:27,660::task::990::TaskManager.Task::(_decref) Task=`c95cfa1a-b59b-4d55-96d3-99d3127f9f9d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:24:28,622::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:24:28,696::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357987 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:24:30,709::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:24:30,780::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335421 s, 30.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:24:32,792::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-24 10:24:32,825::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:24:32,841::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000623863 s, 6.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:24:32,914::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0840652 s, 12.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:24:34,927::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:24:35,001::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364468 s, 28.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:24:35,567::task::595::TaskManager.Task::(_updateState) Task=`dca31d8a-5557-4dbf-b86d-9e75689211b6`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:24:35,567::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:24:35,567::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000623863', 'lastCheck': '2.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:24:35,568::task::1185::TaskManager.Task::(prepare) Task=`dca31d8a-5557-4dbf-b86d-9e75689211b6`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000623863', 'lastCheck': '2.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:24:35,568::task::595::TaskManager.Task::(_updateState) Task=`dca31d8a-5557-4dbf-b86d-9e75689211b6`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:24:35,568::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:24:35,568::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:24:35,568::task::990::TaskManager.Task::(_decref) Task=`dca31d8a-5557-4dbf-b86d-9e75689211b6`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:24:37,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:24:37,088::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364536 s, 28.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:24:37,744::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:24:37,745::task::595::TaskManager.Task::(_updateState) Task=`99fc51b8-9596-4940-922e-717d7f91441e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:24:37,745::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:24:37,745::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:24:37,746::task::1185::TaskManager.Task::(prepare) Task=`99fc51b8-9596-4940-922e-717d7f91441e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:24:37,746::task::595::TaskManager.Task::(_updateState) Task=`99fc51b8-9596-4940-922e-717d7f91441e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:24:37,746::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:24:37,746::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:24:37,746::task::990::TaskManager.Task::(_decref) Task=`99fc51b8-9596-4940-922e-717d7f91441e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:24:37,784::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:24:37,784::task::595::TaskManager.Task::(_updateState) Task=`99d58a8b-7433-411d-b03d-299be34aae44`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:24:37,784::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:24:37,784::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`fd3cf635-7d13-49c1-8957-b277be10e6da`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:24:37,785::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:24:37,785::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:24:37,785::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`fd3cf635-7d13-49c1-8957-b277be10e6da`::Granted request >Thread-34::DEBUG::2014-07-24 10:24:37,786::task::827::TaskManager.Task::(resourceAcquired) Task=`99d58a8b-7433-411d-b03d-299be34aae44`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:24:37,787::task::990::TaskManager.Task::(_decref) Task=`99d58a8b-7433-411d-b03d-299be34aae44`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:24:37,787::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:24:37,788::task::1185::TaskManager.Task::(prepare) Task=`99d58a8b-7433-411d-b03d-299be34aae44`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:24:37,788::task::595::TaskManager.Task::(_updateState) Task=`99d58a8b-7433-411d-b03d-299be34aae44`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:24:37,788::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:24:37,788::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:24:37,788::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:24:37,789::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:24:37,789::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:24:37,789::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:24:37,789::task::990::TaskManager.Task::(_decref) Task=`99d58a8b-7433-411d-b03d-299be34aae44`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:24:39,101::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:24:39,174::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362406 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:24:41,187::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:24:41,262::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368651 s, 27.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:24:42,876::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:24:42,884::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000777496 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:24:43,274::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:24:43,348::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359772 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:24:45,360::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:24:45,434::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035521 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:24:47,446::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:24:47,520::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364542 s, 28.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:24:47,859::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [4376fa5] >Thread-14::DEBUG::2014-07-24 10:24:47,859::task::595::TaskManager.Task::(_updateState) Task=`7e68c201-1713-4537-a0f2-df9798d46968`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:24:47,860::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:24:47,860::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:24:47,860::task::1185::TaskManager.Task::(prepare) Task=`7e68c201-1713-4537-a0f2-df9798d46968`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:24:47,860::task::595::TaskManager.Task::(_updateState) Task=`7e68c201-1713-4537-a0f2-df9798d46968`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:24:47,860::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:24:47,861::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:24:47,861::task::990::TaskManager.Task::(_decref) Task=`7e68c201-1713-4537-a0f2-df9798d46968`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:24:47,892::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [4376fa5] >Thread-34::DEBUG::2014-07-24 10:24:47,893::task::595::TaskManager.Task::(_updateState) Task=`c4942007-634b-4d5b-920c-ca5d349d49bb`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:24:47,893::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:24:47,893::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e21ddd2e-5986-40ed-ba21-798844ec13b7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:24:47,893::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:24:47,894::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:24:47,894::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e21ddd2e-5986-40ed-ba21-798844ec13b7`::Granted request >Thread-34::DEBUG::2014-07-24 10:24:47,894::task::827::TaskManager.Task::(resourceAcquired) Task=`c4942007-634b-4d5b-920c-ca5d349d49bb`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:24:47,894::task::990::TaskManager.Task::(_decref) Task=`c4942007-634b-4d5b-920c-ca5d349d49bb`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:24:47,895::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:24:47,895::task::1185::TaskManager.Task::(prepare) Task=`c4942007-634b-4d5b-920c-ca5d349d49bb`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:24:47,896::task::595::TaskManager.Task::(_updateState) Task=`c4942007-634b-4d5b-920c-ca5d349d49bb`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:24:47,896::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:24:47,896::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:24:47,896::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:24:47,896::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:24:47,897::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:24:47,897::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:24:47,897::task::990::TaskManager.Task::(_decref) Task=`c4942007-634b-4d5b-920c-ca5d349d49bb`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:24:49,533::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:24:49,604::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340215 s, 30.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:24:51,276::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call vmCreate with ({'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': '6fca7e11-8f3f-4784-bdab-7e7f9503cd5b', 'memGuaranteedSize': 1024, 'spiceSslCipherSuite': 'DEFAULT', 'timeOffset': '0', 'cpuType': 'Westmere', 'smp': '1', 'custom': {}, 'vmType': 'kvm', 'memSize': 1024, 'smpCoresPerSocket': '1', 'vmName': 'VM1', 'nice': '0', 'smartcardEnable': 'false', 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'transparentHugePages': 'true', 'devices': [{'device': 'qxl', 'specParams': {'vram': '32768', 'heads': '1'}, 'type': 'video', 'deviceId': '560654a4-ed36-4f17-b5d4-2af4658881cb'}, {'index': '2', 'iface': 'ide', 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': '71b6af57-e549-4959-b78d-83ccf5957ae9', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'scsi', 'format': 'cow', 'optional': 'false', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'specParams': {}, 'readonly': 'false', 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'deviceId': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'address': {'bus': '0', 'controller': '0', 'type': 'drive', 'target': '0', 'unit': '0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:58:22:89', 'linkActive': 'true', 'network': 'rhevm', 'bootOrder': '1', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '1ed866ec-23e4-4ccd-9379-f34f4e553dae', 'device': 'bridge', 'type': 'interface'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': 'c56b1a42-4d1b-4596-bb85-0fce6f3b63f3'}, {'index': '0', 'specParams': {}, 'deviceId': '294d9ebd-277e-4f9c-b53f-3f312bbf43c7', 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'maxVCpus': '160', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'display': 'qxl'},) {} flowID [733e3e5d] >Thread-14::INFO::2014-07-24 10:24:51,288::API::667::vds::(_getNetworkIp) network None: using 0 >Thread-14::INFO::2014-07-24 10:24:51,288::clientIF::364::vds::(createVm) vmContainerLock acquired by vm 6fca7e11-8f3f-4784-bdab-7e7f9503cd5b >Thread-14::DEBUG::2014-07-24 10:24:51,289::libvirtconnection::145::root::(get) trying to connect libvirt >Thread-14::DEBUG::2014-07-24 10:24:51,325::clientIF::377::vds::(createVm) Total desktops after creation of 6fca7e11-8f3f-4784-bdab-7e7f9503cd5b is 1 >Thread-35::DEBUG::2014-07-24 10:24:51,325::vm::2270::vm.Vm::(_startUnderlyingVm) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Start >Thread-14::DEBUG::2014-07-24 10:24:51,326::BindingXMLRPC::1074::vds::(wrapper) return vmCreate with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0', 'vmId': '6fca7e11-8f3f-4784-bdab-7e7f9503cd5b', 'pid': '0', 'memGuaranteedSize': 1024, 'timeOffset': '0', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'Westmere', 'custom': {}, 'clientIp': '', 'nicModel': 'rtl8139,pv', 'smartcardEnable': 'false', 'kvmEnable': 'true', 'transparentHugePages': 'true', 'devices': [{'device': 'qxl', 'specParams': {'vram': '32768', 'heads': '1'}, 'type': 'video', 'deviceId': '560654a4-ed36-4f17-b5d4-2af4658881cb'}, {'index': '2', 'iface': 'ide', 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': '71b6af57-e549-4959-b78d-83ccf5957ae9', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'scsi', 'format': 'cow', 'optional': 'false', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'specParams': {}, 'readonly': 'false', 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'deviceId': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'address': {'bus': '0', 'controller': '0', 'type': 'drive', 'target': '0', 'unit': '0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:58:22:89', 'linkActive': 'true', 'network': 'rhevm', 'bootOrder': '1', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '1ed866ec-23e4-4ccd-9379-f34f4e553dae', 'device': 'bridge', 'type': 'interface'}, {'device': 'memballoon', 'specParams': {'model': 'virtio'}, 'type': 'balloon', 'deviceId': 'c56b1a42-4d1b-4596-bb85-0fce6f3b63f3'}, {'index': '0', 'specParams': {}, 'deviceId': '294d9ebd-277e-4f9c-b53f-3f312bbf43c7', 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'smp': '1', 'vmType': 'kvm', 'memSize': 1024, 'displayIp': '0', 'maxVCpus': '160', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'smpCoresPerSocket': '1', 'vmName': 'VM1', 'display': 'qxl', 'nice': '0'}} >Thread-35::DEBUG::2014-07-24 10:24:51,328::vm::2274::vm.Vm::(_startUnderlyingVm) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::_ongoingCreations acquired >Thread-35::INFO::2014-07-24 10:24:51,330::vm::3151::vm.Vm::(_run) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::VM wrapper has started >Thread-35::DEBUG::2014-07-24 10:24:51,332::task::595::TaskManager.Task::(_updateState) Task=`82756631-5039-4d93-a14c-07aa8ac3bc51`::moving from state init -> state preparing >Thread-35::INFO::2014-07-24 10:24:51,334::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-35::INFO::2014-07-24 10:24:51,336::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-35::DEBUG::2014-07-24 10:24:51,338::task::1185::TaskManager.Task::(prepare) Task=`82756631-5039-4d93-a14c-07aa8ac3bc51`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-35::DEBUG::2014-07-24 10:24:51,339::task::595::TaskManager.Task::(_updateState) Task=`82756631-5039-4d93-a14c-07aa8ac3bc51`::moving from state preparing -> state finished >Thread-35::DEBUG::2014-07-24 10:24:51,340::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-35::DEBUG::2014-07-24 10:24:51,340::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-35::DEBUG::2014-07-24 10:24:51,342::task::990::TaskManager.Task::(_decref) Task=`82756631-5039-4d93-a14c-07aa8ac3bc51`::ref 0 aborting False >Thread-35::INFO::2014-07-24 10:24:51,343::clientIF::322::vds::(prepareVolumePath) prepared volume path: >Thread-35::DEBUG::2014-07-24 10:24:51,343::task::595::TaskManager.Task::(_updateState) Task=`a7a48d43-5bfc-4491-8f76-ef01fff22783`::moving from state init -> state preparing >Thread-35::INFO::2014-07-24 10:24:51,343::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', leafUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2') >Thread-35::DEBUG::2014-07-24 10:24:51,344::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.23aa0606-edc3-4882-a4aa-18aa1983458f`ReqID=`d6de9bc6-c0aa-4061-b1df-bf926c8c4400`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3248' at 'prepareImage' >Thread-35::DEBUG::2014-07-24 10:24:51,344::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f' for lock type 'shared' >Thread-35::DEBUG::2014-07-24 10:24:51,344::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f' is free. Now locking as 'shared' (1 active user) >Thread-35::DEBUG::2014-07-24 10:24:51,344::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.23aa0606-edc3-4882-a4aa-18aa1983458f`ReqID=`d6de9bc6-c0aa-4061-b1df-bf926c8c4400`::Granted request >Thread-35::DEBUG::2014-07-24 10:24:51,345::task::827::TaskManager.Task::(resourceAcquired) Task=`a7a48d43-5bfc-4491-8f76-ef01fff22783`::_resourcesAcquired: Storage.23aa0606-edc3-4882-a4aa-18aa1983458f (shared) >Thread-35::DEBUG::2014-07-24 10:24:51,345::task::990::TaskManager.Task::(_decref) Task=`a7a48d43-5bfc-4491-8f76-ef01fff22783`::ref 1 aborting False >Thread-35::DEBUG::2014-07-24 10:24:51,345::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-35::DEBUG::2014-07-24 10:24:51,346::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-14::DEBUG::2014-07-24 10:24:51,498::task::595::TaskManager.Task::(_updateState) Task=`a19faf77-5865-4d62-8df5-bda70632e1d7`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:24:51,498::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:24:51,499::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000777496', 'lastCheck': '8.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:24:51,499::task::1185::TaskManager.Task::(prepare) Task=`a19faf77-5865-4d62-8df5-bda70632e1d7`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000777496', 'lastCheck': '8.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:24:51,499::task::595::TaskManager.Task::(_updateState) Task=`a19faf77-5865-4d62-8df5-bda70632e1d7`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:24:51,499::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:24:51,499::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:24:51,499::task::990::TaskManager.Task::(_decref) Task=`a19faf77-5865-4d62-8df5-bda70632e1d7`::ref 0 aborting False >Thread-35::DEBUG::2014-07-24 10:24:51,527::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-35::DEBUG::2014-07-24 10:24:51,532::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-35::DEBUG::2014-07-24 10:24:51,533::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-35::DEBUG::2014-07-24 10:24:51,534::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --available y 23aa0606-edc3-4882-a4aa-18aa1983458f/e18ca0ee-e29f-4b85-b352-62c5aeed9be2' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:24:51,616::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:24:51,709::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342673 s, 29.9 MB/s\n'; <rc> = 0 >Thread-35::DEBUG::2014-07-24 10:24:51,880::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-35::DEBUG::2014-07-24 10:24:51,881::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-35::DEBUG::2014-07-24 10:24:51,881::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-35::DEBUG::2014-07-24 10:24:51,882::blockSD::1057::Storage.StorageDomain::(linkBCImage) path to image directory already exists: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/23aa0606-edc3-4882-a4aa-18aa1983458f/images/7afbd34c-3fd8-438a-964b-ff0a25fc709c >Thread-35::DEBUG::2014-07-24 10:24:51,883::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >Thread-35::DEBUG::2014-07-24 10:24:51,883::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-35::DEBUG::2014-07-24 10:24:52,042::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-35::DEBUG::2014-07-24 10:24:52,048::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >Thread-35::DEBUG::2014-07-24 10:24:52,048::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Thread-35::INFO::2014-07-24 10:24:52,055::logUtils::47::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'info': {'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'volType': 'path', 'leaseOffset': 109051904, 'path': '/rhev/data-center/mnt/blockSD/23aa0606-edc3-4882-a4aa-18aa1983458f/images/7afbd34c-3fd8-438a-964b-ff0a25fc709c/e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'leasePath': '/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/leases', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c'}, 'path': '/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/23aa0606-edc3-4882-a4aa-18aa1983458f/images/7afbd34c-3fd8-438a-964b-ff0a25fc709c/e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imgVolumesInfo': [{'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'volType': 'path', 'leaseOffset': 109051904, 'path': '/rhev/data-center/mnt/blockSD/23aa0606-edc3-4882-a4aa-18aa1983458f/images/7afbd34c-3fd8-438a-964b-ff0a25fc709c/e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'leasePath': '/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/leases', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c'}]} >Thread-35::DEBUG::2014-07-24 10:24:52,056::task::1185::TaskManager.Task::(prepare) Task=`a7a48d43-5bfc-4491-8f76-ef01fff22783`::finished: {'info': {'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'volType': 'path', 'leaseOffset': 109051904, 'path': '/rhev/data-center/mnt/blockSD/23aa0606-edc3-4882-a4aa-18aa1983458f/images/7afbd34c-3fd8-438a-964b-ff0a25fc709c/e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'leasePath': '/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/leases', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c'}, 'path': '/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/23aa0606-edc3-4882-a4aa-18aa1983458f/images/7afbd34c-3fd8-438a-964b-ff0a25fc709c/e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imgVolumesInfo': [{'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'volType': 'path', 'leaseOffset': 109051904, 'path': '/rhev/data-center/mnt/blockSD/23aa0606-edc3-4882-a4aa-18aa1983458f/images/7afbd34c-3fd8-438a-964b-ff0a25fc709c/e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'leasePath': '/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/leases', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c'}]} >Thread-35::DEBUG::2014-07-24 10:24:52,056::task::595::TaskManager.Task::(_updateState) Task=`a7a48d43-5bfc-4491-8f76-ef01fff22783`::moving from state preparing -> state finished >Thread-35::DEBUG::2014-07-24 10:24:52,056::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f': < ResourceRef 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f', isValid: 'True' obj: 'None'>} >Thread-35::DEBUG::2014-07-24 10:24:52,056::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-35::DEBUG::2014-07-24 10:24:52,056::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f' >Thread-35::DEBUG::2014-07-24 10:24:52,057::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f' (0 active users) >Thread-35::DEBUG::2014-07-24 10:24:52,057::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f' is free, finding out if anyone is waiting for it. >Thread-35::DEBUG::2014-07-24 10:24:52,057::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.23aa0606-edc3-4882-a4aa-18aa1983458f', Clearing records. >Thread-35::DEBUG::2014-07-24 10:24:52,057::task::990::TaskManager.Task::(_decref) Task=`a7a48d43-5bfc-4491-8f76-ef01fff22783`::ref 0 aborting False >Thread-35::INFO::2014-07-24 10:24:52,057::clientIF::322::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/23aa0606-edc3-4882-a4aa-18aa1983458f/images/7afbd34c-3fd8-438a-964b-ff0a25fc709c/e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-35::DEBUG::2014-07-24 10:24:52,071::vm::3190::vm.Vm::(_run) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::<?xml version="1.0" encoding="utf-8"?> ><domain type="kvm"> > <name>VM1</name> > <uuid>6fca7e11-8f3f-4784-bdab-7e7f9503cd5b</uuid> > <memory>1048576</memory> > <currentMemory>1048576</currentMemory> > <vcpu current="1">160</vcpu> > <memtune> > <min_guarantee>1048576</min_guarantee> > </memtune> > <devices> > <channel type="unix"> > <target name="com.redhat.rhevm.vdsm" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/6fca7e11-8f3f-4784-bdab-7e7f9503cd5b.com.redhat.rhevm.vdsm"/> > </channel> > <channel type="unix"> > <target name="org.qemu.guest_agent.0" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/6fca7e11-8f3f-4784-bdab-7e7f9503cd5b.org.qemu.guest_agent.0"/> > </channel> > <input bus="ps2" type="mouse"/> > <channel type="spicevmc"> > <target name="com.redhat.spice.0" type="virtio"/> > </channel> > <graphics autoport="yes" keymap="en-us" listen="0" passwd="*****" passwdValidTo="1970-01-01T00:00:01" port="-1" tlsPort="-1" type="spice"> > <channel mode="secure" name="main"/> > <channel mode="secure" name="inputs"/> > <channel mode="secure" name="cursor"/> > <channel mode="secure" name="playback"/> > <channel mode="secure" name="record"/> > <channel mode="secure" name="display"/> > <channel mode="secure" name="usbredir"/> > <channel mode="secure" name="smartcard"/> > </graphics> > <memballoon model="virtio"/> > <controller index="0" model="virtio-scsi" type="scsi"/> > <video> > <model heads="1" type="qxl" vram="32768"/> > </video> > <interface type="bridge"> > <mac address="00:1a:4a:58:22:89"/> > <model type="virtio"/> > <source bridge="rhevm"/> > <filterref filter="vdsm-no-mac-spoofing"/> > <link state="up"/> > <boot order="1"/> > <bandwidth/> > </interface> > <disk device="cdrom" snapshot="no" type="file"> > <source file="" startupPolicy="optional"/> > <target bus="ide" dev="hdc"/> > <readonly/> > <serial/> > </disk> > <disk device="disk" snapshot="no" type="block"> > <address bus="0" controller="0" target="0" type="drive" unit="0"/> > <source dev="/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/23aa0606-edc3-4882-a4aa-18aa1983458f/images/7afbd34c-3fd8-438a-964b-ff0a25fc709c/e18ca0ee-e29f-4b85-b352-62c5aeed9be2"/> > <target bus="scsi" dev="sda"/> > <serial>7afbd34c-3fd8-438a-964b-ff0a25fc709c</serial> > <driver cache="none" error_policy="stop" io="native" name="qemu" type="qcow2"/> > </disk> > </devices> > <os> > <type arch="x86_64" machine="rhel6.5.0">hvm</type> > <smbios mode="sysinfo"/> > </os> > <sysinfo type="smbios"> > <system> > <entry name="manufacturer">Red Hat</entry> > <entry name="product">RHEV Hypervisor</entry> > <entry name="version">6Server-6.5.0.1.el6</entry> > <entry name="serial">EDB5DCEA-C28B-11E0-A3A8-5CF3FC78EFF0</entry> > <entry name="uuid">6fca7e11-8f3f-4784-bdab-7e7f9503cd5b</entry> > </system> > </sysinfo> > <clock adjustment="0" offset="variable"> > <timer name="rtc" tickpolicy="catchup"/> > </clock> > <features> > <acpi/> > </features> > <cpu match="exact"> > <model>Westmere</model> > <topology cores="1" sockets="160" threads="1"/> > </cpu> ></domain> > >Thread-18::DEBUG::2014-07-24 10:24:52,889::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:24:52,897::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000764262 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:24:53,868::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >libvirtEventLoop::DEBUG::2014-07-24 10:24:53,901::vm::5176::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::event Started detail 0 opaque None >Thread-35::DEBUG::2014-07-24 10:24:54,108::vm::5032::vm.Vm::(_getUnderlyingDriveInfo) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Looking for drive with attributes {'name': u'hdc', 'bootOrder': '', 'boot': [], 'readonly': True, 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'path': '', 'type': u'cdrom'} >Thread-35::DEBUG::2014-07-24 10:24:54,109::vm::5053::vm.Vm::(_getUnderlyingDriveInfo) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Matched {'name': (u'hdc', u'hdc'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, True), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}), 'path': ('', ''), 'type': (u'cdrom', u'cdrom')} >Thread-35::DEBUG::2014-07-24 10:24:54,111::vm::5072::vm.Vm::(_getUnderlyingDriveInfo) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Matched {'name': (u'hdc', u'hdc'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, 'True'), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}), 'path': ('', ''), 'type': (u'cdrom', 'disk')} >Thread-35::DEBUG::2014-07-24 10:24:54,115::vm::5032::vm.Vm::(_getUnderlyingDriveInfo) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Looking for drive with attributes {'name': u'sda', 'bootOrder': '', 'boot': [], 'readonly': False, 'address': {u'bus': u'0', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'path': u'/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/23aa0606-edc3-4882-a4aa-18aa1983458f/images/7afbd34c-3fd8-438a-964b-ff0a25fc709c/e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'type': u'disk'} >Thread-35::DEBUG::2014-07-24 10:24:54,117::vm::5053::vm.Vm::(_getUnderlyingDriveInfo) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Matched {'name': (u'sda', u'sda'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (False, False), 'address': ({u'bus': u'0', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, {u'bus': u'0', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}), 'path': (u'/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/23aa0606-edc3-4882-a4aa-18aa1983458f/images/7afbd34c-3fd8-438a-964b-ff0a25fc709c/e18ca0ee-e29f-4b85-b352-62c5aeed9be2', '/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/23aa0606-edc3-4882-a4aa-18aa1983458f/images/7afbd34c-3fd8-438a-964b-ff0a25fc709c/e18ca0ee-e29f-4b85-b352-62c5aeed9be2'), 'type': (u'disk', u'disk')} >Thread-35::DEBUG::2014-07-24 10:24:54,119::vm::5072::vm.Vm::(_getUnderlyingDriveInfo) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Matched {'name': (u'sda', u'sda'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (False, 'False'), 'address': ({u'bus': u'0', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, {u'bus': u'0', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}), 'path': (u'/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/23aa0606-edc3-4882-a4aa-18aa1983458f/images/7afbd34c-3fd8-438a-964b-ff0a25fc709c/e18ca0ee-e29f-4b85-b352-62c5aeed9be2', '/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/23aa0606-edc3-4882-a4aa-18aa1983458f/images/7afbd34c-3fd8-438a-964b-ff0a25fc709c/e18ca0ee-e29f-4b85-b352-62c5aeed9be2'), 'type': (u'disk', 'disk')} >Dummy-33::DEBUG::2014-07-24 10:24:54,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.156529 s, 6.5 MB/s\n'; <rc> = 0 >Thread-35::DEBUG::2014-07-24 10:24:54,565::sampling::309::vm.Vm::(start) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Start statistics collection >Thread-37::DEBUG::2014-07-24 10:24:54,568::sampling::338::vm.Vm::(run) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Stats thread started >Thread-37::DEBUG::2014-07-24 10:24:54,576::task::595::TaskManager.Task::(_updateState) Task=`b75e2790-afa7-4684-a296-2781279c9968`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 10:24:54,578::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 10:24:54,580::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-37::DEBUG::2014-07-24 10:24:54,581::task::1185::TaskManager.Task::(prepare) Task=`b75e2790-afa7-4684-a296-2781279c9968`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-37::DEBUG::2014-07-24 10:24:54,582::task::595::TaskManager.Task::(_updateState) Task=`b75e2790-afa7-4684-a296-2781279c9968`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 10:24:54,582::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 10:24:54,584::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 10:24:54,585::task::990::TaskManager.Task::(_decref) Task=`b75e2790-afa7-4684-a296-2781279c9968`::ref 0 aborting False >Thread-35::DEBUG::2014-07-24 10:24:54,592::vmChannels::198::vds::(register) Add fileno 50 to listener's channels. >Thread-35::WARNING::2014-07-24 10:24:54,595::vm::3715::vm.Vm::(_readPauseCode) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::_readPauseCode unsupported by libvirt vm >Thread-35::DEBUG::2014-07-24 10:24:54,638::vm::2291::vm.Vm::(_startUnderlyingVm) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::_ongoingCreations released >Thread-14::DEBUG::2014-07-24 10:24:54,871::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call vmGetStats with ('6fca7e11-8f3f-4784-bdab-7e7f9503cd5b',) {} >Thread-14::DEBUG::2014-07-24 10:24:54,871::vm::598::vm.Vm::(_getCpuStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-24 10:24:54,871::vm::654::vm.Vm::(_getNetworkStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Network stats not available >Thread-14::DEBUG::2014-07-24 10:24:54,871::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-24 10:24:54,871::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >Thread-14::DEBUG::2014-07-24 10:24:54,872::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-24 10:24:54,872::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >Thread-14::DEBUG::2014-07-24 10:24:54,872::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '23972', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '391993537154198009', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'state': 'unknown', 'macAddr': '00:1a:4a:58:22:89', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '6fca7e11-8f3f-4784-bdab-7e7f9503cd5b', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'hdc': {'truesize': '0', 'apparentsize': '0'}, u'sda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c'}}, 'monitorResponse': '0', 'statsAge': '0.30', 'elapsedTime': '3', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >VM Channels Listener::DEBUG::2014-07-24 10:24:55,383::vmChannels::106::vds::(_do_add_channels) fileno 50 was added to unconnected channels. >VM Channels Listener::DEBUG::2014-07-24 10:24:55,384::vmChannels::132::vds::(_handle_unconnected) Trying to connect fileno 50. >VM Channels Listener::DEBUG::2014-07-24 10:24:55,384::guestIF::194::vm.Vm::(_connect) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Attempting connection to /var/lib/libvirt/qemu/channels/6fca7e11-8f3f-4784-bdab-7e7f9503cd5b.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-07-24 10:24:55,387::guestIF::197::vm.Vm::(_connect) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Connected to /var/lib/libvirt/qemu/channels/6fca7e11-8f3f-4784-bdab-7e7f9503cd5b.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-07-24 10:24:55,388::vmChannels::148::vds::(_handle_unconnected) Connecting to fileno 50 succeeded. >Dummy-33::DEBUG::2014-07-24 10:24:56,592::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:24:56,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339993 s, 30.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:24:58,006::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:24:58,006::task::595::TaskManager.Task::(_updateState) Task=`50cda13b-7d69-48d7-8fe6-f908e2fda820`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:24:58,007::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:24:58,007::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:24:58,007::task::1185::TaskManager.Task::(prepare) Task=`50cda13b-7d69-48d7-8fe6-f908e2fda820`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:24:58,007::task::595::TaskManager.Task::(_updateState) Task=`50cda13b-7d69-48d7-8fe6-f908e2fda820`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:24:58,007::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:24:58,008::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:24:58,008::task::990::TaskManager.Task::(_decref) Task=`50cda13b-7d69-48d7-8fe6-f908e2fda820`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:24:58,083::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:24:58,083::task::595::TaskManager.Task::(_updateState) Task=`fd6048d1-a813-4e5c-9f72-6c76fbe7b4cb`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:24:58,083::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:24:58,084::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4d7dae17-df66-4bcb-93f8-75edf1f740e2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:24:58,085::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:24:58,085::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:24:58,085::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4d7dae17-df66-4bcb-93f8-75edf1f740e2`::Granted request >Thread-34::DEBUG::2014-07-24 10:24:58,085::task::827::TaskManager.Task::(resourceAcquired) Task=`fd6048d1-a813-4e5c-9f72-6c76fbe7b4cb`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:24:58,085::task::990::TaskManager.Task::(_decref) Task=`fd6048d1-a813-4e5c-9f72-6c76fbe7b4cb`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:24:58,086::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:24:58,086::task::1185::TaskManager.Task::(prepare) Task=`fd6048d1-a813-4e5c-9f72-6c76fbe7b4cb`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:24:58,087::task::595::TaskManager.Task::(_updateState) Task=`fd6048d1-a813-4e5c-9f72-6c76fbe7b4cb`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:24:58,087::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:24:58,087::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:24:58,087::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:24:58,087::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:24:58,087::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:24:58,088::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:24:58,088::task::990::TaskManager.Task::(_decref) Task=`fd6048d1-a813-4e5c-9f72-6c76fbe7b4cb`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:24:58,410::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call vmGetStats with ('6fca7e11-8f3f-4784-bdab-7e7f9503cd5b',) {} >Thread-14::DEBUG::2014-07-24 10:24:58,410::vm::598::vm.Vm::(_getCpuStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-24 10:24:58,410::vm::654::vm.Vm::(_getNetworkStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Network stats not available >Thread-14::DEBUG::2014-07-24 10:24:58,410::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-24 10:24:58,410::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >Thread-14::DEBUG::2014-07-24 10:24:58,411::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-24 10:24:58,411::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >Thread-14::DEBUG::2014-07-24 10:24:58,411::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '23972', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '391993537154198009', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'state': 'unknown', 'macAddr': '00:1a:4a:58:22:89', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '6fca7e11-8f3f-4784-bdab-7e7f9503cd5b', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'hdc': {'truesize': '0', 'apparentsize': '0'}, u'sda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c'}}, 'monitorResponse': '0', 'statsAge': '1.75', 'elapsedTime': '7', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-24 10:24:58,680::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >GuestMonitor-VM1::DEBUG::2014-07-24 10:24:58,750::vm::598::vm.Vm::(_getCpuStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-VM1::DEBUG::2014-07-24 10:24:58,751::vm::654::vm.Vm::(_getNetworkStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Network stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:24:58,753::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:24:58,754::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:24:58,755::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:24:58,756::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:24:58,759::vm::598::vm.Vm::(_getCpuStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-VM1::DEBUG::2014-07-24 10:24:58,760::vm::654::vm.Vm::(_getNetworkStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Network stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:24:58,761::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:24:58,762::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:24:58,763::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:24:58,764::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >Dummy-33::DEBUG::2014-07-24 10:24:58,777::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334189 s, 30.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:25:00,789::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:25:00,864::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348142 s, 29.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:25:01,564::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call vmGetStats with ('6fca7e11-8f3f-4784-bdab-7e7f9503cd5b',) {} >Thread-14::DEBUG::2014-07-24 10:25:01,564::vm::598::vm.Vm::(_getCpuStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-24 10:25:01,564::vm::654::vm.Vm::(_getNetworkStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Network stats not available >Thread-14::DEBUG::2014-07-24 10:25:01,564::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-24 10:25:01,564::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >Thread-14::DEBUG::2014-07-24 10:25:01,565::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-24 10:25:01,565::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >Thread-14::DEBUG::2014-07-24 10:25:01,565::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '23972', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '391993537154198009', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'state': 'unknown', 'macAddr': '00:1a:4a:58:22:89', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '6fca7e11-8f3f-4784-bdab-7e7f9503cd5b', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'hdc': {'truesize': '0', 'apparentsize': '0'}, u'sda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c'}}, 'monitorResponse': '0', 'statsAge': '0.89', 'elapsedTime': '10', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-24 10:25:02,876::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-24 10:25:02,909::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:25:02,926::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000708977 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:25:03,009::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0872715 s, 11.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:25:03,393::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call vmSetTicket with ('6fca7e11-8f3f-4784-bdab-7e7f9503cd5b', 'fswy99tNbHLN', '120', 'disconnect', {'userName': 'admin', 'userId': 'fdfc627c-d875-11e0-90f0-83df133b58cc'}) {} flowID [7eeb950b] >Thread-14::DEBUG::2014-07-24 10:25:03,443::BindingXMLRPC::1074::vds::(wrapper) return vmSetTicket with {'status': {'message': 'Done', 'code': 0}} >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:03,772::vm::598::vm.Vm::(_getCpuStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:03,772::vm::654::vm.Vm::(_getNetworkStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Network stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:03,772::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:03,773::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:03,773::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:03,773::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:03,774::vm::598::vm.Vm::(_getCpuStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:03,774::vm::654::vm.Vm::(_getNetworkStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Network stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:03,774::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:03,775::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:03,775::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:03,775::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >Thread-14::DEBUG::2014-07-24 10:25:04,672::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call vmGetStats with ('6fca7e11-8f3f-4784-bdab-7e7f9503cd5b',) {} >Thread-14::DEBUG::2014-07-24 10:25:04,672::vm::598::vm.Vm::(_getCpuStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-24 10:25:04,672::vm::654::vm.Vm::(_getNetworkStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Network stats not available >Thread-14::DEBUG::2014-07-24 10:25:04,673::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-24 10:25:04,673::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >Thread-14::DEBUG::2014-07-24 10:25:04,673::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-24 10:25:04,673::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >Thread-14::DEBUG::2014-07-24 10:25:04,673::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '23972', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '391993537154198009', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable': 'true', 'network': {u'vnet0': {'state': 'unknown', 'macAddr': '00:1a:4a:58:22:89', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '6fca7e11-8f3f-4784-bdab-7e7f9503cd5b', 'displayType': 'qxl', 'cpuUser': '0.00', 'disks': {u'hdc': {'truesize': '0', 'apparentsize': '0'}, u'sda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c'}}, 'monitorResponse': '0', 'statsAge': '2.00', 'elapsedTime': '13', 'vmType': 'kvm', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-24 10:25:05,021::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:25:05,103::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351088 s, 29.2 MB/s\n'; <rc> = 0 >libvirtEventLoop::DEBUG::2014-07-24 10:25:05,750::clientIF::553::vm.Vm::(dispatchLibvirtEvents) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::graphics event phase 0 localAddr {'node': '10.35.64.88', 'service': '', 'family': 0} remoteAddr {'node': '10.35.2.195', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-07-24 10:25:05,837::clientIF::553::vm.Vm::(dispatchLibvirtEvents) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::graphics event phase 1 localAddr {'node': '10.35.64.88', 'service': '', 'family': 0} remoteAddr {'node': '10.35.2.195', 'service': '', 'family': 0}authScheme spice subject [] >libvirtEventLoop::DEBUG::2014-07-24 10:25:05,855::clientIF::553::vm.Vm::(dispatchLibvirtEvents) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::graphics event phase 0 localAddr {'node': '10.35.64.88', 'service': '', 'family': 0} remoteAddr {'node': '10.35.2.195', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-07-24 10:25:05,875::clientIF::553::vm.Vm::(dispatchLibvirtEvents) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::graphics event phase 1 localAddr {'node': '10.35.64.88', 'service': '', 'family': 0} remoteAddr {'node': '10.35.2.195', 'service': '', 'family': 0}authScheme spice subject [] >libvirtEventLoop::DEBUG::2014-07-24 10:25:05,912::clientIF::553::vm.Vm::(dispatchLibvirtEvents) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::graphics event phase 0 localAddr {'node': '10.35.64.88', 'service': '', 'family': 0} remoteAddr {'node': '10.35.2.195', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-07-24 10:25:05,913::clientIF::553::vm.Vm::(dispatchLibvirtEvents) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::graphics event phase 0 localAddr {'node': '10.35.64.88', 'service': '', 'family': 0} remoteAddr {'node': '10.35.2.195', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-07-24 10:25:05,995::clientIF::553::vm.Vm::(dispatchLibvirtEvents) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::graphics event phase 1 localAddr {'node': '10.35.64.88', 'service': '', 'family': 0} remoteAddr {'node': '10.35.2.195', 'service': '', 'family': 0}authScheme spice subject [] >libvirtEventLoop::DEBUG::2014-07-24 10:25:05,996::clientIF::553::vm.Vm::(dispatchLibvirtEvents) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::graphics event phase 1 localAddr {'node': '10.35.64.88', 'service': '', 'family': 0} remoteAddr {'node': '10.35.2.195', 'service': '', 'family': 0}authScheme spice subject [] >Dummy-33::DEBUG::2014-07-24 10:25:07,115::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:25:07,190::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358928 s, 28.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:25:07,743::task::595::TaskManager.Task::(_updateState) Task=`ade6ae0d-89df-48ef-be44-d115b41ba0d1`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:25:07,743::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:25:07,744::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000708977', 'lastCheck': '4.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:25:07,744::task::1185::TaskManager.Task::(prepare) Task=`ade6ae0d-89df-48ef-be44-d115b41ba0d1`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000708977', 'lastCheck': '4.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:25:07,744::task::595::TaskManager.Task::(_updateState) Task=`ade6ae0d-89df-48ef-be44-d115b41ba0d1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:25:07,744::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:25:07,744::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:25:07,744::task::990::TaskManager.Task::(_decref) Task=`ade6ae0d-89df-48ef-be44-d115b41ba0d1`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:25:07,856::vm::598::vm.Vm::(_getCpuStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::CPU stats not available: 'NoneType' object is unsubscriptable >Thread-14::DEBUG::2014-07-24 10:25:07,856::vm::654::vm.Vm::(_getNetworkStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Network stats not available >Thread-14::DEBUG::2014-07-24 10:25:07,857::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-24 10:25:07,857::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >Thread-14::DEBUG::2014-07-24 10:25:07,857::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-24 10:25:07,857::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >Thread-14::DEBUG::2014-07-24 10:25:08,148::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:25:08,149::task::595::TaskManager.Task::(_updateState) Task=`a451d97b-2f7d-4fdb-bf70-3ca0164d8b3a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:25:08,149::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:25:08,149::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:25:08,149::task::1185::TaskManager.Task::(prepare) Task=`a451d97b-2f7d-4fdb-bf70-3ca0164d8b3a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:25:08,150::task::595::TaskManager.Task::(_updateState) Task=`a451d97b-2f7d-4fdb-bf70-3ca0164d8b3a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:25:08,150::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:25:08,150::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:25:08,150::task::990::TaskManager.Task::(_decref) Task=`a451d97b-2f7d-4fdb-bf70-3ca0164d8b3a`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:25:08,183::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:25:08,183::task::595::TaskManager.Task::(_updateState) Task=`d37a6c44-6395-40ab-a667-d095a388fab3`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:25:08,183::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:25:08,184::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`092f67f2-dab1-44de-9e9c-439df15776e5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:25:08,184::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:25:08,184::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:25:08,184::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`092f67f2-dab1-44de-9e9c-439df15776e5`::Granted request >Thread-34::DEBUG::2014-07-24 10:25:08,185::task::827::TaskManager.Task::(resourceAcquired) Task=`d37a6c44-6395-40ab-a667-d095a388fab3`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:25:08,185::task::990::TaskManager.Task::(_decref) Task=`d37a6c44-6395-40ab-a667-d095a388fab3`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:25:08,186::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:25:08,186::task::1185::TaskManager.Task::(prepare) Task=`d37a6c44-6395-40ab-a667-d095a388fab3`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:25:08,186::task::595::TaskManager.Task::(_updateState) Task=`d37a6c44-6395-40ab-a667-d095a388fab3`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:25:08,186::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:25:08,186::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:25:08,187::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:25:08,187::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:25:08,187::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:25:08,187::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:25:08,187::task::990::TaskManager.Task::(_decref) Task=`d37a6c44-6395-40ab-a667-d095a388fab3`::ref 0 aborting False >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:08,781::vm::598::vm.Vm::(_getCpuStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:08,781::vm::654::vm.Vm::(_getNetworkStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Network stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:08,781::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:08,782::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:08,782::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:08,782::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:08,782::vm::598::vm.Vm::(_getCpuStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::CPU stats not available: 'NoneType' object is unsubscriptable >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:08,782::vm::654::vm.Vm::(_getNetworkStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Network stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:08,783::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:08,783::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:08,783::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:08,783::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >Dummy-33::DEBUG::2014-07-24 10:25:09,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:25:09,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351176 s, 29.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:25:11,053::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call vmGetStats with ('6fca7e11-8f3f-4784-bdab-7e7f9503cd5b',) {} >Thread-14::DEBUG::2014-07-24 10:25:11,053::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-24 10:25:11,053::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >Thread-14::DEBUG::2014-07-24 10:25:11,054::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-24 10:25:11,054::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >Thread-14::DEBUG::2014-07-24 10:25:11,054::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '23972', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '391993537154198009', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '10.35.2.195', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:58:22:89', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '6fca7e11-8f3f-4784-bdab-7e7f9503cd5b', 'displayType': 'qxl', 'cpuUser': '36.16', 'disks': {u'hdc': {'truesize': '0', 'apparentsize': '0'}, u'sda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c'}}, 'monitorResponse': '0', 'statsAge': '0.35', 'elapsedTime': '19', 'vmType': 'kvm', 'cpuSys': '25.74', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-24 10:25:11,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:25:11,363::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338687 s, 30.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:25:12,961::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:25:12,970::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000736298 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:25:13,376::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:25:13,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03885 s, 26.4 MB/s\n'; <rc> = 0 >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:13,789::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:13,789::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:13,795::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:13,795::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:13,796::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:13,796::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:13,796::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:13,796::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >Thread-14::DEBUG::2014-07-24 10:25:14,191::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call vmGetStats with ('6fca7e11-8f3f-4784-bdab-7e7f9503cd5b',) {} >Thread-14::DEBUG::2014-07-24 10:25:14,192::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-24 10:25:14,192::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >Thread-14::DEBUG::2014-07-24 10:25:14,192::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-24 10:25:14,192::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >Thread-14::DEBUG::2014-07-24 10:25:14,193::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '23972', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '391993537154198009', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '10.35.2.195', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:58:22:89', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '6fca7e11-8f3f-4784-bdab-7e7f9503cd5b', 'displayType': 'qxl', 'cpuUser': '36.16', 'disks': {u'hdc': {'truesize': '0', 'apparentsize': '0'}, u'sda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c'}}, 'monitorResponse': '0', 'statsAge': '1.48', 'elapsedTime': '22', 'vmType': 'kvm', 'cpuSys': '25.74', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-24 10:25:15,468::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:25:15,543::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359463 s, 28.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:25:17,358::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call vmGetStats with ('6fca7e11-8f3f-4784-bdab-7e7f9503cd5b',) {} >Thread-14::DEBUG::2014-07-24 10:25:17,358::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-24 10:25:17,359::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >Thread-14::DEBUG::2014-07-24 10:25:17,359::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-24 10:25:17,359::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >Thread-14::DEBUG::2014-07-24 10:25:17,359::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '23972', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '391993537154198009', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '10.35.2.195', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:58:22:89', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '6fca7e11-8f3f-4784-bdab-7e7f9503cd5b', 'displayType': 'qxl', 'cpuUser': '36.16', 'disks': {u'hdc': {'truesize': '0', 'apparentsize': '0'}, u'sda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c'}}, 'monitorResponse': '0', 'statsAge': '0.64', 'elapsedTime': '26', 'vmType': 'kvm', 'cpuSys': '25.74', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-24 10:25:17,556::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:25:17,630::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358413 s, 28.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:25:18,244::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:25:18,244::task::595::TaskManager.Task::(_updateState) Task=`d07c0207-990b-4d5a-a65b-62bc7b1c65fa`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:25:18,245::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:25:18,245::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:25:18,245::task::1185::TaskManager.Task::(prepare) Task=`d07c0207-990b-4d5a-a65b-62bc7b1c65fa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:25:18,245::task::595::TaskManager.Task::(_updateState) Task=`d07c0207-990b-4d5a-a65b-62bc7b1c65fa`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:25:18,246::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:25:18,246::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:25:18,246::task::990::TaskManager.Task::(_decref) Task=`d07c0207-990b-4d5a-a65b-62bc7b1c65fa`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:25:18,332::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:25:18,332::task::595::TaskManager.Task::(_updateState) Task=`ddda63c6-5323-4295-8c1c-0c1c3cefe13d`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:25:18,332::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:25:18,333::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`10aa2fd6-bb51-4af3-aa67-78f647f2a09a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:25:18,333::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:25:18,333::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:25:18,333::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`10aa2fd6-bb51-4af3-aa67-78f647f2a09a`::Granted request >Thread-34::DEBUG::2014-07-24 10:25:18,333::task::827::TaskManager.Task::(resourceAcquired) Task=`ddda63c6-5323-4295-8c1c-0c1c3cefe13d`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:25:18,334::task::990::TaskManager.Task::(_decref) Task=`ddda63c6-5323-4295-8c1c-0c1c3cefe13d`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:25:18,334::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:25:18,335::task::1185::TaskManager.Task::(prepare) Task=`ddda63c6-5323-4295-8c1c-0c1c3cefe13d`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:25:18,335::task::595::TaskManager.Task::(_updateState) Task=`ddda63c6-5323-4295-8c1c-0c1c3cefe13d`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:25:18,335::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:25:18,335::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:25:18,335::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:25:18,335::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:25:18,336::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:25:18,336::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:25:18,336::task::990::TaskManager.Task::(_decref) Task=`ddda63c6-5323-4295-8c1c-0c1c3cefe13d`::ref 0 aborting False >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:18,802::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:18,802::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:18,813::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:18,813::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:18,813::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:18,814::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:18,814::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:18,814::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >Dummy-33::DEBUG::2014-07-24 10:25:19,643::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:25:19,715::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337405 s, 30.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:25:20,481::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call vmGetStats with ('6fca7e11-8f3f-4784-bdab-7e7f9503cd5b',) {} >Thread-14::DEBUG::2014-07-24 10:25:20,481::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-24 10:25:20,482::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >Thread-14::DEBUG::2014-07-24 10:25:20,482::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-24 10:25:20,482::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >Thread-14::DEBUG::2014-07-24 10:25:20,482::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '23972', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '391993537154198009', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '10.35.2.195', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:58:22:89', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '6fca7e11-8f3f-4784-bdab-7e7f9503cd5b', 'displayType': 'qxl', 'cpuUser': '36.16', 'disks': {u'hdc': {'truesize': '0', 'apparentsize': '0'}, u'sda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c'}}, 'monitorResponse': '0', 'statsAge': '1.76', 'elapsedTime': '29', 'vmType': 'kvm', 'cpuSys': '25.74', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-24 10:25:21,728::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:25:21,824::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0438235 s, 23.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:25:22,975::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:25:22,985::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000749136 s, 5.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:25:23,542::task::595::TaskManager.Task::(_updateState) Task=`82035c28-f878-4c37-b034-af17252006c1`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:25:23,542::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:25:23,543::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000749136', 'lastCheck': '0.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:25:23,543::task::1185::TaskManager.Task::(prepare) Task=`82035c28-f878-4c37-b034-af17252006c1`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000749136', 'lastCheck': '0.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:25:23,543::task::595::TaskManager.Task::(_updateState) Task=`82035c28-f878-4c37-b034-af17252006c1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:25:23,543::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:25:23,543::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:25:23,543::task::990::TaskManager.Task::(_decref) Task=`82035c28-f878-4c37-b034-af17252006c1`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:25:23,659::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-24 10:25:23,659::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >Thread-14::DEBUG::2014-07-24 10:25:23,660::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-24 10:25:23,660::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:23,820::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:23,820::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:23,830::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:23,831::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:23,831::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:23,831::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:23,831::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:23,832::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >Dummy-33::DEBUG::2014-07-24 10:25:23,841::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:25:23,916::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363822 s, 28.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:25:25,424::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:25:25,929::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:25:26,004::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353021 s, 29.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:25:26,857::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call vmGetStats with ('6fca7e11-8f3f-4784-bdab-7e7f9503cd5b',) {} >Thread-14::DEBUG::2014-07-24 10:25:26,858::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-24 10:25:26,858::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >Thread-14::DEBUG::2014-07-24 10:25:26,858::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-24 10:25:26,858::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >Thread-14::DEBUG::2014-07-24 10:25:26,859::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '23972', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '391993537154198009', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '10.35.2.195', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:58:22:89', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '6fca7e11-8f3f-4784-bdab-7e7f9503cd5b', 'displayType': 'qxl', 'cpuUser': '22.25', 'disks': {u'hdc': {'truesize': '0', 'apparentsize': '0'}, u'sda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c'}}, 'monitorResponse': '0', 'statsAge': '0.12', 'elapsedTime': '35', 'vmType': 'kvm', 'cpuSys': '13.70', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-24 10:25:28,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:25:28,091::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356627 s, 28.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:25:28,398::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:25:28,400::task::595::TaskManager.Task::(_updateState) Task=`58400a71-ac2a-4a14-bfb2-67bcb11011ee`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:25:28,401::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:25:28,403::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:25:28,404::task::1185::TaskManager.Task::(prepare) Task=`58400a71-ac2a-4a14-bfb2-67bcb11011ee`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:25:28,405::task::595::TaskManager.Task::(_updateState) Task=`58400a71-ac2a-4a14-bfb2-67bcb11011ee`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:25:28,405::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:25:28,406::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:25:28,407::task::990::TaskManager.Task::(_decref) Task=`58400a71-ac2a-4a14-bfb2-67bcb11011ee`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:25:28,440::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:25:28,440::task::595::TaskManager.Task::(_updateState) Task=`9b52790d-829a-45d3-b2e6-ae2fd9035369`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:25:28,440::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:25:28,441::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`df22ea51-0411-484a-b1aa-af192e989f2f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:25:28,441::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:25:28,441::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:25:28,441::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`df22ea51-0411-484a-b1aa-af192e989f2f`::Granted request >Thread-34::DEBUG::2014-07-24 10:25:28,441::task::827::TaskManager.Task::(resourceAcquired) Task=`9b52790d-829a-45d3-b2e6-ae2fd9035369`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:25:28,442::task::990::TaskManager.Task::(_decref) Task=`9b52790d-829a-45d3-b2e6-ae2fd9035369`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:25:28,442::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:25:28,442::task::1185::TaskManager.Task::(prepare) Task=`9b52790d-829a-45d3-b2e6-ae2fd9035369`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:25:28,443::task::595::TaskManager.Task::(_updateState) Task=`9b52790d-829a-45d3-b2e6-ae2fd9035369`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:25:28,443::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:25:28,443::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:25:28,443::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:25:28,443::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:25:28,444::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:25:28,444::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:25:28,444::task::990::TaskManager.Task::(_decref) Task=`9b52790d-829a-45d3-b2e6-ae2fd9035369`::ref 0 aborting False >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:28,837::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:28,838::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:28,854::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:28,854::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:28,855::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:28,855::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:28,855::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:28,855::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >Thread-14::DEBUG::2014-07-24 10:25:29,946::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call vmGetStats with ('6fca7e11-8f3f-4784-bdab-7e7f9503cd5b',) {} >Thread-14::DEBUG::2014-07-24 10:25:29,946::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-24 10:25:29,946::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >Thread-14::DEBUG::2014-07-24 10:25:29,946::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-24 10:25:29,946::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >Thread-14::DEBUG::2014-07-24 10:25:29,947::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '23972', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '391993537154198009', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '10.35.2.195', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:58:22:89', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '6fca7e11-8f3f-4784-bdab-7e7f9503cd5b', 'displayType': 'qxl', 'cpuUser': '22.25', 'disks': {u'hdc': {'truesize': '0', 'apparentsize': '0'}, u'sda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c'}}, 'monitorResponse': '0', 'statsAge': '1.21', 'elapsedTime': '38', 'vmType': 'kvm', 'cpuSys': '13.70', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-24 10:25:30,103::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:25:30,179::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359595 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:25:32,191::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:25:32,266::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364194 s, 28.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:25:32,990::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:25:32,998::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000695397 s, 5.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:25:33,038::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call vmGetStats with ('6fca7e11-8f3f-4784-bdab-7e7f9503cd5b',) {} >Thread-14::DEBUG::2014-07-24 10:25:33,038::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-24 10:25:33,038::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >Thread-14::DEBUG::2014-07-24 10:25:33,038::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-24 10:25:33,039::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >Thread-14::DEBUG::2014-07-24 10:25:33,039::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '23972', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '391993537154198009', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '10.35.2.195', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:58:22:89', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '6fca7e11-8f3f-4784-bdab-7e7f9503cd5b', 'displayType': 'qxl', 'cpuUser': '22.25', 'disks': {u'hdc': {'truesize': '0', 'apparentsize': '0'}, u'sda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c'}}, 'monitorResponse': '0', 'statsAge': '0.29', 'elapsedTime': '41', 'vmType': 'kvm', 'cpuSys': '13.70', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:33,861::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:33,861::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:33,866::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:33,866::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:33,866::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:33,866::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:33,867::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:33,867::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >Dummy-33::DEBUG::2014-07-24 10:25:34,279::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:25:34,354::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361287 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:25:36,367::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:25:36,455::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338812 s, 30.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:25:36,518::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call vmGetStats with ('6fca7e11-8f3f-4784-bdab-7e7f9503cd5b',) {} >Thread-14::DEBUG::2014-07-24 10:25:36,518::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-24 10:25:36,518::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >Thread-14::DEBUG::2014-07-24 10:25:36,519::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-24 10:25:36,519::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >Thread-14::DEBUG::2014-07-24 10:25:36,519::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '23972', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '391993537154198009', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '10.35.2.195', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:58:22:89', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '6fca7e11-8f3f-4784-bdab-7e7f9503cd5b', 'displayType': 'qxl', 'cpuUser': '22.25', 'disks': {u'hdc': {'truesize': '0', 'apparentsize': '0'}, u'sda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c'}}, 'monitorResponse': '0', 'statsAge': '1.77', 'elapsedTime': '45', 'vmType': 'kvm', 'cpuSys': '13.70', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-24 10:25:38,467::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-24 10:25:38,520::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:25:38,522::task::595::TaskManager.Task::(_updateState) Task=`ba6b6538-d1cb-4e43-bc50-fcd0d091459f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:25:38,522::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:25:38,524::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:25:38,524::task::1185::TaskManager.Task::(prepare) Task=`ba6b6538-d1cb-4e43-bc50-fcd0d091459f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:25:38,525::task::595::TaskManager.Task::(_updateState) Task=`ba6b6538-d1cb-4e43-bc50-fcd0d091459f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:25:38,526::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:25:38,526::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:25:38,527::task::990::TaskManager.Task::(_decref) Task=`ba6b6538-d1cb-4e43-bc50-fcd0d091459f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:25:38,553::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359388 s, 28.5 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-24 10:25:38,566::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:25:38,566::task::595::TaskManager.Task::(_updateState) Task=`132cdb8b-ae15-4d30-92b2-7297f245ead3`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:25:38,567::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:25:38,567::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`50d61c0b-8b44-4383-8da1-b1326e3c41e8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:25:38,567::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:25:38,567::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:25:38,568::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`50d61c0b-8b44-4383-8da1-b1326e3c41e8`::Granted request >Thread-34::DEBUG::2014-07-24 10:25:38,568::task::827::TaskManager.Task::(resourceAcquired) Task=`132cdb8b-ae15-4d30-92b2-7297f245ead3`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:25:38,568::task::990::TaskManager.Task::(_decref) Task=`132cdb8b-ae15-4d30-92b2-7297f245ead3`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:25:38,569::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:25:38,569::task::1185::TaskManager.Task::(prepare) Task=`132cdb8b-ae15-4d30-92b2-7297f245ead3`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:25:38,569::task::595::TaskManager.Task::(_updateState) Task=`132cdb8b-ae15-4d30-92b2-7297f245ead3`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:25:38,569::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:25:38,569::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:25:38,570::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:25:38,570::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:25:38,570::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:25:38,570::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:25:38,570::task::990::TaskManager.Task::(_decref) Task=`132cdb8b-ae15-4d30-92b2-7297f245ead3`::ref 0 aborting False >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:38,873::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:38,873::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:38,878::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:38,878::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:38,878::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:38,878::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:38,879::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:38,879::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >Thread-14::DEBUG::2014-07-24 10:25:39,579::task::595::TaskManager.Task::(_updateState) Task=`c4f8d13f-2f4f-4f6f-9748-b8ba03ba72ea`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:25:39,579::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:25:39,579::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000695397', 'lastCheck': '6.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:25:39,580::task::1185::TaskManager.Task::(prepare) Task=`c4f8d13f-2f4f-4f6f-9748-b8ba03ba72ea`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000695397', 'lastCheck': '6.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:25:39,580::task::595::TaskManager.Task::(_updateState) Task=`c4f8d13f-2f4f-4f6f-9748-b8ba03ba72ea`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:25:39,580::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:25:39,580::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:25:39,580::task::990::TaskManager.Task::(_decref) Task=`c4f8d13f-2f4f-4f6f-9748-b8ba03ba72ea`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:25:39,715::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-24 10:25:39,715::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >Thread-14::DEBUG::2014-07-24 10:25:39,715::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-24 10:25:39,716::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >Dummy-33::DEBUG::2014-07-24 10:25:40,565::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:25:40,641::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364642 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:25:42,653::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:25:42,729::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365814 s, 28.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:25:42,852::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call vmGetStats with ('6fca7e11-8f3f-4784-bdab-7e7f9503cd5b',) {} >Thread-14::DEBUG::2014-07-24 10:25:42,852::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-24 10:25:42,853::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >Thread-14::DEBUG::2014-07-24 10:25:42,853::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-24 10:25:42,853::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >Thread-14::DEBUG::2014-07-24 10:25:42,853::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '23972', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '391993537154198009', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '10.35.2.195', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:58:22:89', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '6fca7e11-8f3f-4784-bdab-7e7f9503cd5b', 'displayType': 'qxl', 'cpuUser': '11.99', 'disks': {u'hdc': {'truesize': '0', 'apparentsize': '0'}, u'sda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c'}}, 'monitorResponse': '0', 'statsAge': '0.09', 'elapsedTime': '51', 'vmType': 'kvm', 'cpuSys': '7.32', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-18::DEBUG::2014-07-24 10:25:43,003::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:25:43,013::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000796461 s, 5.1 MB/s\n'; <rc> = 0 >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:43,885::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:43,885::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:43,895::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:43,895::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:43,896::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:43,896::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:43,896::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:43,896::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >Dummy-33::DEBUG::2014-07-24 10:25:44,741::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:25:44,818::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0377168 s, 27.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:25:46,007::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call vmGetStats with ('6fca7e11-8f3f-4784-bdab-7e7f9503cd5b',) {} >Thread-14::DEBUG::2014-07-24 10:25:46,007::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-24 10:25:46,007::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >Thread-14::DEBUG::2014-07-24 10:25:46,008::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-24 10:25:46,008::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >Thread-14::DEBUG::2014-07-24 10:25:46,008::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '23972', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '391993537154198009', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '10.35.2.195', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:58:22:89', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '6fca7e11-8f3f-4784-bdab-7e7f9503cd5b', 'displayType': 'qxl', 'cpuUser': '11.99', 'disks': {u'hdc': {'truesize': '0', 'apparentsize': '0'}, u'sda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c'}}, 'monitorResponse': '0', 'statsAge': '1.24', 'elapsedTime': '54', 'vmType': 'kvm', 'cpuSys': '7.32', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-24 10:25:46,830::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:25:46,905::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358444 s, 28.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:25:48,627::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:25:48,627::task::595::TaskManager.Task::(_updateState) Task=`5f66c54c-1db2-41c2-9896-52c5abaac9ee`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:25:48,628::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:25:48,628::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:25:48,628::task::1185::TaskManager.Task::(prepare) Task=`5f66c54c-1db2-41c2-9896-52c5abaac9ee`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:25:48,628::task::595::TaskManager.Task::(_updateState) Task=`5f66c54c-1db2-41c2-9896-52c5abaac9ee`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:25:48,628::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:25:48,629::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:25:48,629::task::990::TaskManager.Task::(_decref) Task=`5f66c54c-1db2-41c2-9896-52c5abaac9ee`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:25:48,703::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:25:48,703::task::595::TaskManager.Task::(_updateState) Task=`777cfadb-52bd-4659-b8c8-5a9237392ac7`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:25:48,703::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:25:48,704::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`6d3e5c00-9d72-4528-bae5-6f47d6649ec3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:25:48,704::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:25:48,704::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:25:48,704::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`6d3e5c00-9d72-4528-bae5-6f47d6649ec3`::Granted request >Thread-34::DEBUG::2014-07-24 10:25:48,705::task::827::TaskManager.Task::(resourceAcquired) Task=`777cfadb-52bd-4659-b8c8-5a9237392ac7`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:25:48,705::task::990::TaskManager.Task::(_decref) Task=`777cfadb-52bd-4659-b8c8-5a9237392ac7`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:25:48,705::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:25:48,706::task::1185::TaskManager.Task::(prepare) Task=`777cfadb-52bd-4659-b8c8-5a9237392ac7`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:25:48,706::task::595::TaskManager.Task::(_updateState) Task=`777cfadb-52bd-4659-b8c8-5a9237392ac7`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:25:48,706::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:25:48,706::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:25:48,706::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:25:48,707::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:25:48,707::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:25:48,707::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:25:48,707::task::990::TaskManager.Task::(_decref) Task=`777cfadb-52bd-4659-b8c8-5a9237392ac7`::ref 0 aborting False >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:48,902::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:48,902::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:48,913::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:48,913::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:48,913::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:48,914::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:48,914::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:48,914::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >Dummy-33::DEBUG::2014-07-24 10:25:48,917::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:25:48,992::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351612 s, 29.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:25:49,111::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call vmGetStats with ('6fca7e11-8f3f-4784-bdab-7e7f9503cd5b',) {} >Thread-14::DEBUG::2014-07-24 10:25:49,111::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-24 10:25:49,112::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >Thread-14::DEBUG::2014-07-24 10:25:49,112::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-24 10:25:49,112::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >Thread-14::DEBUG::2014-07-24 10:25:49,112::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Powering up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '23972', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '391993537154198009', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '10.35.2.195', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:58:22:89', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '6fca7e11-8f3f-4784-bdab-7e7f9503cd5b', 'displayType': 'qxl', 'cpuUser': '11.99', 'disks': {u'hdc': {'truesize': '0', 'apparentsize': '0'}, u'sda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c'}}, 'monitorResponse': '0', 'statsAge': '0.33', 'elapsedTime': '57', 'vmType': 'kvm', 'cpuSys': '7.32', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-24 10:25:51,004::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:25:51,080::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365653 s, 28.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:25:52,253::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call vmGetStats with ('6fca7e11-8f3f-4784-bdab-7e7f9503cd5b',) {} >Thread-14::DEBUG::2014-07-24 10:25:52,254::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >Thread-14::DEBUG::2014-07-24 10:25:52,254::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >Thread-14::DEBUG::2014-07-24 10:25:52,254::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >Thread-14::DEBUG::2014-07-24 10:25:52,254::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >Thread-14::DEBUG::2014-07-24 10:25:52,254::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '23972', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '391993537154198009', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'pauseCode': 'NOERR', 'clientIp': '10.35.2.195', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:58:22:89', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '6fca7e11-8f3f-4784-bdab-7e7f9503cd5b', 'displayType': 'qxl', 'cpuUser': '11.99', 'disks': {u'hdc': {'truesize': '0', 'apparentsize': '0'}, u'sda': {'truesize': '1073741824', 'apparentsize': '1073741824', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c'}}, 'monitorResponse': '0', 'statsAge': '1.47', 'elapsedTime': '60', 'vmType': 'kvm', 'cpuSys': '7.32', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-18::DEBUG::2014-07-24 10:25:53,017::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:25:53,026::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000644335 s, 6.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:25:53,092::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:25:53,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367066 s, 27.9 MB/s\n'; <rc> = 0 >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:53,920::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:53,920::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:53,924::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:53,924::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:53,925::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:53,925::vm::676::vm.Vm::(_getDiskStats) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda stats not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:53,925::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk hdc latency not available >GuestMonitor-VM1::DEBUG::2014-07-24 10:25:53,925::vm::715::vm.Vm::(_getDiskLatency) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Disk sda latency not available >Thread-37::DEBUG::2014-07-24 10:25:54,790::task::595::TaskManager.Task::(_updateState) Task=`782e05c9-1058-4553-9860-897bf1b4eb9a`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 10:25:54,790::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 10:25:54,791::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-37::DEBUG::2014-07-24 10:25:54,792::task::1185::TaskManager.Task::(prepare) Task=`782e05c9-1058-4553-9860-897bf1b4eb9a`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-37::DEBUG::2014-07-24 10:25:54,792::task::595::TaskManager.Task::(_updateState) Task=`782e05c9-1058-4553-9860-897bf1b4eb9a`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 10:25:54,792::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 10:25:54,792::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 10:25:54,792::task::990::TaskManager.Task::(_decref) Task=`782e05c9-1058-4553-9860-897bf1b4eb9a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:25:55,180::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:25:55,259::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360876 s, 28.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:25:55,345::task::595::TaskManager.Task::(_updateState) Task=`e30e9c40-57d0-4fe8-aa5c-6b3e81127b98`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:25:55,345::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:25:55,346::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644335', 'lastCheck': '2.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:25:55,346::task::1185::TaskManager.Task::(prepare) Task=`e30e9c40-57d0-4fe8-aa5c-6b3e81127b98`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644335', 'lastCheck': '2.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:25:55,346::task::595::TaskManager.Task::(_updateState) Task=`e30e9c40-57d0-4fe8-aa5c-6b3e81127b98`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:25:55,346::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:25:55,346::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:25:55,347::task::990::TaskManager.Task::(_decref) Task=`e30e9c40-57d0-4fe8-aa5c-6b3e81127b98`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-07-24 10:25:55,460::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:25:57,273::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:25:57,351::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036433 s, 28.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:25:58,771::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [21656b69] >Thread-14::DEBUG::2014-07-24 10:25:58,771::task::595::TaskManager.Task::(_updateState) Task=`e6382249-dcc2-4173-a090-ebb4e33ebc64`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:25:58,772::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:25:58,772::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:25:58,772::task::1185::TaskManager.Task::(prepare) Task=`e6382249-dcc2-4173-a090-ebb4e33ebc64`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:25:58,772::task::595::TaskManager.Task::(_updateState) Task=`e6382249-dcc2-4173-a090-ebb4e33ebc64`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:25:58,773::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:25:58,773::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:25:58,773::task::990::TaskManager.Task::(_decref) Task=`e6382249-dcc2-4173-a090-ebb4e33ebc64`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:25:58,815::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [21656b69] >Thread-34::DEBUG::2014-07-24 10:25:58,816::task::595::TaskManager.Task::(_updateState) Task=`b5365da6-5e26-495b-9517-9272bc7f54c7`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:25:58,816::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:25:58,816::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`759baec7-8ecd-42cb-b5cb-3c06f80ac50c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:25:58,817::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:25:58,817::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:25:58,817::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`759baec7-8ecd-42cb-b5cb-3c06f80ac50c`::Granted request >Thread-34::DEBUG::2014-07-24 10:25:58,817::task::827::TaskManager.Task::(resourceAcquired) Task=`b5365da6-5e26-495b-9517-9272bc7f54c7`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:25:58,817::task::990::TaskManager.Task::(_decref) Task=`b5365da6-5e26-495b-9517-9272bc7f54c7`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:25:58,818::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:25:58,818::task::1185::TaskManager.Task::(prepare) Task=`b5365da6-5e26-495b-9517-9272bc7f54c7`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:25:58,819::task::595::TaskManager.Task::(_updateState) Task=`b5365da6-5e26-495b-9517-9272bc7f54c7`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:25:58,819::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:25:58,819::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:25:58,819::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:25:58,819::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:25:58,820::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:25:58,820::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:25:58,820::task::990::TaskManager.Task::(_decref) Task=`b5365da6-5e26-495b-9517-9272bc7f54c7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:25:59,363::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:25:59,443::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364609 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:26:01,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:26:01,536::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359692 s, 28.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:26:03,031::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 23aa0606-edc3-4882-a4aa-18aa1983458f >Thread-18::DEBUG::2014-07-24 10:26:03,031::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-18::DEBUG::2014-07-24 10:26:03,031::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:26:03,041::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000585402 s, 3.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:26:03,042::misc::264::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000585402 s, 3.5 MB/s'], size: 2048 >Thread-18::DEBUG::2014-07-24 10:26:03,042::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-18::WARNING::2014-07-24 10:26:03,042::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-18::DEBUG::2014-07-24 10:26:03,042::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-18::DEBUG::2014-07-24 10:26:03,042::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 10:26:03,043::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 10:26:03,043::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 10:26:03,043::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 10:26:03,043::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 10:26:03,044::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-18::DEBUG::2014-07-24 10:26:03,310::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:26:03,312::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 10:26:03,312::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'LOCKPOLICY=', 'POOL_DOMAINS=23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'POOL_DESCRIPTION=DS1', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_UUID=637ea13c-81a8-4b44-8cab-961458b01883', 'POOL_SPM_ID=1', '_SHA_CKSUM=a749afdc7119a2d6aad840af5c63c9b28c0b612c', 'POOL_SPM_LVER=0'] >Thread-18::INFO::2014-07-24 10:26:03,313::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_imageNS already registered >Thread-18::INFO::2014-07-24 10:26:03,313::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_volumeNS already registered >Thread-18::INFO::2014-07-24 10:26:03,313::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_lvmActivationNS already registered >Thread-18::DEBUG::2014-07-24 10:26:03,314::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-18::DEBUG::2014-07-24 10:26:03,467::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:26:03,467::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:26:03,477::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000443214 s, 9.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:26:03,549::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:26:03,630::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0375524 s, 27.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:26:05,643::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:26:05,727::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359387 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:26:07,740::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:26:07,824::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0371453 s, 27.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:26:08,876::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:26:08,877::task::595::TaskManager.Task::(_updateState) Task=`84d1d640-d9c0-4020-bcea-b2963c07f54d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:26:08,877::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:26:08,878::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:26:08,878::task::1185::TaskManager.Task::(prepare) Task=`84d1d640-d9c0-4020-bcea-b2963c07f54d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:26:08,878::task::595::TaskManager.Task::(_updateState) Task=`84d1d640-d9c0-4020-bcea-b2963c07f54d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:26:08,878::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:26:08,878::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:26:08,878::task::990::TaskManager.Task::(_decref) Task=`84d1d640-d9c0-4020-bcea-b2963c07f54d`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:26:08,911::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:26:08,911::task::595::TaskManager.Task::(_updateState) Task=`42ee0fd8-f7b3-4a98-a8fa-7e9e0528892c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:26:08,911::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:26:08,912::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1902f077-9a93-4522-ba30-c11fadadd1b0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:26:08,912::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:26:08,912::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:26:08,912::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1902f077-9a93-4522-ba30-c11fadadd1b0`::Granted request >Thread-34::DEBUG::2014-07-24 10:26:08,913::task::827::TaskManager.Task::(resourceAcquired) Task=`42ee0fd8-f7b3-4a98-a8fa-7e9e0528892c`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:26:08,913::task::990::TaskManager.Task::(_decref) Task=`42ee0fd8-f7b3-4a98-a8fa-7e9e0528892c`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:26:08,913::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:26:08,914::task::1185::TaskManager.Task::(prepare) Task=`42ee0fd8-f7b3-4a98-a8fa-7e9e0528892c`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:26:08,914::task::595::TaskManager.Task::(_updateState) Task=`42ee0fd8-f7b3-4a98-a8fa-7e9e0528892c`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:26:08,914::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:26:08,914::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:26:08,914::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:26:08,915::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:26:08,915::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:26:08,915::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:26:08,915::task::990::TaskManager.Task::(_decref) Task=`42ee0fd8-f7b3-4a98-a8fa-7e9e0528892c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:26:09,837::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:26:09,917::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364076 s, 28.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:26:10,843::task::595::TaskManager.Task::(_updateState) Task=`86477d5d-35d1-436f-b51a-1bd50ae1a4a1`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:26:10,844::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:26:10,844::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000443214', 'lastCheck': '7.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:26:10,844::task::1185::TaskManager.Task::(prepare) Task=`86477d5d-35d1-436f-b51a-1bd50ae1a4a1`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000443214', 'lastCheck': '7.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:26:10,844::task::595::TaskManager.Task::(_updateState) Task=`86477d5d-35d1-436f-b51a-1bd50ae1a4a1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:26:10,844::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:26:10,844::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:26:10,845::task::990::TaskManager.Task::(_decref) Task=`86477d5d-35d1-436f-b51a-1bd50ae1a4a1`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:26:11,929::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:26:12,009::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0371419 s, 27.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:26:13,482::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:26:13,492::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000550831 s, 7.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:26:14,021::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:26:14,104::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036671 s, 27.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:26:16,117::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:26:16,198::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0392221 s, 26.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:26:18,210::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:26:18,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0374878 s, 27.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:26:19,025::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:26:19,026::task::595::TaskManager.Task::(_updateState) Task=`50148742-0b52-4059-925d-2a1c9f5a8679`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:26:19,026::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:26:19,027::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:26:19,027::task::1185::TaskManager.Task::(prepare) Task=`50148742-0b52-4059-925d-2a1c9f5a8679`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:26:19,027::task::595::TaskManager.Task::(_updateState) Task=`50148742-0b52-4059-925d-2a1c9f5a8679`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:26:19,027::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:26:19,027::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:26:19,027::task::990::TaskManager.Task::(_decref) Task=`50148742-0b52-4059-925d-2a1c9f5a8679`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:26:19,076::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:26:19,077::task::595::TaskManager.Task::(_updateState) Task=`05f3ca38-fb2e-4c5b-bc3e-b8c16d927661`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:26:19,077::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:26:19,077::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1d2e63c6-9c9e-45eb-980f-606d7a55717a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:26:19,078::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:26:19,078::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:26:19,078::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1d2e63c6-9c9e-45eb-980f-606d7a55717a`::Granted request >Thread-34::DEBUG::2014-07-24 10:26:19,078::task::827::TaskManager.Task::(resourceAcquired) Task=`05f3ca38-fb2e-4c5b-bc3e-b8c16d927661`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:26:19,078::task::990::TaskManager.Task::(_decref) Task=`05f3ca38-fb2e-4c5b-bc3e-b8c16d927661`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:26:19,079::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:26:19,079::task::1185::TaskManager.Task::(prepare) Task=`05f3ca38-fb2e-4c5b-bc3e-b8c16d927661`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:26:19,080::task::595::TaskManager.Task::(_updateState) Task=`05f3ca38-fb2e-4c5b-bc3e-b8c16d927661`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:26:19,080::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:26:19,080::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:26:19,080::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:26:19,080::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:26:19,080::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:26:19,081::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:26:19,081::task::990::TaskManager.Task::(_decref) Task=`05f3ca38-fb2e-4c5b-bc3e-b8c16d927661`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:26:20,301::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:26:20,380::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365675 s, 28.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:26:22,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:26:22,474::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0395693 s, 25.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:26:23,496::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:26:23,506::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0005852 s, 7.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:26:24,487::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:26:24,562::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035229 s, 29.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:26:25,508::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-14::DEBUG::2014-07-24 10:26:26,233::task::595::TaskManager.Task::(_updateState) Task=`a53162e0-6db5-421a-9717-78eab08f6a90`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:26:26,234::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:26:26,234::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0005852', 'lastCheck': '2.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:26:26,234::task::1185::TaskManager.Task::(prepare) Task=`a53162e0-6db5-421a-9717-78eab08f6a90`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0005852', 'lastCheck': '2.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:26:26,234::task::595::TaskManager.Task::(_updateState) Task=`a53162e0-6db5-421a-9717-78eab08f6a90`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:26:26,234::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:26:26,235::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:26:26,235::task::990::TaskManager.Task::(_decref) Task=`a53162e0-6db5-421a-9717-78eab08f6a90`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:26:26,575::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:26:26,662::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346984 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:26:28,674::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:26:28,749::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358739 s, 28.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:26:29,143::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:26:29,144::task::595::TaskManager.Task::(_updateState) Task=`9d73e076-c973-4591-a4e9-6e94b51b98b3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:26:29,144::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:26:29,144::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:26:29,144::task::1185::TaskManager.Task::(prepare) Task=`9d73e076-c973-4591-a4e9-6e94b51b98b3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:26:29,144::task::595::TaskManager.Task::(_updateState) Task=`9d73e076-c973-4591-a4e9-6e94b51b98b3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:26:29,145::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:26:29,145::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:26:29,145::task::990::TaskManager.Task::(_decref) Task=`9d73e076-c973-4591-a4e9-6e94b51b98b3`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:26:29,177::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:26:29,177::task::595::TaskManager.Task::(_updateState) Task=`9e001484-f650-43f0-af28-5d6ccc655745`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:26:29,177::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:26:29,178::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c9ddf5d2-eeaf-4e6e-9477-936ea714f7ab`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:26:29,178::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:26:29,178::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:26:29,178::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c9ddf5d2-eeaf-4e6e-9477-936ea714f7ab`::Granted request >Thread-34::DEBUG::2014-07-24 10:26:29,179::task::827::TaskManager.Task::(resourceAcquired) Task=`9e001484-f650-43f0-af28-5d6ccc655745`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:26:29,179::task::990::TaskManager.Task::(_decref) Task=`9e001484-f650-43f0-af28-5d6ccc655745`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:26:29,180::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:26:29,180::task::1185::TaskManager.Task::(prepare) Task=`9e001484-f650-43f0-af28-5d6ccc655745`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:26:29,180::task::595::TaskManager.Task::(_updateState) Task=`9e001484-f650-43f0-af28-5d6ccc655745`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:26:29,180::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:26:29,180::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:26:29,181::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:26:29,181::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:26:29,181::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:26:29,181::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:26:29,181::task::990::TaskManager.Task::(_decref) Task=`9e001484-f650-43f0-af28-5d6ccc655745`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:26:30,762::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:26:30,837::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362042 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:26:32,850::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:26:32,927::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354541 s, 28.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:26:33,511::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:26:33,521::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000629219 s, 6.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:26:34,939::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:26:35,013::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342569 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:26:37,025::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:26:37,102::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360033 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:26:39,115::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:26:39,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372756 s, 27.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:26:39,236::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:26:39,236::task::595::TaskManager.Task::(_updateState) Task=`27241e6b-3e3c-47c9-8b9f-f13875e86216`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:26:39,237::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:26:39,237::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:26:39,237::task::1185::TaskManager.Task::(prepare) Task=`27241e6b-3e3c-47c9-8b9f-f13875e86216`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:26:39,237::task::595::TaskManager.Task::(_updateState) Task=`27241e6b-3e3c-47c9-8b9f-f13875e86216`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:26:39,238::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:26:39,238::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:26:39,238::task::990::TaskManager.Task::(_decref) Task=`27241e6b-3e3c-47c9-8b9f-f13875e86216`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:26:39,269::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:26:39,270::task::595::TaskManager.Task::(_updateState) Task=`b39230a4-9c08-4081-a3f0-a2fbb586a372`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:26:39,270::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:26:39,270::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`183abc5a-6bf5-4663-89f5-192a2a917ac5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:26:39,270::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:26:39,271::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:26:39,271::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`183abc5a-6bf5-4663-89f5-192a2a917ac5`::Granted request >Thread-34::DEBUG::2014-07-24 10:26:39,271::task::827::TaskManager.Task::(resourceAcquired) Task=`b39230a4-9c08-4081-a3f0-a2fbb586a372`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:26:39,271::task::990::TaskManager.Task::(_decref) Task=`b39230a4-9c08-4081-a3f0-a2fbb586a372`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:26:39,272::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:26:39,272::task::1185::TaskManager.Task::(prepare) Task=`b39230a4-9c08-4081-a3f0-a2fbb586a372`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:26:39,273::task::595::TaskManager.Task::(_updateState) Task=`b39230a4-9c08-4081-a3f0-a2fbb586a372`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:26:39,273::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:26:39,273::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:26:39,273::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:26:39,273::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:26:39,273::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:26:39,274::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:26:39,274::task::990::TaskManager.Task::(_decref) Task=`b39230a4-9c08-4081-a3f0-a2fbb586a372`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:26:41,204::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:26:41,283::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370428 s, 27.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:26:41,692::task::595::TaskManager.Task::(_updateState) Task=`75215fad-d4f2-4c61-bbb8-3faeaf105d82`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:26:41,692::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:26:41,692::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000629219', 'lastCheck': '8.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:26:41,692::task::1185::TaskManager.Task::(prepare) Task=`75215fad-d4f2-4c61-bbb8-3faeaf105d82`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000629219', 'lastCheck': '8.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:26:41,693::task::595::TaskManager.Task::(_updateState) Task=`75215fad-d4f2-4c61-bbb8-3faeaf105d82`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:26:41,693::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:26:41,693::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:26:41,693::task::990::TaskManager.Task::(_decref) Task=`75215fad-d4f2-4c61-bbb8-3faeaf105d82`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:26:43,296::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:26:43,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363106 s, 28.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:26:43,526::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:26:43,535::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000664416 s, 6.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:26:45,386::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:26:45,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036839 s, 27.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:26:47,478::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:26:47,556::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369352 s, 27.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:26:49,328::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:26:49,328::task::595::TaskManager.Task::(_updateState) Task=`9b4a0284-a4a6-4258-809c-8cd123a836ab`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:26:49,328::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:26:49,329::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:26:49,329::task::1185::TaskManager.Task::(prepare) Task=`9b4a0284-a4a6-4258-809c-8cd123a836ab`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:26:49,329::task::595::TaskManager.Task::(_updateState) Task=`9b4a0284-a4a6-4258-809c-8cd123a836ab`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:26:49,329::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:26:49,329::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:26:49,330::task::990::TaskManager.Task::(_decref) Task=`9b4a0284-a4a6-4258-809c-8cd123a836ab`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:26:49,365::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:26:49,365::task::595::TaskManager.Task::(_updateState) Task=`bb97a94b-1293-4b2d-ab07-a9848b87bb71`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:26:49,365::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:26:49,365::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`96109785-aaa0-46fe-b139-3e3fea8e02d9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:26:49,366::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:26:49,366::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:26:49,366::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`96109785-aaa0-46fe-b139-3e3fea8e02d9`::Granted request >Thread-34::DEBUG::2014-07-24 10:26:49,366::task::827::TaskManager.Task::(resourceAcquired) Task=`bb97a94b-1293-4b2d-ab07-a9848b87bb71`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:26:49,366::task::990::TaskManager.Task::(_decref) Task=`bb97a94b-1293-4b2d-ab07-a9848b87bb71`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:26:49,367::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:26:49,367::task::1185::TaskManager.Task::(prepare) Task=`bb97a94b-1293-4b2d-ab07-a9848b87bb71`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:26:49,368::task::595::TaskManager.Task::(_updateState) Task=`bb97a94b-1293-4b2d-ab07-a9848b87bb71`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:26:49,368::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:26:49,368::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:26:49,368::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:26:49,368::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:26:49,368::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:26:49,369::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:26:49,369::task::990::TaskManager.Task::(_decref) Task=`bb97a94b-1293-4b2d-ab07-a9848b87bb71`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:26:49,569::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:26:49,644::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362196 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:26:51,657::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:26:51,733::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366531 s, 27.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:26:53,540::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:26:53,549::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000698771 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:26:53,745::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:26:53,819::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346036 s, 29.6 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 10:26:54,947::task::595::TaskManager.Task::(_updateState) Task=`5f62d331-223f-4a33-a2c0-022e517577db`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 10:26:54,948::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 10:26:54,948::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-37::DEBUG::2014-07-24 10:26:54,948::task::1185::TaskManager.Task::(prepare) Task=`5f62d331-223f-4a33-a2c0-022e517577db`::finished: {'truesize': '1073741824', 'apparentsize': '1073741824'} >Thread-37::DEBUG::2014-07-24 10:26:54,948::task::595::TaskManager.Task::(_updateState) Task=`5f62d331-223f-4a33-a2c0-022e517577db`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 10:26:54,948::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 10:26:54,949::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 10:26:54,949::task::990::TaskManager.Task::(_decref) Task=`5f62d331-223f-4a33-a2c0-022e517577db`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-07-24 10:26:55,551::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:26:55,831::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:26:55,906::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351361 s, 29.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:26:57,067::task::595::TaskManager.Task::(_updateState) Task=`42015639-0091-4de0-9312-114ba31ab54d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:26:57,067::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:26:57,067::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000698771', 'lastCheck': '3.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:26:57,068::task::1185::TaskManager.Task::(prepare) Task=`42015639-0091-4de0-9312-114ba31ab54d`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000698771', 'lastCheck': '3.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:26:57,068::task::595::TaskManager.Task::(_updateState) Task=`42015639-0091-4de0-9312-114ba31ab54d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:26:57,068::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:26:57,068::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:26:57,068::task::990::TaskManager.Task::(_decref) Task=`42015639-0091-4de0-9312-114ba31ab54d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:26:57,918::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:26:57,993::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348962 s, 29.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:26:59,424::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:26:59,441::task::595::TaskManager.Task::(_updateState) Task=`7c9924bc-48db-4746-8d0b-45e230f81fdf`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:26:59,442::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:26:59,442::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:26:59,442::task::1185::TaskManager.Task::(prepare) Task=`7c9924bc-48db-4746-8d0b-45e230f81fdf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:26:59,442::task::595::TaskManager.Task::(_updateState) Task=`7c9924bc-48db-4746-8d0b-45e230f81fdf`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:26:59,442::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:26:59,443::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:26:59,443::task::990::TaskManager.Task::(_decref) Task=`7c9924bc-48db-4746-8d0b-45e230f81fdf`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:26:59,476::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:26:59,476::task::595::TaskManager.Task::(_updateState) Task=`a0e7abae-2b83-4f50-9abd-27f9a0ec2757`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:26:59,476::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:26:59,476::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`de8be874-f266-4bbf-8685-d3fdb8234a31`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:26:59,477::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:26:59,477::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:26:59,477::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`de8be874-f266-4bbf-8685-d3fdb8234a31`::Granted request >Thread-34::DEBUG::2014-07-24 10:26:59,477::task::827::TaskManager.Task::(resourceAcquired) Task=`a0e7abae-2b83-4f50-9abd-27f9a0ec2757`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:26:59,477::task::990::TaskManager.Task::(_decref) Task=`a0e7abae-2b83-4f50-9abd-27f9a0ec2757`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:26:59,478::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:26:59,478::task::1185::TaskManager.Task::(prepare) Task=`a0e7abae-2b83-4f50-9abd-27f9a0ec2757`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:26:59,478::task::595::TaskManager.Task::(_updateState) Task=`a0e7abae-2b83-4f50-9abd-27f9a0ec2757`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:26:59,479::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:26:59,479::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:26:59,479::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:26:59,479::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:26:59,479::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:26:59,480::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:26:59,480::task::990::TaskManager.Task::(_decref) Task=`a0e7abae-2b83-4f50-9abd-27f9a0ec2757`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:27:00,006::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:27:00,080::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348062 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:27:02,092::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:27:02,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036506 s, 28.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:27:03,554::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:27:03,563::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000687185 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:27:04,180::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:27:04,254::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354905 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:27:06,267::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:27:06,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.143804 s, 7.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:27:08,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:27:08,546::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367472 s, 27.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:27:09,537::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:27:09,538::task::595::TaskManager.Task::(_updateState) Task=`ea9430f2-69bb-406d-b10b-3d31944b9183`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:27:09,538::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:27:09,538::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:27:09,538::task::1185::TaskManager.Task::(prepare) Task=`ea9430f2-69bb-406d-b10b-3d31944b9183`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:27:09,539::task::595::TaskManager.Task::(_updateState) Task=`ea9430f2-69bb-406d-b10b-3d31944b9183`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:27:09,539::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:27:09,539::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:27:09,539::task::990::TaskManager.Task::(_decref) Task=`ea9430f2-69bb-406d-b10b-3d31944b9183`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:27:09,575::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:27:09,575::task::595::TaskManager.Task::(_updateState) Task=`25675fd4-f0cc-4dae-ad23-d51776c5d67e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:27:09,575::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:27:09,575::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b2f5cb16-2db3-4487-b9dc-dabc062f846f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:27:09,576::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:27:09,576::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:27:09,576::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b2f5cb16-2db3-4487-b9dc-dabc062f846f`::Granted request >Thread-34::DEBUG::2014-07-24 10:27:09,576::task::827::TaskManager.Task::(resourceAcquired) Task=`25675fd4-f0cc-4dae-ad23-d51776c5d67e`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:27:09,577::task::990::TaskManager.Task::(_decref) Task=`25675fd4-f0cc-4dae-ad23-d51776c5d67e`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:27:09,577::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:27:09,577::task::1185::TaskManager.Task::(prepare) Task=`25675fd4-f0cc-4dae-ad23-d51776c5d67e`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:27:09,578::task::595::TaskManager.Task::(_updateState) Task=`25675fd4-f0cc-4dae-ad23-d51776c5d67e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:27:09,578::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:27:09,578::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:27:09,578::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:27:09,578::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:27:09,578::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:27:09,579::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:27:09,579::task::990::TaskManager.Task::(_decref) Task=`25675fd4-f0cc-4dae-ad23-d51776c5d67e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:27:10,558::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:27:10,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349654 s, 29.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:27:12,512::task::595::TaskManager.Task::(_updateState) Task=`21650784-4c34-43e7-bb24-a8d4925da96a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:27:12,512::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:27:12,513::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000687185', 'lastCheck': '8.9', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:27:12,513::task::1185::TaskManager.Task::(prepare) Task=`21650784-4c34-43e7-bb24-a8d4925da96a`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000687185', 'lastCheck': '8.9', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:27:12,513::task::595::TaskManager.Task::(_updateState) Task=`21650784-4c34-43e7-bb24-a8d4925da96a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:27:12,513::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:27:12,513::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:27:12,513::task::990::TaskManager.Task::(_decref) Task=`21650784-4c34-43e7-bb24-a8d4925da96a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:27:12,645::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:27:13,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.331416 s, 3.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:27:13,568::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:27:13,578::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000535949 s, 7.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:27:15,030::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:27:15,115::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357688 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:27:17,128::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:27:17,214::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0459581 s, 22.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:27:19,227::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:27:19,304::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350393 s, 29.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:27:19,651::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [3b38bf98] >Thread-14::DEBUG::2014-07-24 10:27:19,652::task::595::TaskManager.Task::(_updateState) Task=`78fc5244-6c26-4958-b13c-b469c3fbb603`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:27:19,652::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:27:19,652::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:27:19,652::task::1185::TaskManager.Task::(prepare) Task=`78fc5244-6c26-4958-b13c-b469c3fbb603`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:27:19,653::task::595::TaskManager.Task::(_updateState) Task=`78fc5244-6c26-4958-b13c-b469c3fbb603`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:27:19,653::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:27:19,653::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:27:19,653::task::990::TaskManager.Task::(_decref) Task=`78fc5244-6c26-4958-b13c-b469c3fbb603`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:27:19,685::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [3b38bf98] >Thread-34::DEBUG::2014-07-24 10:27:19,685::task::595::TaskManager.Task::(_updateState) Task=`8e90300e-a86e-4db0-b0ff-dbdc3e3429e8`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:27:19,686::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:27:19,686::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`2522d34f-82e5-4378-99f0-8cd1a0b65b77`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:27:19,686::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:27:19,687::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:27:19,687::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`2522d34f-82e5-4378-99f0-8cd1a0b65b77`::Granted request >Thread-34::DEBUG::2014-07-24 10:27:19,687::task::827::TaskManager.Task::(resourceAcquired) Task=`8e90300e-a86e-4db0-b0ff-dbdc3e3429e8`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:27:19,687::task::990::TaskManager.Task::(_decref) Task=`8e90300e-a86e-4db0-b0ff-dbdc3e3429e8`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:27:19,688::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:27:19,688::task::1185::TaskManager.Task::(prepare) Task=`8e90300e-a86e-4db0-b0ff-dbdc3e3429e8`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:27:19,688::task::595::TaskManager.Task::(_updateState) Task=`8e90300e-a86e-4db0-b0ff-dbdc3e3429e8`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:27:19,688::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:27:19,689::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:27:19,689::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:27:19,689::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:27:19,689::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:27:19,689::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:27:19,690::task::990::TaskManager.Task::(_decref) Task=`8e90300e-a86e-4db0-b0ff-dbdc3e3429e8`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:27:21,317::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:27:21,393::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035969 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:27:23,406::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:27:23,486::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0376348 s, 27.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:27:23,583::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:27:23,594::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000687847 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:27:25,499::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:27:25,577::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354973 s, 28.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:27:25,595::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:27:27,590::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:27:27,667::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035761 s, 28.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:27:27,930::task::595::TaskManager.Task::(_updateState) Task=`56488bbc-fde2-43ab-9cb2-b9137a1309f3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:27:27,930::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:27:27,930::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000687847', 'lastCheck': '4.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:27:27,931::task::1185::TaskManager.Task::(prepare) Task=`56488bbc-fde2-43ab-9cb2-b9137a1309f3`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000687847', 'lastCheck': '4.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:27:27,931::task::595::TaskManager.Task::(_updateState) Task=`56488bbc-fde2-43ab-9cb2-b9137a1309f3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:27:27,931::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:27:27,931::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:27:27,931::task::990::TaskManager.Task::(_decref) Task=`56488bbc-fde2-43ab-9cb2-b9137a1309f3`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:27:29,679::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-24 10:27:29,749::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:27:29,750::task::595::TaskManager.Task::(_updateState) Task=`5a072423-980e-4c62-880f-79209d569082`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:27:29,751::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:27:29,752::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:27:29,753::task::1185::TaskManager.Task::(prepare) Task=`5a072423-980e-4c62-880f-79209d569082`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:27:29,754::task::595::TaskManager.Task::(_updateState) Task=`5a072423-980e-4c62-880f-79209d569082`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:27:29,754::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:27:29,755::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:27:29,756::task::990::TaskManager.Task::(_decref) Task=`5a072423-980e-4c62-880f-79209d569082`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:27:29,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366112 s, 28.0 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-24 10:27:29,795::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:27:29,795::task::595::TaskManager.Task::(_updateState) Task=`c04f0bab-3df3-4ba2-82d2-8cb1e43813f2`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:27:29,795::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:27:29,796::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`12501678-4843-4180-b01b-59c618545dbb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:27:29,796::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:27:29,796::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:27:29,796::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`12501678-4843-4180-b01b-59c618545dbb`::Granted request >Thread-34::DEBUG::2014-07-24 10:27:29,797::task::827::TaskManager.Task::(resourceAcquired) Task=`c04f0bab-3df3-4ba2-82d2-8cb1e43813f2`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:27:29,797::task::990::TaskManager.Task::(_decref) Task=`c04f0bab-3df3-4ba2-82d2-8cb1e43813f2`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:27:29,798::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:27:29,798::task::1185::TaskManager.Task::(prepare) Task=`c04f0bab-3df3-4ba2-82d2-8cb1e43813f2`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:27:29,798::task::595::TaskManager.Task::(_updateState) Task=`c04f0bab-3df3-4ba2-82d2-8cb1e43813f2`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:27:29,798::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:27:29,798::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:27:29,799::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:27:29,799::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:27:29,799::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:27:29,799::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:27:29,799::task::990::TaskManager.Task::(_decref) Task=`c04f0bab-3df3-4ba2-82d2-8cb1e43813f2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:27:31,780::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:27:31,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0426886 s, 24.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:27:33,599::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:27:33,610::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00088395 s, 4.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:27:33,880::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:27:33,967::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451521 s, 22.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:27:35,980::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:27:36,081::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0583937 s, 17.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:27:38,095::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:27:38,173::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363946 s, 28.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:27:39,881::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:27:39,881::task::595::TaskManager.Task::(_updateState) Task=`bd11b500-ca6f-4069-bb97-f9dbab36f995`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:27:39,882::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:27:39,882::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:27:39,882::task::1185::TaskManager.Task::(prepare) Task=`bd11b500-ca6f-4069-bb97-f9dbab36f995`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:27:39,882::task::595::TaskManager.Task::(_updateState) Task=`bd11b500-ca6f-4069-bb97-f9dbab36f995`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:27:39,882::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:27:39,883::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:27:39,883::task::990::TaskManager.Task::(_decref) Task=`bd11b500-ca6f-4069-bb97-f9dbab36f995`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:27:39,922::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:27:39,923::task::595::TaskManager.Task::(_updateState) Task=`538c69aa-88a9-43f9-a488-3eb43cb0fd0c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:27:39,923::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:27:39,923::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`063f1d6a-79b5-4651-89c0-dc9084f6514b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:27:39,923::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:27:39,924::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:27:39,924::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`063f1d6a-79b5-4651-89c0-dc9084f6514b`::Granted request >Thread-34::DEBUG::2014-07-24 10:27:39,924::task::827::TaskManager.Task::(resourceAcquired) Task=`538c69aa-88a9-43f9-a488-3eb43cb0fd0c`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:27:39,924::task::990::TaskManager.Task::(_decref) Task=`538c69aa-88a9-43f9-a488-3eb43cb0fd0c`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:27:39,925::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:27:39,925::task::1185::TaskManager.Task::(prepare) Task=`538c69aa-88a9-43f9-a488-3eb43cb0fd0c`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '37312528384', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:27:39,925::task::595::TaskManager.Task::(_updateState) Task=`538c69aa-88a9-43f9-a488-3eb43cb0fd0c`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:27:39,926::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:27:39,926::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:27:39,926::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:27:39,926::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:27:39,926::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:27:39,926::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:27:39,927::task::990::TaskManager.Task::(_decref) Task=`538c69aa-88a9-43f9-a488-3eb43cb0fd0c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:27:40,186::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:27:40,260::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344087 s, 29.8 MB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 10:27:41,105::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 1073741824, capacity: 10737418240, allocated: 541785600, physical: 1073741824) >Thread-37::DEBUG::2014-07-24 10:27:41,105::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 2048, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 10:27:41,106::task::595::TaskManager.Task::(_updateState) Task=`c9ad0f92-182c-4442-8258-de1bc7531bbf`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 10:27:41,106::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 2048, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=2147483648, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 10:27:41,106::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 10:27:41,106::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 10:27:41,107::task::1185::TaskManager.Task::(prepare) Task=`c9ad0f92-182c-4442-8258-de1bc7531bbf`::finished: None >Thread-27::DEBUG::2014-07-24 10:27:41,107::storage_mailbox::426::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - start: 64, end: 128, len: 4096, message(1/63): '1xtnd\x8fE\x83\x19\xaa\x18\xaa\xa4\x82H\xc3\xed\x06\x06\xaa#\xe2\x9b\xed\xae\xc5bR\xb3\x85K\x9f\xe2\xee\xa0\x8c\xe1000000000000080000000000000' >Thread-37::DEBUG::2014-07-24 10:27:41,108::task::595::TaskManager.Task::(_updateState) Task=`c9ad0f92-182c-4442-8258-de1bc7531bbf`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 10:27:41,110::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-27::DEBUG::2014-07-24 10:27:41,110::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-37::DEBUG::2014-07-24 10:27:41,119::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 10:27:41,121::task::990::TaskManager.Task::(_decref) Task=`c9ad0f92-182c-4442-8258-de1bc7531bbf`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 10:27:41,183::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0632228 s, 64.8 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 10:27:41,183::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 10:27:41,183::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 10:27:42,192::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00141 s, 4.1 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:27:42,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:27:42,372::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0413197 s, 24.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:27:42,375::storage_mailbox::658::Storage.MailBox.SpmMailMonitor::(_handleRequests) SPM_MailMonitor: Mailbox 1 validated, checking mail >Dummy-33::DEBUG::2014-07-24 10:27:42,376::storage_mailbox::698::Storage.MailBox.SpmMailMonitor::(_handleRequests) SPM_MailMonitor: processing request: '1xtnd\x8fE\x83\x19\xaa\x18\xaa\xa4\x82H\xc3\xed\x06\x06\xaa#\xe2\x9b\xed\xae\xc5bR\xb3\x85K\x9f\xe2\xee\xa0\x8c\xe1000000000000080000000000000' >Thread-28::DEBUG::2014-07-24 10:27:42,377::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >93b9518c-87fe-42be-94c7-ea2ea0352505::DEBUG::2014-07-24 10:27:42,380::threadPool::200::Misc.ThreadPool.WorkerThread::(_processNextTask) Task: 93b9518c-87fe-42be-94c7-ea2ea0352505 running: <function runTask at 0x149a500> with: (<functools.partial object at 0x15de890>, 65, '1xtnd\x8fE\x83\x19\xaa\x18\xaa\xa4\x82H\xc3\xed\x06\x06\xaa#\xe2\x9b\xed\xae\xc5bR\xb3\x85K\x9f\xe2\xee\xa0\x8c\xe1000000000000080000000000000') >93b9518c-87fe-42be-94c7-ea2ea0352505::DEBUG::2014-07-24 10:27:42,385::task::595::TaskManager.Task::(_updateState) Task=`71dc76d6-4468-4499-a39e-130fdb97c954`::moving from state init -> state preparing >93b9518c-87fe-42be-94c7-ea2ea0352505::DEBUG::2014-07-24 10:27:42,388::storage_mailbox::146::Storage.SPM.Messages.Extend::(processRequest) processRequest, payload:'1xtnd\x8fE\x83\x19\xaa\x18\xaa\xa4\x82H\xc3\xed\x06\x06\xaa#\xe2\x9b\xed\xae\xc5bR\xb3\x85K\x9f\xe2\xee\xa0\x8c\xe1000000000000080000000000000' >93b9518c-87fe-42be-94c7-ea2ea0352505::INFO::2014-07-24 10:27:42,390::storage_mailbox::161::Storage.SPM.Messages.Extend::(processRequest) processRequest: extending volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 in domain 23aa0606-edc3-4882-a4aa-18aa1983458f (pool 637ea13c-81a8-4b44-8cab-961458b01883) to size 2048 >93b9518c-87fe-42be-94c7-ea2ea0352505::DEBUG::2014-07-24 10:27:42,401::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvextend --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --size 2048m 23aa0606-edc3-4882-a4aa-18aa1983458f/e18ca0ee-e29f-4b85-b352-62c5aeed9be2' (cwd None) >93b9518c-87fe-42be-94c7-ea2ea0352505::DEBUG::2014-07-24 10:27:43,088::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >93b9518c-87fe-42be-94c7-ea2ea0352505::DEBUG::2014-07-24 10:27:43,089::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >93b9518c-87fe-42be-94c7-ea2ea0352505::DEBUG::2014-07-24 10:27:43,089::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >93b9518c-87fe-42be-94c7-ea2ea0352505::DEBUG::2014-07-24 10:27:43,089::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >93b9518c-87fe-42be-94c7-ea2ea0352505::DEBUG::2014-07-24 10:27:43,089::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >93b9518c-87fe-42be-94c7-ea2ea0352505::DEBUG::2014-07-24 10:27:43,090::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >93b9518c-87fe-42be-94c7-ea2ea0352505::DEBUG::2014-07-24 10:27:43,091::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) 'dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox oflag=direct iflag=fullblock conv=notrunc count=1 bs=4096 seek=1' (cwd None) >93b9518c-87fe-42be-94c7-ea2ea0352505::DEBUG::2014-07-24 10:27:43,102::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000899713 s, 4.6 MB/s\n'; <rc> = 0 >93b9518c-87fe-42be-94c7-ea2ea0352505::DEBUG::2014-07-24 10:27:43,102::task::1185::TaskManager.Task::(prepare) Task=`71dc76d6-4468-4499-a39e-130fdb97c954`::finished: {'status': {'message': 'Done', 'code': 0}} >93b9518c-87fe-42be-94c7-ea2ea0352505::DEBUG::2014-07-24 10:27:43,102::task::595::TaskManager.Task::(_updateState) Task=`71dc76d6-4468-4499-a39e-130fdb97c954`::moving from state preparing -> state finished >93b9518c-87fe-42be-94c7-ea2ea0352505::DEBUG::2014-07-24 10:27:43,103::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >93b9518c-87fe-42be-94c7-ea2ea0352505::DEBUG::2014-07-24 10:27:43,103::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >93b9518c-87fe-42be-94c7-ea2ea0352505::DEBUG::2014-07-24 10:27:43,103::task::990::TaskManager.Task::(_decref) Task=`71dc76d6-4468-4499-a39e-130fdb97c954`::ref 0 aborting False >93b9518c-87fe-42be-94c7-ea2ea0352505::DEBUG::2014-07-24 10:27:43,103::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-14::DEBUG::2014-07-24 10:27:43,309::task::595::TaskManager.Task::(_updateState) Task=`788b23b8-8566-43dd-b5c7-9f4aaceb1f25`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:27:43,324::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:27:43,325::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00088395', 'lastCheck': '9.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:27:43,325::task::1185::TaskManager.Task::(prepare) Task=`788b23b8-8566-43dd-b5c7-9f4aaceb1f25`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00088395', 'lastCheck': '9.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:27:43,325::task::595::TaskManager.Task::(_updateState) Task=`788b23b8-8566-43dd-b5c7-9f4aaceb1f25`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:27:43,325::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:27:43,325::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:27:43,325::task::990::TaskManager.Task::(_decref) Task=`788b23b8-8566-43dd-b5c7-9f4aaceb1f25`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 10:27:43,615::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 10:27:43,615::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-18::DEBUG::2014-07-24 10:27:43,823::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:27:43,824::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 10:27:43,825::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:27:43,834::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00109293 s, 3.7 MB/s\n'; <rc> = 0 >Thread-27::DEBUG::2014-07-24 10:27:44,195::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 10:27:44,360::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.156115 s, 26.2 kB/s\n'; <rc> = 0 >Thread-27::DEBUG::2014-07-24 10:27:44,360::storage_mailbox::342::Storage.MailBox.HsmMailMonitor::(_handleResponses) HSM_MailboxMonitor(1/63) - Checking reply: '1xtnd\x8fE\x83\x19\xaa\x18\xaa\xa4\x82H\xc3\xed\x06\x06\xaa#\xe2\x9b\xed\xae\xc5bR\xb3\x85K\x9f\xe2\xee\xa0\x8c\xe1000000000000080000000000000' >Thread-27::INFO::2014-07-24 10:27:44,361::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-24::DEBUG::2014-07-24 10:27:44,361::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >36bfa0fc-2ebd-48b2-8d44-b0f9dd0331d5::DEBUG::2014-07-24 10:27:44,363::threadPool::200::Misc.ThreadPool.WorkerThread::(_processNextTask) Task: 36bfa0fc-2ebd-48b2-8d44-b0f9dd0331d5 running: <function runTask at 0x149a500> with: (<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>, {'newSize': 2048, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}) >Thread-27::DEBUG::2014-07-24 10:27:44,364::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >36bfa0fc-2ebd-48b2-8d44-b0f9dd0331d5::DEBUG::2014-07-24 10:27:44,375::task::595::TaskManager.Task::(_updateState) Task=`d4c26d6d-5691-4b12-9f13-a21d550daac8`::moving from state init -> state preparing >36bfa0fc-2ebd-48b2-8d44-b0f9dd0331d5::DEBUG::2014-07-24 10:27:44,377::vm::2543::vm.Vm::(__verifyVolumeExtension) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Refreshing drive volume for sda (domainID: 23aa0606-edc3-4882-a4aa-18aa1983458f, volumeID: e18ca0ee-e29f-4b85-b352-62c5aeed9be2) >36bfa0fc-2ebd-48b2-8d44-b0f9dd0331d5::DEBUG::2014-07-24 10:27:44,379::task::595::TaskManager.Task::(_updateState) Task=`1ddfafa5-1cf7-4ade-8032-764efdb54a6f`::moving from state init -> state preparing >36bfa0fc-2ebd-48b2-8d44-b0f9dd0331d5::INFO::2014-07-24 10:27:44,379::logUtils::44::dispatcher::(wrapper) Run and protect: refreshVolume(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2') >36bfa0fc-2ebd-48b2-8d44-b0f9dd0331d5::DEBUG::2014-07-24 10:27:44,379::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >36bfa0fc-2ebd-48b2-8d44-b0f9dd0331d5::DEBUG::2014-07-24 10:27:44,380::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >36bfa0fc-2ebd-48b2-8d44-b0f9dd0331d5::DEBUG::2014-07-24 10:27:44,533::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >36bfa0fc-2ebd-48b2-8d44-b0f9dd0331d5::DEBUG::2014-07-24 10:27:44,539::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >36bfa0fc-2ebd-48b2-8d44-b0f9dd0331d5::DEBUG::2014-07-24 10:27:44,539::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >36bfa0fc-2ebd-48b2-8d44-b0f9dd0331d5::DEBUG::2014-07-24 10:27:44,540::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --refresh 23aa0606-edc3-4882-a4aa-18aa1983458f/e18ca0ee-e29f-4b85-b352-62c5aeed9be2' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:27:44,576::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:27:44,656::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0375099 s, 27.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:27:44,656::storage_mailbox::658::Storage.MailBox.SpmMailMonitor::(_handleRequests) SPM_MailMonitor: Mailbox 1 validated, checking mail >Dummy-33::DEBUG::2014-07-24 10:27:44,668::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) 'dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox oflag=direct iflag=fullblock conv=notrunc count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:27:44,712::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035648 s, 28.7 MB/s\n'; <rc> = 0 >36bfa0fc-2ebd-48b2-8d44-b0f9dd0331d5::DEBUG::2014-07-24 10:27:44,723::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >36bfa0fc-2ebd-48b2-8d44-b0f9dd0331d5::DEBUG::2014-07-24 10:27:44,723::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >36bfa0fc-2ebd-48b2-8d44-b0f9dd0331d5::DEBUG::2014-07-24 10:27:44,724::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >36bfa0fc-2ebd-48b2-8d44-b0f9dd0331d5::INFO::2014-07-24 10:27:44,724::logUtils::47::dispatcher::(wrapper) Run and protect: refreshVolume, Return response: None >36bfa0fc-2ebd-48b2-8d44-b0f9dd0331d5::DEBUG::2014-07-24 10:27:44,724::task::1185::TaskManager.Task::(prepare) Task=`1ddfafa5-1cf7-4ade-8032-764efdb54a6f`::finished: None >36bfa0fc-2ebd-48b2-8d44-b0f9dd0331d5::DEBUG::2014-07-24 10:27:44,724::task::595::TaskManager.Task::(_updateState) Task=`1ddfafa5-1cf7-4ade-8032-764efdb54a6f`::moving from state preparing -> state finished >36bfa0fc-2ebd-48b2-8d44-b0f9dd0331d5::DEBUG::2014-07-24 10:27:44,725::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >36bfa0fc-2ebd-48b2-8d44-b0f9dd0331d5::DEBUG::2014-07-24 10:27:44,725::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >36bfa0fc-2ebd-48b2-8d44-b0f9dd0331d5::DEBUG::2014-07-24 10:27:44,725::task::990::TaskManager.Task::(_decref) Task=`1ddfafa5-1cf7-4ade-8032-764efdb54a6f`::ref 0 aborting False >36bfa0fc-2ebd-48b2-8d44-b0f9dd0331d5::DEBUG::2014-07-24 10:27:44,725::task::595::TaskManager.Task::(_updateState) Task=`5ec60d9a-14a9-46ed-b621-1d734e4e42bf`::moving from state init -> state preparing >36bfa0fc-2ebd-48b2-8d44-b0f9dd0331d5::INFO::2014-07-24 10:27:44,726::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >36bfa0fc-2ebd-48b2-8d44-b0f9dd0331d5::INFO::2014-07-24 10:27:44,726::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >36bfa0fc-2ebd-48b2-8d44-b0f9dd0331d5::DEBUG::2014-07-24 10:27:44,726::task::1185::TaskManager.Task::(prepare) Task=`5ec60d9a-14a9-46ed-b621-1d734e4e42bf`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >36bfa0fc-2ebd-48b2-8d44-b0f9dd0331d5::DEBUG::2014-07-24 10:27:44,726::task::595::TaskManager.Task::(_updateState) Task=`5ec60d9a-14a9-46ed-b621-1d734e4e42bf`::moving from state preparing -> state finished >36bfa0fc-2ebd-48b2-8d44-b0f9dd0331d5::DEBUG::2014-07-24 10:27:44,726::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >36bfa0fc-2ebd-48b2-8d44-b0f9dd0331d5::DEBUG::2014-07-24 10:27:44,727::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >36bfa0fc-2ebd-48b2-8d44-b0f9dd0331d5::DEBUG::2014-07-24 10:27:44,727::task::990::TaskManager.Task::(_decref) Task=`5ec60d9a-14a9-46ed-b621-1d734e4e42bf`::ref 0 aborting False >36bfa0fc-2ebd-48b2-8d44-b0f9dd0331d5::DEBUG::2014-07-24 10:27:44,727::vm::2563::vm.Vm::(__verifyVolumeExtension) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Verifying extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2, requested size 2147483648, current size 2147483648 >36bfa0fc-2ebd-48b2-8d44-b0f9dd0331d5::DEBUG::2014-07-24 10:27:44,758::task::1185::TaskManager.Task::(prepare) Task=`d4c26d6d-5691-4b12-9f13-a21d550daac8`::finished: None >36bfa0fc-2ebd-48b2-8d44-b0f9dd0331d5::DEBUG::2014-07-24 10:27:44,758::task::595::TaskManager.Task::(_updateState) Task=`d4c26d6d-5691-4b12-9f13-a21d550daac8`::moving from state preparing -> state finished >36bfa0fc-2ebd-48b2-8d44-b0f9dd0331d5::DEBUG::2014-07-24 10:27:44,758::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >36bfa0fc-2ebd-48b2-8d44-b0f9dd0331d5::DEBUG::2014-07-24 10:27:44,759::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >36bfa0fc-2ebd-48b2-8d44-b0f9dd0331d5::DEBUG::2014-07-24 10:27:44,759::task::990::TaskManager.Task::(_decref) Task=`d4c26d6d-5691-4b12-9f13-a21d550daac8`::ref 0 aborting False >36bfa0fc-2ebd-48b2-8d44-b0f9dd0331d5::DEBUG::2014-07-24 10:27:44,759::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-27::DEBUG::2014-07-24 10:27:45,380::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00719 s, 4.1 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:27:46,714::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:27:46,793::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357929 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:27:46,793::storage_mailbox::658::Storage.MailBox.SpmMailMonitor::(_handleRequests) SPM_MailMonitor: Mailbox 1 validated, checking mail >Dummy-33::DEBUG::2014-07-24 10:27:46,804::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) 'dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox oflag=direct iflag=fullblock conv=notrunc count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:27:46,852::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0391908 s, 26.1 MB/s\n'; <rc> = 0 >Thread-27::DEBUG::2014-07-24 10:27:47,383::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 10:27:47,524::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.132018 s, 31.0 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 10:27:47,525::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 10:27:47,525::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 10:27:48,534::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00146 s, 4.1 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:27:48,855::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:27:48,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358828 s, 28.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:27:49,984::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:27:50,002::task::595::TaskManager.Task::(_updateState) Task=`9bda657f-de61-4e2e-892e-c61c23c40a9f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:27:50,003::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:27:50,003::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:27:50,003::task::1185::TaskManager.Task::(prepare) Task=`9bda657f-de61-4e2e-892e-c61c23c40a9f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:27:50,003::task::595::TaskManager.Task::(_updateState) Task=`9bda657f-de61-4e2e-892e-c61c23c40a9f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:27:50,003::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:27:50,003::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:27:50,004::task::990::TaskManager.Task::(_decref) Task=`9bda657f-de61-4e2e-892e-c61c23c40a9f`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:27:50,035::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:27:50,035::task::595::TaskManager.Task::(_updateState) Task=`2753abe3-2755-48cd-835e-f0e0e9446e96`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:27:50,035::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:27:50,036::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`8e4dfc9e-a6da-41e1-bf9c-0610fc25ac93`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:27:50,036::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:27:50,036::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:27:50,036::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`8e4dfc9e-a6da-41e1-bf9c-0610fc25ac93`::Granted request >Thread-34::DEBUG::2014-07-24 10:27:50,037::task::827::TaskManager.Task::(resourceAcquired) Task=`2753abe3-2755-48cd-835e-f0e0e9446e96`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:27:50,037::task::990::TaskManager.Task::(_decref) Task=`2753abe3-2755-48cd-835e-f0e0e9446e96`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:27:50,038::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '36238786560', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:27:50,038::task::1185::TaskManager.Task::(prepare) Task=`2753abe3-2755-48cd-835e-f0e0e9446e96`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '36238786560', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:27:50,038::task::595::TaskManager.Task::(_updateState) Task=`2753abe3-2755-48cd-835e-f0e0e9446e96`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:27:50,038::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:27:50,038::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:27:50,038::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:27:50,039::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:27:50,039::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:27:50,039::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:27:50,039::task::990::TaskManager.Task::(_decref) Task=`2753abe3-2755-48cd-835e-f0e0e9446e96`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:27:50,960::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:27:51,038::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366524 s, 27.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:27:53,056::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:27:53,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346065 s, 29.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:27:53,845::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:27:53,855::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000622495 s, 6.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:27:55,142::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-37::DEBUG::2014-07-24 10:27:55,155::task::595::TaskManager.Task::(_updateState) Task=`a5d25232-0ec0-4852-b990-58fb4a6f2f5d`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 10:27:55,156::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 10:27:55,156::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-37::DEBUG::2014-07-24 10:27:55,156::task::1185::TaskManager.Task::(prepare) Task=`a5d25232-0ec0-4852-b990-58fb4a6f2f5d`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-37::DEBUG::2014-07-24 10:27:55,157::task::595::TaskManager.Task::(_updateState) Task=`a5d25232-0ec0-4852-b990-58fb4a6f2f5d`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 10:27:55,157::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 10:27:55,157::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 10:27:55,157::task::990::TaskManager.Task::(_decref) Task=`a5d25232-0ec0-4852-b990-58fb4a6f2f5d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:27:55,222::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0382195 s, 26.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:27:55,639::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:27:57,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:27:57,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355403 s, 28.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:27:58,755::task::595::TaskManager.Task::(_updateState) Task=`f89271d7-c14a-4293-b52c-7e698cb3245d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:27:58,755::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:27:58,756::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622495', 'lastCheck': '4.9', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:27:58,756::task::1185::TaskManager.Task::(prepare) Task=`f89271d7-c14a-4293-b52c-7e698cb3245d`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000622495', 'lastCheck': '4.9', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:27:58,756::task::595::TaskManager.Task::(_updateState) Task=`f89271d7-c14a-4293-b52c-7e698cb3245d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:27:58,756::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:27:58,756::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:27:58,756::task::990::TaskManager.Task::(_decref) Task=`f89271d7-c14a-4293-b52c-7e698cb3245d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:27:59,324::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:27:59,403::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370453 s, 27.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:28:00,101::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:28:00,101::task::595::TaskManager.Task::(_updateState) Task=`b074f483-15b1-460f-b203-a54114e06c9c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:28:00,102::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:28:00,102::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:28:00,102::task::1185::TaskManager.Task::(prepare) Task=`b074f483-15b1-460f-b203-a54114e06c9c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:28:00,102::task::595::TaskManager.Task::(_updateState) Task=`b074f483-15b1-460f-b203-a54114e06c9c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:28:00,103::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:28:00,103::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:28:00,103::task::990::TaskManager.Task::(_decref) Task=`b074f483-15b1-460f-b203-a54114e06c9c`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:28:00,146::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:28:00,164::task::595::TaskManager.Task::(_updateState) Task=`ca80e5e0-a221-413c-a3cf-df72402333be`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:28:00,164::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:28:00,164::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`8d7bbce1-d579-4e8c-9818-2d22a698ac70`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:28:00,164::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:28:00,165::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:28:00,165::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`8d7bbce1-d579-4e8c-9818-2d22a698ac70`::Granted request >Thread-34::DEBUG::2014-07-24 10:28:00,166::task::827::TaskManager.Task::(resourceAcquired) Task=`ca80e5e0-a221-413c-a3cf-df72402333be`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:28:00,166::task::990::TaskManager.Task::(_decref) Task=`ca80e5e0-a221-413c-a3cf-df72402333be`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:28:00,167::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '36238786560', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:28:00,167::task::1185::TaskManager.Task::(prepare) Task=`ca80e5e0-a221-413c-a3cf-df72402333be`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '36238786560', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:28:00,167::task::595::TaskManager.Task::(_updateState) Task=`ca80e5e0-a221-413c-a3cf-df72402333be`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:28:00,167::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:28:00,167::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:28:00,168::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:28:00,168::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:28:00,168::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:28:00,168::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:28:00,168::task::990::TaskManager.Task::(_decref) Task=`ca80e5e0-a221-413c-a3cf-df72402333be`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:28:01,416::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:28:01,501::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0429717 s, 23.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:28:03,514::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:28:03,642::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0861914 s, 11.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:28:03,860::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:28:03,870::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000788824 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:28:05,656::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:28:05,734::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0376976 s, 27.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:28:07,747::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:28:07,825::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361234 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:28:09,838::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:28:09,916::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356365 s, 28.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:28:10,227::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:28:10,228::task::595::TaskManager.Task::(_updateState) Task=`f8e1adb2-50a1-4f19-9594-e4452e9b4f6a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:28:10,228::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:28:10,229::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:28:10,229::task::1185::TaskManager.Task::(prepare) Task=`f8e1adb2-50a1-4f19-9594-e4452e9b4f6a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:28:10,229::task::595::TaskManager.Task::(_updateState) Task=`f8e1adb2-50a1-4f19-9594-e4452e9b4f6a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:28:10,229::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:28:10,230::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:28:10,230::task::990::TaskManager.Task::(_decref) Task=`f8e1adb2-50a1-4f19-9594-e4452e9b4f6a`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:28:10,277::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:28:10,278::task::595::TaskManager.Task::(_updateState) Task=`b02c3dc9-7e84-44c8-b572-67f806b0bf89`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:28:10,278::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:28:10,278::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`2795b5c3-dc9c-427c-a9e4-af85d6541e2c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:28:10,278::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:28:10,279::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:28:10,279::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`2795b5c3-dc9c-427c-a9e4-af85d6541e2c`::Granted request >Thread-34::DEBUG::2014-07-24 10:28:10,280::task::827::TaskManager.Task::(resourceAcquired) Task=`b02c3dc9-7e84-44c8-b572-67f806b0bf89`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:28:10,281::task::990::TaskManager.Task::(_decref) Task=`b02c3dc9-7e84-44c8-b572-67f806b0bf89`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:28:10,281::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '36238786560', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:28:10,282::task::1185::TaskManager.Task::(prepare) Task=`b02c3dc9-7e84-44c8-b572-67f806b0bf89`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '36238786560', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:28:10,282::task::595::TaskManager.Task::(_updateState) Task=`b02c3dc9-7e84-44c8-b572-67f806b0bf89`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:28:10,282::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:28:10,282::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:28:10,282::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:28:10,283::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:28:10,283::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:28:10,283::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:28:10,283::task::990::TaskManager.Task::(_decref) Task=`b02c3dc9-7e84-44c8-b572-67f806b0bf89`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:28:11,929::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:28:12,003::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348694 s, 29.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:28:13,875::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:28:13,889::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00487689 s, 840 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:28:14,015::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-24 10:28:14,140::task::595::TaskManager.Task::(_updateState) Task=`c4546f79-8564-4b40-8866-59920e1f5425`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:28:14,140::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:28:14,140::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00487689', 'lastCheck': '0.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:28:14,141::task::1185::TaskManager.Task::(prepare) Task=`c4546f79-8564-4b40-8866-59920e1f5425`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00487689', 'lastCheck': '0.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:28:14,141::task::595::TaskManager.Task::(_updateState) Task=`c4546f79-8564-4b40-8866-59920e1f5425`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:28:14,141::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:28:14,141::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:28:14,141::task::990::TaskManager.Task::(_decref) Task=`c4546f79-8564-4b40-8866-59920e1f5425`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:28:14,411::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.355648 s, 2.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:28:16,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:28:16,499::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364541 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:28:18,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:28:18,588::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356742 s, 28.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:28:20,338::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:28:20,354::task::595::TaskManager.Task::(_updateState) Task=`b326aa3b-3677-4c3a-aff6-2489da64cd32`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:28:20,354::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:28:20,354::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:28:20,355::task::1185::TaskManager.Task::(prepare) Task=`b326aa3b-3677-4c3a-aff6-2489da64cd32`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:28:20,355::task::595::TaskManager.Task::(_updateState) Task=`b326aa3b-3677-4c3a-aff6-2489da64cd32`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:28:20,355::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:28:20,355::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:28:20,355::task::990::TaskManager.Task::(_decref) Task=`b326aa3b-3677-4c3a-aff6-2489da64cd32`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:28:20,390::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:28:20,390::task::595::TaskManager.Task::(_updateState) Task=`e7948cda-3a3a-4704-8574-48e06c66590e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:28:20,390::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:28:20,391::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`5e34ba8c-c608-47d3-adcd-9a53ab6d8a05`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:28:20,391::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:28:20,391::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:28:20,391::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`5e34ba8c-c608-47d3-adcd-9a53ab6d8a05`::Granted request >Thread-34::DEBUG::2014-07-24 10:28:20,391::task::827::TaskManager.Task::(resourceAcquired) Task=`e7948cda-3a3a-4704-8574-48e06c66590e`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:28:20,392::task::990::TaskManager.Task::(_decref) Task=`e7948cda-3a3a-4704-8574-48e06c66590e`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:28:20,392::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '36238786560', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:28:20,392::task::1185::TaskManager.Task::(prepare) Task=`e7948cda-3a3a-4704-8574-48e06c66590e`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '36238786560', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:28:20,393::task::595::TaskManager.Task::(_updateState) Task=`e7948cda-3a3a-4704-8574-48e06c66590e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:28:20,393::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:28:20,393::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:28:20,393::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:28:20,393::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:28:20,394::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:28:20,394::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:28:20,394::task::990::TaskManager.Task::(_decref) Task=`e7948cda-3a3a-4704-8574-48e06c66590e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:28:20,602::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:28:20,679::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363141 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:28:22,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:28:22,819::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0530689 s, 19.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:28:23,894::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:28:23,903::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000445775 s, 9.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:28:24,832::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:28:24,907::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344465 s, 29.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:28:25,676::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:28:26,920::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:28:26,996::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345001 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:28:29,009::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:28:29,109::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372641 s, 27.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:28:29,550::task::595::TaskManager.Task::(_updateState) Task=`f2fc8b80-00d7-4e39-94cd-20ca04c5b47f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:28:29,550::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:28:29,550::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000445775', 'lastCheck': '5.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:28:29,550::task::1185::TaskManager.Task::(prepare) Task=`f2fc8b80-00d7-4e39-94cd-20ca04c5b47f`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000445775', 'lastCheck': '5.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:28:29,551::task::595::TaskManager.Task::(_updateState) Task=`f2fc8b80-00d7-4e39-94cd-20ca04c5b47f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:28:29,551::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:28:29,551::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:28:29,551::task::990::TaskManager.Task::(_decref) Task=`f2fc8b80-00d7-4e39-94cd-20ca04c5b47f`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:28:30,467::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:28:30,468::task::595::TaskManager.Task::(_updateState) Task=`56a496c5-f011-4a89-81b6-2360486b209e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:28:30,468::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:28:30,468::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:28:30,469::task::1185::TaskManager.Task::(prepare) Task=`56a496c5-f011-4a89-81b6-2360486b209e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:28:30,469::task::595::TaskManager.Task::(_updateState) Task=`56a496c5-f011-4a89-81b6-2360486b209e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:28:30,469::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:28:30,469::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:28:30,469::task::990::TaskManager.Task::(_decref) Task=`56a496c5-f011-4a89-81b6-2360486b209e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:28:30,506::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:28:30,507::task::595::TaskManager.Task::(_updateState) Task=`870937b8-fd89-4dcc-b878-65b3904341e7`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:28:30,507::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:28:30,507::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`3ff7a42b-4a38-4e67-8ca4-2fb48d1aca66`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:28:30,508::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:28:30,508::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:28:30,508::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`3ff7a42b-4a38-4e67-8ca4-2fb48d1aca66`::Granted request >Thread-34::DEBUG::2014-07-24 10:28:30,508::task::827::TaskManager.Task::(resourceAcquired) Task=`870937b8-fd89-4dcc-b878-65b3904341e7`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:28:30,509::task::990::TaskManager.Task::(_decref) Task=`870937b8-fd89-4dcc-b878-65b3904341e7`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:28:30,509::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '36238786560', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:28:30,509::task::1185::TaskManager.Task::(prepare) Task=`870937b8-fd89-4dcc-b878-65b3904341e7`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '36238786560', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:28:30,510::task::595::TaskManager.Task::(_updateState) Task=`870937b8-fd89-4dcc-b878-65b3904341e7`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:28:30,510::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:28:30,510::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:28:30,510::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:28:30,510::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:28:30,511::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:28:30,511::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:28:30,511::task::990::TaskManager.Task::(_decref) Task=`870937b8-fd89-4dcc-b878-65b3904341e7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:28:31,127::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:28:31,207::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370067 s, 27.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:28:33,220::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:28:33,301::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0375063 s, 27.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:28:33,908::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:28:33,918::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00117111 s, 3.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:28:35,313::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:28:35,389::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351804 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:28:37,402::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:28:37,493::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0484225 s, 21.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:28:39,506::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:28:39,882::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.333543 s, 3.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:28:40,569::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:28:40,570::task::595::TaskManager.Task::(_updateState) Task=`43b337e7-e89d-4de9-8780-5e0009c1b613`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:28:40,570::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:28:40,571::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:28:40,571::task::1185::TaskManager.Task::(prepare) Task=`43b337e7-e89d-4de9-8780-5e0009c1b613`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:28:40,571::task::595::TaskManager.Task::(_updateState) Task=`43b337e7-e89d-4de9-8780-5e0009c1b613`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:28:40,571::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:28:40,571::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:28:40,571::task::990::TaskManager.Task::(_decref) Task=`43b337e7-e89d-4de9-8780-5e0009c1b613`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:28:40,604::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:28:40,604::task::595::TaskManager.Task::(_updateState) Task=`60cd6079-d7b8-4506-ab1f-d074c98ac4db`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:28:40,604::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:28:40,605::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`8c46a0c2-a15e-475d-9343-a6c06ffbbaba`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:28:40,605::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:28:40,605::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:28:40,605::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`8c46a0c2-a15e-475d-9343-a6c06ffbbaba`::Granted request >Thread-34::DEBUG::2014-07-24 10:28:40,606::task::827::TaskManager.Task::(resourceAcquired) Task=`60cd6079-d7b8-4506-ab1f-d074c98ac4db`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:28:40,606::task::990::TaskManager.Task::(_decref) Task=`60cd6079-d7b8-4506-ab1f-d074c98ac4db`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:28:40,607::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '36238786560', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:28:40,607::task::1185::TaskManager.Task::(prepare) Task=`60cd6079-d7b8-4506-ab1f-d074c98ac4db`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '36238786560', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:28:40,607::task::595::TaskManager.Task::(_updateState) Task=`60cd6079-d7b8-4506-ab1f-d074c98ac4db`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:28:40,607::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:28:40,607::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:28:40,608::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:28:40,608::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:28:40,608::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:28:40,608::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:28:40,608::task::990::TaskManager.Task::(_decref) Task=`60cd6079-d7b8-4506-ab1f-d074c98ac4db`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:28:41,895::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:28:41,981::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0430347 s, 23.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:28:43,923::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:28:43,941::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00951483 s, 430 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:28:43,994::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:28:44,364::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.330665 s, 3.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:28:44,928::task::595::TaskManager.Task::(_updateState) Task=`4a42c565-53f1-4afa-a323-992a368c4a6e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:28:44,928::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:28:44,928::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00951483', 'lastCheck': '1.0', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:28:44,929::task::1185::TaskManager.Task::(prepare) Task=`4a42c565-53f1-4afa-a323-992a368c4a6e`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00951483', 'lastCheck': '1.0', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:28:44,929::task::595::TaskManager.Task::(_updateState) Task=`4a42c565-53f1-4afa-a323-992a368c4a6e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:28:44,929::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:28:44,929::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:28:44,930::task::990::TaskManager.Task::(_decref) Task=`4a42c565-53f1-4afa-a323-992a368c4a6e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:28:46,376::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:28:46,455::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348776 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:28:48,467::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:28:48,544::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352649 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:28:50,558::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:28:50,634::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361534 s, 28.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:28:50,664::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:28:50,665::task::595::TaskManager.Task::(_updateState) Task=`04e3f910-45d7-41b7-b212-03093185f2cf`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:28:50,665::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:28:50,665::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:28:50,666::task::1185::TaskManager.Task::(prepare) Task=`04e3f910-45d7-41b7-b212-03093185f2cf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:28:50,666::task::595::TaskManager.Task::(_updateState) Task=`04e3f910-45d7-41b7-b212-03093185f2cf`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:28:50,666::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:28:50,666::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:28:50,666::task::990::TaskManager.Task::(_decref) Task=`04e3f910-45d7-41b7-b212-03093185f2cf`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:28:50,700::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:28:50,700::task::595::TaskManager.Task::(_updateState) Task=`599e53d3-ff5e-4d11-a720-cb69077e266d`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:28:50,701::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:28:50,701::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`989e3639-c80e-4b40-8d3b-2e5d708023ac`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:28:50,701::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:28:50,701::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:28:50,702::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`989e3639-c80e-4b40-8d3b-2e5d708023ac`::Granted request >Thread-34::DEBUG::2014-07-24 10:28:50,702::task::827::TaskManager.Task::(resourceAcquired) Task=`599e53d3-ff5e-4d11-a720-cb69077e266d`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:28:50,702::task::990::TaskManager.Task::(_decref) Task=`599e53d3-ff5e-4d11-a720-cb69077e266d`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:28:50,703::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '36238786560', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:28:50,703::task::1185::TaskManager.Task::(prepare) Task=`599e53d3-ff5e-4d11-a720-cb69077e266d`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '36238786560', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:28:50,703::task::595::TaskManager.Task::(_updateState) Task=`599e53d3-ff5e-4d11-a720-cb69077e266d`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:28:50,703::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:28:50,703::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:28:50,704::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:28:50,704::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:28:50,704::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:28:50,704::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:28:50,704::task::990::TaskManager.Task::(_decref) Task=`599e53d3-ff5e-4d11-a720-cb69077e266d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:28:52,647::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:28:52,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363499 s, 28.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:28:53,946::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:28:53,956::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00072901 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:28:54,736::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:28:54,810::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342542 s, 29.9 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 10:28:55,321::task::595::TaskManager.Task::(_updateState) Task=`5bb6c519-ac8d-467a-a338-08919784d350`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 10:28:55,321::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 10:28:55,322::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-37::DEBUG::2014-07-24 10:28:55,322::task::1185::TaskManager.Task::(prepare) Task=`5bb6c519-ac8d-467a-a338-08919784d350`::finished: {'truesize': '2147483648', 'apparentsize': '2147483648'} >Thread-37::DEBUG::2014-07-24 10:28:55,322::task::595::TaskManager.Task::(_updateState) Task=`5bb6c519-ac8d-467a-a338-08919784d350`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 10:28:55,322::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 10:28:55,322::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 10:28:55,323::task::990::TaskManager.Task::(_decref) Task=`5bb6c519-ac8d-467a-a338-08919784d350`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-07-24 10:28:55,714::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:28:56,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:28:56,899::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362206 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:28:58,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:28:58,987::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349175 s, 29.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:29:00,349::task::595::TaskManager.Task::(_updateState) Task=`300b26ae-b44c-4db3-a294-658c886091b2`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:29:00,349::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:29:00,350::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00072901', 'lastCheck': '6.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:29:00,350::task::1185::TaskManager.Task::(prepare) Task=`300b26ae-b44c-4db3-a294-658c886091b2`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00072901', 'lastCheck': '6.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:29:00,350::task::595::TaskManager.Task::(_updateState) Task=`300b26ae-b44c-4db3-a294-658c886091b2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:29:00,350::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:29:00,350::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:29:00,350::task::990::TaskManager.Task::(_decref) Task=`300b26ae-b44c-4db3-a294-658c886091b2`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:29:00,776::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [1487b3f5] >Thread-14::DEBUG::2014-07-24 10:29:00,777::task::595::TaskManager.Task::(_updateState) Task=`91a40628-fe82-4d45-9534-e9102da00111`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:29:00,777::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:29:00,778::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:29:00,778::task::1185::TaskManager.Task::(prepare) Task=`91a40628-fe82-4d45-9534-e9102da00111`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:29:00,778::task::595::TaskManager.Task::(_updateState) Task=`91a40628-fe82-4d45-9534-e9102da00111`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:29:00,778::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:29:00,778::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:29:00,778::task::990::TaskManager.Task::(_decref) Task=`91a40628-fe82-4d45-9534-e9102da00111`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:29:00,811::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [1487b3f5] >Thread-34::DEBUG::2014-07-24 10:29:00,811::task::595::TaskManager.Task::(_updateState) Task=`6d4eae8e-8430-4414-9562-9593d2e71dfa`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:29:00,811::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:29:00,812::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`550dc6ee-cebe-46aa-95bc-9de1c4708259`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:29:00,812::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:29:00,812::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:29:00,812::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`550dc6ee-cebe-46aa-95bc-9de1c4708259`::Granted request >Thread-34::DEBUG::2014-07-24 10:29:00,813::task::827::TaskManager.Task::(resourceAcquired) Task=`6d4eae8e-8430-4414-9562-9593d2e71dfa`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:29:00,813::task::990::TaskManager.Task::(_decref) Task=`6d4eae8e-8430-4414-9562-9593d2e71dfa`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:29:00,814::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '36238786560', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:29:00,814::task::1185::TaskManager.Task::(prepare) Task=`6d4eae8e-8430-4414-9562-9593d2e71dfa`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '36238786560', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:29:00,814::task::595::TaskManager.Task::(_updateState) Task=`6d4eae8e-8430-4414-9562-9593d2e71dfa`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:29:00,814::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:29:00,814::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:29:00,815::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:29:00,815::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:29:00,815::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:29:00,815::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:29:00,815::task::990::TaskManager.Task::(_decref) Task=`6d4eae8e-8430-4414-9562-9593d2e71dfa`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:29:01,000::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:29:01,078::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360038 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:29:03,091::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:29:03,178::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0419854 s, 24.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:29:03,961::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:29:03,971::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000999725 s, 4.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:29:05,191::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:29:05,294::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0616065 s, 16.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:29:07,307::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:29:07,405::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0564866 s, 18.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:29:09,418::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:29:09,497::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0371031 s, 27.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:29:10,875::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [6674a7d7] >Thread-14::DEBUG::2014-07-24 10:29:10,876::task::595::TaskManager.Task::(_updateState) Task=`a2c4869c-fad8-4278-8fa6-915dfb7f442e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:29:10,876::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:29:10,876::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:29:10,876::task::1185::TaskManager.Task::(prepare) Task=`a2c4869c-fad8-4278-8fa6-915dfb7f442e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:29:10,877::task::595::TaskManager.Task::(_updateState) Task=`a2c4869c-fad8-4278-8fa6-915dfb7f442e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:29:10,877::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:29:10,877::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:29:10,877::task::990::TaskManager.Task::(_decref) Task=`a2c4869c-fad8-4278-8fa6-915dfb7f442e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:29:10,909::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [6674a7d7] >Thread-34::DEBUG::2014-07-24 10:29:10,909::task::595::TaskManager.Task::(_updateState) Task=`bfb51a99-4ca7-4181-bc8c-209a1dc7d1e4`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:29:10,910::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:29:10,910::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b3aa698b-2b89-41f0-bb3b-917538c43cbe`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:29:10,910::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:29:10,910::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:29:10,911::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b3aa698b-2b89-41f0-bb3b-917538c43cbe`::Granted request >Thread-34::DEBUG::2014-07-24 10:29:10,912::task::827::TaskManager.Task::(resourceAcquired) Task=`bfb51a99-4ca7-4181-bc8c-209a1dc7d1e4`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:29:10,912::task::990::TaskManager.Task::(_decref) Task=`bfb51a99-4ca7-4181-bc8c-209a1dc7d1e4`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:29:10,913::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '36238786560', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:29:10,913::task::1185::TaskManager.Task::(prepare) Task=`bfb51a99-4ca7-4181-bc8c-209a1dc7d1e4`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '36238786560', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:29:10,913::task::595::TaskManager.Task::(_updateState) Task=`bfb51a99-4ca7-4181-bc8c-209a1dc7d1e4`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:29:10,913::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:29:10,914::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:29:10,914::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:29:10,914::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:29:10,914::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:29:10,914::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:29:10,914::task::990::TaskManager.Task::(_decref) Task=`bfb51a99-4ca7-4181-bc8c-209a1dc7d1e4`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:29:11,509::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:29:11,588::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0382975 s, 26.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:29:13,600::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:29:13,677::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361439 s, 28.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:29:13,976::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:29:13,986::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000667574 s, 6.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:29:15,690::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-24 10:29:15,743::task::595::TaskManager.Task::(_updateState) Task=`97eecab4-8ca8-48fe-9524-a847f09cd044`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:29:15,744::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:29:15,745::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000667574', 'lastCheck': '1.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:29:15,746::task::1185::TaskManager.Task::(prepare) Task=`97eecab4-8ca8-48fe-9524-a847f09cd044`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000667574', 'lastCheck': '1.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:29:15,748::task::595::TaskManager.Task::(_updateState) Task=`97eecab4-8ca8-48fe-9524-a847f09cd044`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:29:15,749::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:29:15,750::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:29:15,751::task::990::TaskManager.Task::(_decref) Task=`97eecab4-8ca8-48fe-9524-a847f09cd044`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:29:15,792::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348427 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:29:17,804::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:29:17,888::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366592 s, 27.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:29:19,904::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:29:19,980::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370794 s, 27.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:29:21,042::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:29:21,043::task::595::TaskManager.Task::(_updateState) Task=`67754054-1eda-4248-82a8-97fbdc1b85ab`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:29:21,043::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:29:21,043::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:29:21,043::task::1185::TaskManager.Task::(prepare) Task=`67754054-1eda-4248-82a8-97fbdc1b85ab`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:29:21,044::task::595::TaskManager.Task::(_updateState) Task=`67754054-1eda-4248-82a8-97fbdc1b85ab`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:29:21,044::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:29:21,044::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:29:21,044::task::990::TaskManager.Task::(_decref) Task=`67754054-1eda-4248-82a8-97fbdc1b85ab`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:29:21,079::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:29:21,079::task::595::TaskManager.Task::(_updateState) Task=`c7cba400-1db8-4a43-a415-d3f6e4d42a06`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:29:21,079::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:29:21,079::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d7c60ee2-cf01-479c-9fef-e3d8cfb1c9a2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:29:21,080::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:29:21,080::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:29:21,080::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d7c60ee2-cf01-479c-9fef-e3d8cfb1c9a2`::Granted request >Thread-34::DEBUG::2014-07-24 10:29:21,080::task::827::TaskManager.Task::(resourceAcquired) Task=`c7cba400-1db8-4a43-a415-d3f6e4d42a06`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:29:21,081::task::990::TaskManager.Task::(_decref) Task=`c7cba400-1db8-4a43-a415-d3f6e4d42a06`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:29:21,081::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '36238786560', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:29:21,081::task::1185::TaskManager.Task::(prepare) Task=`c7cba400-1db8-4a43-a415-d3f6e4d42a06`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '36238786560', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:29:21,082::task::595::TaskManager.Task::(_updateState) Task=`c7cba400-1db8-4a43-a415-d3f6e4d42a06`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:29:21,082::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:29:21,082::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:29:21,082::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:29:21,082::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:29:21,082::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:29:21,083::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:29:21,083::task::990::TaskManager.Task::(_decref) Task=`c7cba400-1db8-4a43-a415-d3f6e4d42a06`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:29:21,992::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:29:22,070::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0378204 s, 27.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:29:23,991::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:29:24,000::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000651016 s, 6.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:29:24,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:29:24,161::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347399 s, 29.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:29:25,752::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:29:26,174::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:29:26,247::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334438 s, 30.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:29:28,259::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:29:28,335::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353623 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:29:30,348::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:29:30,422::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350408 s, 29.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:29:31,143::task::595::TaskManager.Task::(_updateState) Task=`cb6a4848-0643-4ecb-97c0-5ac928ad60cc`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:29:31,143::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:29:31,144::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000651016', 'lastCheck': '7.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:29:31,144::task::1185::TaskManager.Task::(prepare) Task=`cb6a4848-0643-4ecb-97c0-5ac928ad60cc`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000651016', 'lastCheck': '7.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:29:31,144::task::595::TaskManager.Task::(_updateState) Task=`cb6a4848-0643-4ecb-97c0-5ac928ad60cc`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:29:31,144::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:29:31,144::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:29:31,145::task::990::TaskManager.Task::(_decref) Task=`cb6a4848-0643-4ecb-97c0-5ac928ad60cc`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:29:31,261::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:29:31,276::task::595::TaskManager.Task::(_updateState) Task=`cfd24ec6-7dd7-42fd-bb26-61dc5e98f704`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:29:31,276::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:29:31,277::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:29:31,277::task::1185::TaskManager.Task::(prepare) Task=`cfd24ec6-7dd7-42fd-bb26-61dc5e98f704`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:29:31,277::task::595::TaskManager.Task::(_updateState) Task=`cfd24ec6-7dd7-42fd-bb26-61dc5e98f704`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:29:31,277::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:29:31,277::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:29:31,277::task::990::TaskManager.Task::(_decref) Task=`cfd24ec6-7dd7-42fd-bb26-61dc5e98f704`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:29:31,349::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:29:31,349::task::595::TaskManager.Task::(_updateState) Task=`2b77a851-cdaa-4c3f-98fe-7797e27b1b1c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:29:31,349::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:29:31,349::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`51620000-6d4d-4f4e-beab-6e9a8a3ef9b2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:29:31,350::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:29:31,350::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:29:31,350::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`51620000-6d4d-4f4e-beab-6e9a8a3ef9b2`::Granted request >Thread-34::DEBUG::2014-07-24 10:29:31,350::task::827::TaskManager.Task::(resourceAcquired) Task=`2b77a851-cdaa-4c3f-98fe-7797e27b1b1c`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:29:31,350::task::990::TaskManager.Task::(_decref) Task=`2b77a851-cdaa-4c3f-98fe-7797e27b1b1c`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:29:31,351::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '36238786560', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:29:31,351::task::1185::TaskManager.Task::(prepare) Task=`2b77a851-cdaa-4c3f-98fe-7797e27b1b1c`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '36238786560', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:29:31,352::task::595::TaskManager.Task::(_updateState) Task=`2b77a851-cdaa-4c3f-98fe-7797e27b1b1c`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:29:31,352::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:29:31,352::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:29:31,352::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:29:31,352::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:29:31,352::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:29:31,353::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:29:31,353::task::990::TaskManager.Task::(_decref) Task=`2b77a851-cdaa-4c3f-98fe-7797e27b1b1c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:29:32,434::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:29:32,507::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334806 s, 30.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:29:34,005::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:29:34,014::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000673236 s, 6.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:29:34,519::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:29:34,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347716 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:29:36,607::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:29:36,681::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034038 s, 30.1 MB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 10:29:37,455::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 2147483648, capacity: 10737418240, allocated: 1612135936, physical: 2147483648) >Thread-37::DEBUG::2014-07-24 10:29:37,455::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 3072, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 10:29:37,456::task::595::TaskManager.Task::(_updateState) Task=`1cbf2cde-045d-4ade-b505-f483d01e12ca`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 10:29:37,456::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 3072, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=3221225472, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 10:29:37,456::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 10:29:37,457::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 10:29:37,457::task::1185::TaskManager.Task::(prepare) Task=`1cbf2cde-045d-4ade-b505-f483d01e12ca`::finished: None >Thread-27::DEBUG::2014-07-24 10:29:37,458::storage_mailbox::426::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - start: 64, end: 128, len: 4096, message(1/63): '1xtnd\x8fE\x83\x19\xaa\x18\xaa\xa4\x82H\xc3\xed\x06\x06\xaa#\xe2\x9b\xed\xae\xc5bR\xb3\x85K\x9f\xe2\xee\xa0\x8c\xe10000000000000c0000000000000' >Thread-37::DEBUG::2014-07-24 10:29:37,459::task::595::TaskManager.Task::(_updateState) Task=`1cbf2cde-045d-4ade-b505-f483d01e12ca`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 10:29:37,460::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-27::DEBUG::2014-07-24 10:29:37,461::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-37::DEBUG::2014-07-24 10:29:37,461::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 10:29:37,474::task::990::TaskManager.Task::(_decref) Task=`1cbf2cde-045d-4ade-b505-f483d01e12ca`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 10:29:37,500::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0296841 s, 138 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 10:29:37,500::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 10:29:37,501::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 10:29:38,510::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00165 s, 4.1 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:29:38,693::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:29:38,768::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345104 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:29:38,768::storage_mailbox::658::Storage.MailBox.SpmMailMonitor::(_handleRequests) SPM_MailMonitor: Mailbox 1 validated, checking mail >Dummy-33::DEBUG::2014-07-24 10:29:38,769::storage_mailbox::698::Storage.MailBox.SpmMailMonitor::(_handleRequests) SPM_MailMonitor: processing request: '1xtnd\x8fE\x83\x19\xaa\x18\xaa\xa4\x82H\xc3\xed\x06\x06\xaa#\xe2\x9b\xed\xae\xc5bR\xb3\x85K\x9f\xe2\xee\xa0\x8c\xe10000000000000c0000000000000' >Thread-29::DEBUG::2014-07-24 10:29:38,770::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >c3d99393-cc31-4edb-a221-b44cb2c12e0e::DEBUG::2014-07-24 10:29:38,771::threadPool::200::Misc.ThreadPool.WorkerThread::(_processNextTask) Task: c3d99393-cc31-4edb-a221-b44cb2c12e0e running: <function runTask at 0x149a500> with: (<functools.partial object at 0x15de890>, 65, '1xtnd\x8fE\x83\x19\xaa\x18\xaa\xa4\x82H\xc3\xed\x06\x06\xaa#\xe2\x9b\xed\xae\xc5bR\xb3\x85K\x9f\xe2\xee\xa0\x8c\xe10000000000000c0000000000000') >c3d99393-cc31-4edb-a221-b44cb2c12e0e::DEBUG::2014-07-24 10:29:38,772::task::595::TaskManager.Task::(_updateState) Task=`a8c7599b-1a56-4c4f-9a13-07c2c1767a30`::moving from state init -> state preparing >c3d99393-cc31-4edb-a221-b44cb2c12e0e::DEBUG::2014-07-24 10:29:38,773::storage_mailbox::146::Storage.SPM.Messages.Extend::(processRequest) processRequest, payload:'1xtnd\x8fE\x83\x19\xaa\x18\xaa\xa4\x82H\xc3\xed\x06\x06\xaa#\xe2\x9b\xed\xae\xc5bR\xb3\x85K\x9f\xe2\xee\xa0\x8c\xe10000000000000c0000000000000' >c3d99393-cc31-4edb-a221-b44cb2c12e0e::INFO::2014-07-24 10:29:38,774::storage_mailbox::161::Storage.SPM.Messages.Extend::(processRequest) processRequest: extending volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 in domain 23aa0606-edc3-4882-a4aa-18aa1983458f (pool 637ea13c-81a8-4b44-8cab-961458b01883) to size 3072 >c3d99393-cc31-4edb-a221-b44cb2c12e0e::DEBUG::2014-07-24 10:29:38,779::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvextend --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --size 3072m 23aa0606-edc3-4882-a4aa-18aa1983458f/e18ca0ee-e29f-4b85-b352-62c5aeed9be2' (cwd None) >c3d99393-cc31-4edb-a221-b44cb2c12e0e::DEBUG::2014-07-24 10:29:39,072::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >c3d99393-cc31-4edb-a221-b44cb2c12e0e::DEBUG::2014-07-24 10:29:39,072::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >c3d99393-cc31-4edb-a221-b44cb2c12e0e::DEBUG::2014-07-24 10:29:39,073::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >c3d99393-cc31-4edb-a221-b44cb2c12e0e::DEBUG::2014-07-24 10:29:39,073::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >c3d99393-cc31-4edb-a221-b44cb2c12e0e::DEBUG::2014-07-24 10:29:39,073::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >c3d99393-cc31-4edb-a221-b44cb2c12e0e::DEBUG::2014-07-24 10:29:39,073::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >c3d99393-cc31-4edb-a221-b44cb2c12e0e::DEBUG::2014-07-24 10:29:39,075::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) 'dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox oflag=direct iflag=fullblock conv=notrunc count=1 bs=4096 seek=1' (cwd None) >c3d99393-cc31-4edb-a221-b44cb2c12e0e::DEBUG::2014-07-24 10:29:39,085::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00100965 s, 4.1 MB/s\n'; <rc> = 0 >c3d99393-cc31-4edb-a221-b44cb2c12e0e::DEBUG::2014-07-24 10:29:39,085::task::1185::TaskManager.Task::(prepare) Task=`a8c7599b-1a56-4c4f-9a13-07c2c1767a30`::finished: {'status': {'message': 'Done', 'code': 0}} >c3d99393-cc31-4edb-a221-b44cb2c12e0e::DEBUG::2014-07-24 10:29:39,085::task::595::TaskManager.Task::(_updateState) Task=`a8c7599b-1a56-4c4f-9a13-07c2c1767a30`::moving from state preparing -> state finished >c3d99393-cc31-4edb-a221-b44cb2c12e0e::DEBUG::2014-07-24 10:29:39,085::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >c3d99393-cc31-4edb-a221-b44cb2c12e0e::DEBUG::2014-07-24 10:29:39,086::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >c3d99393-cc31-4edb-a221-b44cb2c12e0e::DEBUG::2014-07-24 10:29:39,086::task::990::TaskManager.Task::(_decref) Task=`a8c7599b-1a56-4c4f-9a13-07c2c1767a30`::ref 0 aborting False >c3d99393-cc31-4edb-a221-b44cb2c12e0e::DEBUG::2014-07-24 10:29:39,086::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-27::DEBUG::2014-07-24 10:29:40,515::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 10:29:40,533::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00782772 s, 523 kB/s\n'; <rc> = 0 >Thread-27::DEBUG::2014-07-24 10:29:40,533::storage_mailbox::342::Storage.MailBox.HsmMailMonitor::(_handleResponses) HSM_MailboxMonitor(1/63) - Checking reply: '1xtnd\x8fE\x83\x19\xaa\x18\xaa\xa4\x82H\xc3\xed\x06\x06\xaa#\xe2\x9b\xed\xae\xc5bR\xb3\x85K\x9f\xe2\xee\xa0\x8c\xe10000000000000c0000000000000' >36bfa0fc-2ebd-48b2-8d44-b0f9dd0331d5::DEBUG::2014-07-24 10:29:40,534::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-27::INFO::2014-07-24 10:29:40,534::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >4fa79bbd-a95b-45c4-8b4a-fca5e6f3b743::DEBUG::2014-07-24 10:29:40,535::threadPool::200::Misc.ThreadPool.WorkerThread::(_processNextTask) Task: 4fa79bbd-a95b-45c4-8b4a-fca5e6f3b743 running: <function runTask at 0x149a500> with: (<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>, {'newSize': 3072, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}) >4fa79bbd-a95b-45c4-8b4a-fca5e6f3b743::DEBUG::2014-07-24 10:29:40,538::task::595::TaskManager.Task::(_updateState) Task=`c20e7f7a-d653-461e-b536-95c602d9a566`::moving from state init -> state preparing >Thread-27::DEBUG::2014-07-24 10:29:40,538::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >4fa79bbd-a95b-45c4-8b4a-fca5e6f3b743::DEBUG::2014-07-24 10:29:40,546::vm::2543::vm.Vm::(__verifyVolumeExtension) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Refreshing drive volume for sda (domainID: 23aa0606-edc3-4882-a4aa-18aa1983458f, volumeID: e18ca0ee-e29f-4b85-b352-62c5aeed9be2) >4fa79bbd-a95b-45c4-8b4a-fca5e6f3b743::DEBUG::2014-07-24 10:29:40,549::task::595::TaskManager.Task::(_updateState) Task=`cae8ba6f-17c7-4d75-a8be-d936dd94a3bf`::moving from state init -> state preparing >4fa79bbd-a95b-45c4-8b4a-fca5e6f3b743::INFO::2014-07-24 10:29:40,550::logUtils::44::dispatcher::(wrapper) Run and protect: refreshVolume(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2') >4fa79bbd-a95b-45c4-8b4a-fca5e6f3b743::DEBUG::2014-07-24 10:29:40,550::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >4fa79bbd-a95b-45c4-8b4a-fca5e6f3b743::DEBUG::2014-07-24 10:29:40,551::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >4fa79bbd-a95b-45c4-8b4a-fca5e6f3b743::DEBUG::2014-07-24 10:29:40,715::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >4fa79bbd-a95b-45c4-8b4a-fca5e6f3b743::DEBUG::2014-07-24 10:29:40,720::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >4fa79bbd-a95b-45c4-8b4a-fca5e6f3b743::DEBUG::2014-07-24 10:29:40,720::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >4fa79bbd-a95b-45c4-8b4a-fca5e6f3b743::DEBUG::2014-07-24 10:29:40,721::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --refresh 23aa0606-edc3-4882-a4aa-18aa1983458f/e18ca0ee-e29f-4b85-b352-62c5aeed9be2' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:29:40,800::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:29:40,890::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0490436 s, 20.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:29:40,891::storage_mailbox::658::Storage.MailBox.SpmMailMonitor::(_handleRequests) SPM_MailMonitor: Mailbox 1 validated, checking mail >Dummy-33::DEBUG::2014-07-24 10:29:40,902::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) 'dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox oflag=direct iflag=fullblock conv=notrunc count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:29:40,952::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0407674 s, 25.1 MB/s\n'; <rc> = 0 >4fa79bbd-a95b-45c4-8b4a-fca5e6f3b743::DEBUG::2014-07-24 10:29:41,101::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >4fa79bbd-a95b-45c4-8b4a-fca5e6f3b743::DEBUG::2014-07-24 10:29:41,102::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >4fa79bbd-a95b-45c4-8b4a-fca5e6f3b743::DEBUG::2014-07-24 10:29:41,102::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >4fa79bbd-a95b-45c4-8b4a-fca5e6f3b743::INFO::2014-07-24 10:29:41,102::logUtils::47::dispatcher::(wrapper) Run and protect: refreshVolume, Return response: None >4fa79bbd-a95b-45c4-8b4a-fca5e6f3b743::DEBUG::2014-07-24 10:29:41,102::task::1185::TaskManager.Task::(prepare) Task=`cae8ba6f-17c7-4d75-a8be-d936dd94a3bf`::finished: None >4fa79bbd-a95b-45c4-8b4a-fca5e6f3b743::DEBUG::2014-07-24 10:29:41,102::task::595::TaskManager.Task::(_updateState) Task=`cae8ba6f-17c7-4d75-a8be-d936dd94a3bf`::moving from state preparing -> state finished >4fa79bbd-a95b-45c4-8b4a-fca5e6f3b743::DEBUG::2014-07-24 10:29:41,103::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >4fa79bbd-a95b-45c4-8b4a-fca5e6f3b743::DEBUG::2014-07-24 10:29:41,103::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >4fa79bbd-a95b-45c4-8b4a-fca5e6f3b743::DEBUG::2014-07-24 10:29:41,103::task::990::TaskManager.Task::(_decref) Task=`cae8ba6f-17c7-4d75-a8be-d936dd94a3bf`::ref 0 aborting False >4fa79bbd-a95b-45c4-8b4a-fca5e6f3b743::DEBUG::2014-07-24 10:29:41,103::task::595::TaskManager.Task::(_updateState) Task=`33710673-bb06-429c-981a-94fbdca33abc`::moving from state init -> state preparing >4fa79bbd-a95b-45c4-8b4a-fca5e6f3b743::INFO::2014-07-24 10:29:41,104::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >4fa79bbd-a95b-45c4-8b4a-fca5e6f3b743::INFO::2014-07-24 10:29:41,104::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >4fa79bbd-a95b-45c4-8b4a-fca5e6f3b743::DEBUG::2014-07-24 10:29:41,104::task::1185::TaskManager.Task::(prepare) Task=`33710673-bb06-429c-981a-94fbdca33abc`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >4fa79bbd-a95b-45c4-8b4a-fca5e6f3b743::DEBUG::2014-07-24 10:29:41,104::task::595::TaskManager.Task::(_updateState) Task=`33710673-bb06-429c-981a-94fbdca33abc`::moving from state preparing -> state finished >4fa79bbd-a95b-45c4-8b4a-fca5e6f3b743::DEBUG::2014-07-24 10:29:41,104::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >4fa79bbd-a95b-45c4-8b4a-fca5e6f3b743::DEBUG::2014-07-24 10:29:41,105::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >4fa79bbd-a95b-45c4-8b4a-fca5e6f3b743::DEBUG::2014-07-24 10:29:41,105::task::990::TaskManager.Task::(_decref) Task=`33710673-bb06-429c-981a-94fbdca33abc`::ref 0 aborting False >4fa79bbd-a95b-45c4-8b4a-fca5e6f3b743::DEBUG::2014-07-24 10:29:41,105::vm::2563::vm.Vm::(__verifyVolumeExtension) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Verifying extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2, requested size 3221225472, current size 3221225472 >4fa79bbd-a95b-45c4-8b4a-fca5e6f3b743::DEBUG::2014-07-24 10:29:41,128::task::1185::TaskManager.Task::(prepare) Task=`c20e7f7a-d653-461e-b536-95c602d9a566`::finished: None >4fa79bbd-a95b-45c4-8b4a-fca5e6f3b743::DEBUG::2014-07-24 10:29:41,129::task::595::TaskManager.Task::(_updateState) Task=`c20e7f7a-d653-461e-b536-95c602d9a566`::moving from state preparing -> state finished >4fa79bbd-a95b-45c4-8b4a-fca5e6f3b743::DEBUG::2014-07-24 10:29:41,129::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >4fa79bbd-a95b-45c4-8b4a-fca5e6f3b743::DEBUG::2014-07-24 10:29:41,129::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >4fa79bbd-a95b-45c4-8b4a-fca5e6f3b743::DEBUG::2014-07-24 10:29:41,129::task::990::TaskManager.Task::(_decref) Task=`c20e7f7a-d653-461e-b536-95c602d9a566`::ref 0 aborting False >4fa79bbd-a95b-45c4-8b4a-fca5e6f3b743::DEBUG::2014-07-24 10:29:41,129::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-13::DEBUG::2014-07-24 10:29:41,420::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [3b38bf98] >Thread-13::DEBUG::2014-07-24 10:29:41,420::task::595::TaskManager.Task::(_updateState) Task=`1d76870a-4b60-4823-a6e5-00c149e097f7`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:29:41,421::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:29:41,421::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:29:41,421::task::1185::TaskManager.Task::(prepare) Task=`1d76870a-4b60-4823-a6e5-00c149e097f7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:29:41,421::task::595::TaskManager.Task::(_updateState) Task=`1d76870a-4b60-4823-a6e5-00c149e097f7`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:29:41,421::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:29:41,422::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:29:41,422::task::990::TaskManager.Task::(_decref) Task=`1d76870a-4b60-4823-a6e5-00c149e097f7`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:29:41,458::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [3b38bf98] >Thread-34::DEBUG::2014-07-24 10:29:41,458::task::595::TaskManager.Task::(_updateState) Task=`f7991f08-0da0-4ebf-bbd8-c4615f8dbb20`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:29:41,458::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:29:41,459::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b8b9fde9-6bb1-4027-91f0-5851697196c5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:29:41,459::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:29:41,459::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:29:41,459::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b8b9fde9-6bb1-4027-91f0-5851697196c5`::Granted request >Thread-34::DEBUG::2014-07-24 10:29:41,460::task::827::TaskManager.Task::(resourceAcquired) Task=`f7991f08-0da0-4ebf-bbd8-c4615f8dbb20`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:29:41,460::task::990::TaskManager.Task::(_decref) Task=`f7991f08-0da0-4ebf-bbd8-c4615f8dbb20`::ref 1 aborting False >Thread-34::DEBUG::2014-07-24 10:29:41,460::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-34::DEBUG::2014-07-24 10:29:41,461::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-27::DEBUG::2014-07-24 10:29:41,552::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00476 s, 4.1 kB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-24 10:29:41,638::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-34::DEBUG::2014-07-24 10:29:41,640::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-34::INFO::2014-07-24 10:29:41,640::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '36238786560', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:29:41,641::task::1185::TaskManager.Task::(prepare) Task=`f7991f08-0da0-4ebf-bbd8-c4615f8dbb20`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '36238786560', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:29:41,641::task::595::TaskManager.Task::(_updateState) Task=`f7991f08-0da0-4ebf-bbd8-c4615f8dbb20`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:29:41,641::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:29:41,641::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:29:41,641::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:29:41,642::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:29:41,642::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:29:41,642::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:29:41,642::task::990::TaskManager.Task::(_decref) Task=`f7991f08-0da0-4ebf-bbd8-c4615f8dbb20`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:29:42,954::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:29:43,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.256979 s, 4.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:29:43,289::storage_mailbox::658::Storage.MailBox.SpmMailMonitor::(_handleRequests) SPM_MailMonitor: Mailbox 1 validated, checking mail >Dummy-33::DEBUG::2014-07-24 10:29:43,300::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) 'dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox oflag=direct iflag=fullblock conv=notrunc count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:29:43,342::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034623 s, 29.6 MB/s\n'; <rc> = 0 >Thread-27::DEBUG::2014-07-24 10:29:43,554::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 10:29:43,821::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.257531 s, 15.9 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 10:29:43,821::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 10:29:43,821::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-18::DEBUG::2014-07-24 10:29:44,020::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:29:44,060::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0324178 s, 126 kB/s\n'; <rc> = 0 >Thread-27::DEBUG::2014-07-24 10:29:44,830::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00152 s, 4.1 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:29:45,344::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:29:45,426::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0405728 s, 25.2 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:29:46,609::task::595::TaskManager.Task::(_updateState) Task=`b567f0c0-8260-4341-9233-9be4e29867f0`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:29:46,624::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:29:46,625::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0324178', 'lastCheck': '2.6', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:29:46,625::task::1185::TaskManager.Task::(prepare) Task=`b567f0c0-8260-4341-9233-9be4e29867f0`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0324178', 'lastCheck': '2.6', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:29:46,625::task::595::TaskManager.Task::(_updateState) Task=`b567f0c0-8260-4341-9233-9be4e29867f0`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:29:46,625::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:29:46,625::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:29:46,625::task::990::TaskManager.Task::(_decref) Task=`b567f0c0-8260-4341-9233-9be4e29867f0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:29:47,439::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:29:47,544::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0632701 s, 16.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:29:49,556::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:29:49,633::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367544 s, 27.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:29:51,646::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-13::DEBUG::2014-07-24 10:29:51,711::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:29:51,712::task::595::TaskManager.Task::(_updateState) Task=`2d0db3b2-c3eb-4241-9324-e668f7e86aea`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:29:51,713::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:29:51,715::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:29:51,715::task::1185::TaskManager.Task::(prepare) Task=`2d0db3b2-c3eb-4241-9324-e668f7e86aea`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:29:51,716::task::595::TaskManager.Task::(_updateState) Task=`2d0db3b2-c3eb-4241-9324-e668f7e86aea`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:29:51,717::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:29:51,717::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:29:51,718::task::990::TaskManager.Task::(_decref) Task=`2d0db3b2-c3eb-4241-9324-e668f7e86aea`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:29:51,734::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358479 s, 28.6 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-24 10:29:51,761::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:29:51,761::task::595::TaskManager.Task::(_updateState) Task=`f1a4009b-eb29-4d6a-80a2-81b7155cf21a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:29:51,761::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:29:51,762::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ef61ef70-e199-401d-97f3-9584afc2225c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:29:51,762::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:29:51,762::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:29:51,762::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ef61ef70-e199-401d-97f3-9584afc2225c`::Granted request >Thread-34::DEBUG::2014-07-24 10:29:51,763::task::827::TaskManager.Task::(resourceAcquired) Task=`f1a4009b-eb29-4d6a-80a2-81b7155cf21a`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:29:51,763::task::990::TaskManager.Task::(_decref) Task=`f1a4009b-eb29-4d6a-80a2-81b7155cf21a`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:29:51,764::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:29:51,764::task::1185::TaskManager.Task::(prepare) Task=`f1a4009b-eb29-4d6a-80a2-81b7155cf21a`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:29:51,764::task::595::TaskManager.Task::(_updateState) Task=`f1a4009b-eb29-4d6a-80a2-81b7155cf21a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:29:51,764::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:29:51,764::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:29:51,765::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:29:51,765::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:29:51,765::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:29:51,765::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:29:51,765::task::990::TaskManager.Task::(_decref) Task=`f1a4009b-eb29-4d6a-80a2-81b7155cf21a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:29:53,747::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:29:53,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361848 s, 28.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:29:54,065::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:29:54,088::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0106593 s, 384 kB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 10:29:55,516::task::595::TaskManager.Task::(_updateState) Task=`7af95068-9f0e-420d-ae26-8b8c66ee14ed`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 10:29:55,516::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 10:29:55,516::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:29:55,516::task::1185::TaskManager.Task::(prepare) Task=`7af95068-9f0e-420d-ae26-8b8c66ee14ed`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:29:55,517::task::595::TaskManager.Task::(_updateState) Task=`7af95068-9f0e-420d-ae26-8b8c66ee14ed`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 10:29:55,517::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 10:29:55,517::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 10:29:55,517::task::990::TaskManager.Task::(_decref) Task=`7af95068-9f0e-420d-ae26-8b8c66ee14ed`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-07-24 10:29:55,789::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:29:55,835::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:29:55,910::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354295 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:29:57,921::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:29:58,017::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0548188 s, 18.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:30:00,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:30:00,122::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0509422 s, 20.1 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:30:01,910::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:30:01,911::task::595::TaskManager.Task::(_updateState) Task=`cd60f1ff-d55b-4e6d-aa89-3391dbd63887`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:30:01,911::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:30:01,912::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:30:01,912::task::1185::TaskManager.Task::(prepare) Task=`cd60f1ff-d55b-4e6d-aa89-3391dbd63887`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:30:01,912::task::595::TaskManager.Task::(_updateState) Task=`cd60f1ff-d55b-4e6d-aa89-3391dbd63887`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:30:01,912::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:30:01,912::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:30:01,913::task::990::TaskManager.Task::(_decref) Task=`cd60f1ff-d55b-4e6d-aa89-3391dbd63887`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:30:01,945::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:30:01,946::task::595::TaskManager.Task::(_updateState) Task=`2cf14b2a-e87e-44d6-ac43-b2924236f1fa`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:30:01,946::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:30:01,946::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`513fd7ce-44f1-451c-ac6e-17ec1f6943f5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:30:01,946::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:30:01,947::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:30:01,947::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`513fd7ce-44f1-451c-ac6e-17ec1f6943f5`::Granted request >Thread-34::DEBUG::2014-07-24 10:30:01,947::task::827::TaskManager.Task::(resourceAcquired) Task=`2cf14b2a-e87e-44d6-ac43-b2924236f1fa`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:30:01,947::task::990::TaskManager.Task::(_decref) Task=`2cf14b2a-e87e-44d6-ac43-b2924236f1fa`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:30:01,948::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:30:01,948::task::1185::TaskManager.Task::(prepare) Task=`2cf14b2a-e87e-44d6-ac43-b2924236f1fa`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:30:01,948::task::595::TaskManager.Task::(_updateState) Task=`2cf14b2a-e87e-44d6-ac43-b2924236f1fa`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:30:01,949::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:30:01,949::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:30:01,949::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:30:01,949::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:30:01,949::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:30:01,949::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:30:01,950::task::990::TaskManager.Task::(_decref) Task=`2cf14b2a-e87e-44d6-ac43-b2924236f1fa`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:30:02,071::task::595::TaskManager.Task::(_updateState) Task=`e8161b77-cac9-4a3b-9fe6-befbedb8dc3c`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:30:02,072::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:30:02,072::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0106593', 'lastCheck': '8.0', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:30:02,072::task::1185::TaskManager.Task::(prepare) Task=`e8161b77-cac9-4a3b-9fe6-befbedb8dc3c`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0106593', 'lastCheck': '8.0', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:30:02,072::task::595::TaskManager.Task::(_updateState) Task=`e8161b77-cac9-4a3b-9fe6-befbedb8dc3c`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:30:02,072::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:30:02,072::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:30:02,073::task::990::TaskManager.Task::(_decref) Task=`e8161b77-cac9-4a3b-9fe6-befbedb8dc3c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:30:02,135::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:30:02,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.371791 s, 2.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:30:04,093::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:30:04,118::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0162524 s, 252 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:30:04,562::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:30:04,663::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0546832 s, 18.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:30:06,675::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:30:06,759::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0430549 s, 23.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:30:08,772::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:30:08,850::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035694 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:30:10,861::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:30:10,943::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0399145 s, 25.7 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:30:12,198::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:30:12,198::task::595::TaskManager.Task::(_updateState) Task=`4f1ea7eb-3f2c-4b47-9acb-a7ec56353c38`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:30:12,199::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:30:12,199::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:30:12,199::task::1185::TaskManager.Task::(prepare) Task=`4f1ea7eb-3f2c-4b47-9acb-a7ec56353c38`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:30:12,199::task::595::TaskManager.Task::(_updateState) Task=`4f1ea7eb-3f2c-4b47-9acb-a7ec56353c38`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:30:12,200::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:30:12,200::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:30:12,200::task::990::TaskManager.Task::(_decref) Task=`4f1ea7eb-3f2c-4b47-9acb-a7ec56353c38`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:30:12,232::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:30:12,232::task::595::TaskManager.Task::(_updateState) Task=`eb0a28dd-daa6-429e-98d1-765e3dd4ac4e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:30:12,232::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:30:12,233::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`a5d0b25d-50ed-4843-9e24-b5aea8543ce6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:30:12,233::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:30:12,233::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:30:12,233::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`a5d0b25d-50ed-4843-9e24-b5aea8543ce6`::Granted request >Thread-34::DEBUG::2014-07-24 10:30:12,234::task::827::TaskManager.Task::(resourceAcquired) Task=`eb0a28dd-daa6-429e-98d1-765e3dd4ac4e`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:30:12,234::task::990::TaskManager.Task::(_decref) Task=`eb0a28dd-daa6-429e-98d1-765e3dd4ac4e`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:30:12,235::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:30:12,235::task::1185::TaskManager.Task::(prepare) Task=`eb0a28dd-daa6-429e-98d1-765e3dd4ac4e`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:30:12,235::task::595::TaskManager.Task::(_updateState) Task=`eb0a28dd-daa6-429e-98d1-765e3dd4ac4e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:30:12,235::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:30:12,235::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:30:12,236::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:30:12,236::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:30:12,236::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:30:12,236::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:30:12,236::task::990::TaskManager.Task::(_decref) Task=`eb0a28dd-daa6-429e-98d1-765e3dd4ac4e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:30:12,956::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:30:13,039::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0389327 s, 26.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:30:14,124::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:30:14,144::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0108612 s, 377 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:30:15,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:30:15,131::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0376371 s, 27.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:30:17,144::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:30:17,219::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361433 s, 28.3 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:30:17,516::task::595::TaskManager.Task::(_updateState) Task=`2066bde4-7862-46d3-b256-2c04c84bd25e`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:30:17,517::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:30:17,517::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0108612', 'lastCheck': '3.4', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:30:17,517::task::1185::TaskManager.Task::(prepare) Task=`2066bde4-7862-46d3-b256-2c04c84bd25e`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0108612', 'lastCheck': '3.4', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:30:17,517::task::595::TaskManager.Task::(_updateState) Task=`2066bde4-7862-46d3-b256-2c04c84bd25e`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:30:17,517::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:30:17,518::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:30:17,518::task::990::TaskManager.Task::(_decref) Task=`2066bde4-7862-46d3-b256-2c04c84bd25e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:30:19,232::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:30:19,313::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.040495 s, 25.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:30:21,326::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:30:21,401::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035847 s, 28.6 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:30:22,291::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:30:22,292::task::595::TaskManager.Task::(_updateState) Task=`eba25e3d-7b5f-4e30-9375-81503bc1e4f2`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:30:22,292::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:30:22,292::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:30:22,293::task::1185::TaskManager.Task::(prepare) Task=`eba25e3d-7b5f-4e30-9375-81503bc1e4f2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:30:22,293::task::595::TaskManager.Task::(_updateState) Task=`eba25e3d-7b5f-4e30-9375-81503bc1e4f2`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:30:22,293::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:30:22,293::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:30:22,293::task::990::TaskManager.Task::(_decref) Task=`eba25e3d-7b5f-4e30-9375-81503bc1e4f2`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:30:22,328::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:30:22,328::task::595::TaskManager.Task::(_updateState) Task=`9e78337e-31e0-4a2e-97eb-196b212511af`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:30:22,328::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:30:22,329::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`5913be34-279b-4399-b9e8-8d7e4adfd407`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:30:22,329::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:30:22,329::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:30:22,329::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`5913be34-279b-4399-b9e8-8d7e4adfd407`::Granted request >Thread-34::DEBUG::2014-07-24 10:30:22,329::task::827::TaskManager.Task::(resourceAcquired) Task=`9e78337e-31e0-4a2e-97eb-196b212511af`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:30:22,330::task::990::TaskManager.Task::(_decref) Task=`9e78337e-31e0-4a2e-97eb-196b212511af`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:30:22,330::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:30:22,330::task::1185::TaskManager.Task::(prepare) Task=`9e78337e-31e0-4a2e-97eb-196b212511af`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:30:22,331::task::595::TaskManager.Task::(_updateState) Task=`9e78337e-31e0-4a2e-97eb-196b212511af`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:30:22,331::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:30:22,331::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:30:22,331::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:30:22,331::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:30:22,332::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:30:22,332::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:30:22,332::task::990::TaskManager.Task::(_decref) Task=`9e78337e-31e0-4a2e-97eb-196b212511af`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:30:23,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:30:23,502::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350337 s, 29.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:30:24,149::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:30:24,175::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.011716 s, 350 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:30:25,515::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:30:25,591::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358959 s, 28.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:30:25,826::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:30:27,606::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:30:27,683::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369495 s, 27.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:30:29,697::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:30:29,772::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353383 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:30:31,786::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:30:31,886::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0606927 s, 16.9 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:30:32,387::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:30:32,388::task::595::TaskManager.Task::(_updateState) Task=`f95734f8-9cad-4e14-8323-d1bed6108314`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:30:32,388::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:30:32,388::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:30:32,389::task::1185::TaskManager.Task::(prepare) Task=`f95734f8-9cad-4e14-8323-d1bed6108314`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:30:32,389::task::595::TaskManager.Task::(_updateState) Task=`f95734f8-9cad-4e14-8323-d1bed6108314`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:30:32,389::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:30:32,389::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:30:32,389::task::990::TaskManager.Task::(_decref) Task=`f95734f8-9cad-4e14-8323-d1bed6108314`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:30:32,422::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:30:32,422::task::595::TaskManager.Task::(_updateState) Task=`c319b6f7-f6b0-428d-a4ee-c1a4a7a4d9e1`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:30:32,422::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:30:32,423::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4a754fbd-3fc8-4281-a8b5-b91fb5cb6170`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:30:32,423::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:30:32,423::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:30:32,423::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4a754fbd-3fc8-4281-a8b5-b91fb5cb6170`::Granted request >Thread-34::DEBUG::2014-07-24 10:30:32,424::task::827::TaskManager.Task::(resourceAcquired) Task=`c319b6f7-f6b0-428d-a4ee-c1a4a7a4d9e1`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:30:32,424::task::990::TaskManager.Task::(_decref) Task=`c319b6f7-f6b0-428d-a4ee-c1a4a7a4d9e1`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:30:32,425::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:30:32,425::task::1185::TaskManager.Task::(prepare) Task=`c319b6f7-f6b0-428d-a4ee-c1a4a7a4d9e1`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:30:32,425::task::595::TaskManager.Task::(_updateState) Task=`c319b6f7-f6b0-428d-a4ee-c1a4a7a4d9e1`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:30:32,425::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:30:32,425::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:30:32,426::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:30:32,426::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:30:32,426::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:30:32,426::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:30:32,426::task::990::TaskManager.Task::(_decref) Task=`c319b6f7-f6b0-428d-a4ee-c1a4a7a4d9e1`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:30:32,885::task::595::TaskManager.Task::(_updateState) Task=`2efff0bc-4686-41cf-a961-76c12826b104`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:30:32,885::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:30:32,885::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.011716', 'lastCheck': '8.7', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:30:32,885::task::1185::TaskManager.Task::(prepare) Task=`2efff0bc-4686-41cf-a961-76c12826b104`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.011716', 'lastCheck': '8.7', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:30:32,886::task::595::TaskManager.Task::(_updateState) Task=`2efff0bc-4686-41cf-a961-76c12826b104`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:30:32,886::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:30:32,886::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:30:32,886::task::990::TaskManager.Task::(_decref) Task=`2efff0bc-4686-41cf-a961-76c12826b104`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:30:33,899::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:30:33,999::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0579891 s, 17.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:30:34,181::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:30:34,211::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0201779 s, 203 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:30:36,012::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:30:36,089::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366471 s, 27.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:30:38,102::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:30:38,179::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354124 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:30:40,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:30:40,269::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0385969 s, 26.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:30:42,282::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:30:42,367::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0440379 s, 23.3 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:30:42,484::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:30:42,484::task::595::TaskManager.Task::(_updateState) Task=`84085ee8-8770-45d0-9409-9b1c2496affd`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:30:42,485::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:30:42,485::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:30:42,485::task::1185::TaskManager.Task::(prepare) Task=`84085ee8-8770-45d0-9409-9b1c2496affd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:30:42,485::task::595::TaskManager.Task::(_updateState) Task=`84085ee8-8770-45d0-9409-9b1c2496affd`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:30:42,486::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:30:42,486::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:30:42,486::task::990::TaskManager.Task::(_decref) Task=`84085ee8-8770-45d0-9409-9b1c2496affd`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:30:42,540::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:30:42,540::task::595::TaskManager.Task::(_updateState) Task=`37322050-d123-4462-ae4b-c332951b21d4`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:30:42,540::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:30:42,541::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`a89aaf93-5910-4618-8708-2c1a111a5d50`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:30:42,541::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:30:42,541::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:30:42,541::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`a89aaf93-5910-4618-8708-2c1a111a5d50`::Granted request >Thread-34::DEBUG::2014-07-24 10:30:42,542::task::827::TaskManager.Task::(resourceAcquired) Task=`37322050-d123-4462-ae4b-c332951b21d4`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:30:42,542::task::990::TaskManager.Task::(_decref) Task=`37322050-d123-4462-ae4b-c332951b21d4`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:30:42,543::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:30:42,543::task::1185::TaskManager.Task::(prepare) Task=`37322050-d123-4462-ae4b-c332951b21d4`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:30:42,543::task::595::TaskManager.Task::(_updateState) Task=`37322050-d123-4462-ae4b-c332951b21d4`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:30:42,543::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:30:42,543::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:30:42,544::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:30:42,544::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:30:42,544::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:30:42,544::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:30:42,544::task::990::TaskManager.Task::(_decref) Task=`37322050-d123-4462-ae4b-c332951b21d4`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 10:30:44,216::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:30:44,236::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0118249 s, 346 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:30:44,380::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:30:44,455::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358712 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:30:46,468::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:30:46,541::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342187 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:30:48,554::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-24 10:30:48,613::task::595::TaskManager.Task::(_updateState) Task=`1f443cf7-e7a1-46e0-bef1-a17d75b40992`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:30:48,615::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:30:48,616::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0118249', 'lastCheck': '4.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:30:48,617::task::1185::TaskManager.Task::(prepare) Task=`1f443cf7-e7a1-46e0-bef1-a17d75b40992`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0118249', 'lastCheck': '4.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:30:48,618::task::595::TaskManager.Task::(_updateState) Task=`1f443cf7-e7a1-46e0-bef1-a17d75b40992`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:30:48,619::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:30:48,621::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:30:48,623::task::990::TaskManager.Task::(_decref) Task=`1f443cf7-e7a1-46e0-bef1-a17d75b40992`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:30:48,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0442617 s, 23.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:30:50,685::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:30:50,760::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357224 s, 28.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:30:52,600::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:30:52,600::task::595::TaskManager.Task::(_updateState) Task=`32c937a9-151b-4a6f-93f5-3e87a773bd64`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:30:52,601::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:30:52,601::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:30:52,601::task::1185::TaskManager.Task::(prepare) Task=`32c937a9-151b-4a6f-93f5-3e87a773bd64`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:30:52,601::task::595::TaskManager.Task::(_updateState) Task=`32c937a9-151b-4a6f-93f5-3e87a773bd64`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:30:52,601::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:30:52,602::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:30:52,602::task::990::TaskManager.Task::(_decref) Task=`32c937a9-151b-4a6f-93f5-3e87a773bd64`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:30:52,635::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:30:52,636::task::595::TaskManager.Task::(_updateState) Task=`03d25a6e-bf4c-4393-9d7e-7e658332c3af`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:30:52,636::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:30:52,636::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e613d874-9307-498e-8a81-f218469a02fd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:30:52,637::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:30:52,637::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:30:52,637::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e613d874-9307-498e-8a81-f218469a02fd`::Granted request >Thread-34::DEBUG::2014-07-24 10:30:52,637::task::827::TaskManager.Task::(resourceAcquired) Task=`03d25a6e-bf4c-4393-9d7e-7e658332c3af`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:30:52,637::task::990::TaskManager.Task::(_decref) Task=`03d25a6e-bf4c-4393-9d7e-7e658332c3af`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:30:52,638::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:30:52,638::task::1185::TaskManager.Task::(prepare) Task=`03d25a6e-bf4c-4393-9d7e-7e658332c3af`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:30:52,638::task::595::TaskManager.Task::(_updateState) Task=`03d25a6e-bf4c-4393-9d7e-7e658332c3af`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:30:52,639::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:30:52,639::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:30:52,639::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:30:52,639::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:30:52,639::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:30:52,639::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:30:52,640::task::990::TaskManager.Task::(_decref) Task=`03d25a6e-bf4c-4393-9d7e-7e658332c3af`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:30:52,772::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:30:52,850::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369816 s, 27.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:30:54,241::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:30:54,261::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0119389 s, 343 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:30:54,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:30:54,949::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0457027 s, 22.4 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 10:30:55,688::task::595::TaskManager.Task::(_updateState) Task=`0453ef66-96b9-4244-be52-849de8879ffc`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 10:30:55,689::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 10:30:55,689::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:30:55,689::task::1185::TaskManager.Task::(prepare) Task=`0453ef66-96b9-4244-be52-849de8879ffc`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:30:55,689::task::595::TaskManager.Task::(_updateState) Task=`0453ef66-96b9-4244-be52-849de8879ffc`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 10:30:55,689::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 10:30:55,690::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 10:30:55,690::task::990::TaskManager.Task::(_decref) Task=`0453ef66-96b9-4244-be52-849de8879ffc`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-07-24 10:30:55,864::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:30:56,962::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:30:57,035::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343692 s, 29.8 MB/s\n'; <rc> = 0 >libvirtEventLoop::DEBUG::2014-07-24 10:30:57,274::vm::2417::vm.Vm::(onReboot) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::reboot event >Dummy-33::DEBUG::2014-07-24 10:30:59,047::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:30:59,124::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369263 s, 27.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:31:01,136::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:31:01,210::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353243 s, 29.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:31:02,696::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:31:02,696::task::595::TaskManager.Task::(_updateState) Task=`9b329af2-caa3-4074-b7aa-9737529241fc`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:31:02,696::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:31:02,697::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:31:02,697::task::1185::TaskManager.Task::(prepare) Task=`9b329af2-caa3-4074-b7aa-9737529241fc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:31:02,697::task::595::TaskManager.Task::(_updateState) Task=`9b329af2-caa3-4074-b7aa-9737529241fc`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:31:02,697::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:31:02,698::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:31:02,698::task::990::TaskManager.Task::(_decref) Task=`9b329af2-caa3-4074-b7aa-9737529241fc`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:31:02,732::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:31:02,732::task::595::TaskManager.Task::(_updateState) Task=`d3e0e30a-80e1-4770-a729-0cf2b70b19b2`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:31:02,733::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:31:02,733::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f62ed968-f666-498c-b887-c374f3176753`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:31:02,733::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:31:02,734::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:31:02,734::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f62ed968-f666-498c-b887-c374f3176753`::Granted request >Thread-34::DEBUG::2014-07-24 10:31:02,736::task::827::TaskManager.Task::(resourceAcquired) Task=`d3e0e30a-80e1-4770-a729-0cf2b70b19b2`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:31:02,736::task::990::TaskManager.Task::(_decref) Task=`d3e0e30a-80e1-4770-a729-0cf2b70b19b2`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:31:02,737::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:31:02,737::task::1185::TaskManager.Task::(prepare) Task=`d3e0e30a-80e1-4770-a729-0cf2b70b19b2`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:31:02,737::task::595::TaskManager.Task::(_updateState) Task=`d3e0e30a-80e1-4770-a729-0cf2b70b19b2`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:31:02,737::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:31:02,737::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:31:02,738::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:31:02,738::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:31:02,738::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:31:02,738::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:31:02,738::task::990::TaskManager.Task::(_decref) Task=`d3e0e30a-80e1-4770-a729-0cf2b70b19b2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:31:03,222::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:31:03,298::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354985 s, 28.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:31:04,013::task::595::TaskManager.Task::(_updateState) Task=`14e657d9-5a05-4fab-8f9b-fa0cf4f5fc7c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:31:04,014::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:31:04,014::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0119389', 'lastCheck': '9.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:31:04,014::task::1185::TaskManager.Task::(prepare) Task=`14e657d9-5a05-4fab-8f9b-fa0cf4f5fc7c`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0119389', 'lastCheck': '9.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:31:04,014::task::595::TaskManager.Task::(_updateState) Task=`14e657d9-5a05-4fab-8f9b-fa0cf4f5fc7c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:31:04,014::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:31:04,014::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:31:04,015::task::990::TaskManager.Task::(_decref) Task=`14e657d9-5a05-4fab-8f9b-fa0cf4f5fc7c`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 10:31:04,267::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 23aa0606-edc3-4882-a4aa-18aa1983458f >Thread-18::DEBUG::2014-07-24 10:31:04,267::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-18::DEBUG::2014-07-24 10:31:04,268::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:31:04,277::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000550518 s, 3.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:31:04,277::misc::264::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000550518 s, 3.7 MB/s'], size: 2048 >Thread-18::DEBUG::2014-07-24 10:31:04,277::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-18::WARNING::2014-07-24 10:31:04,277::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-18::DEBUG::2014-07-24 10:31:04,277::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-18::DEBUG::2014-07-24 10:31:04,278::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 10:31:04,278::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 10:31:04,278::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 10:31:04,278::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 10:31:04,279::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 10:31:04,279::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-18::DEBUG::2014-07-24 10:31:04,488::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:31:04,490::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 10:31:04,495::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'LOCKPOLICY=', 'POOL_DOMAINS=23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'POOL_DESCRIPTION=DS1', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_UUID=637ea13c-81a8-4b44-8cab-961458b01883', 'POOL_SPM_ID=1', '_SHA_CKSUM=a749afdc7119a2d6aad840af5c63c9b28c0b612c', 'POOL_SPM_LVER=0'] >Thread-18::INFO::2014-07-24 10:31:04,496::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_imageNS already registered >Thread-18::INFO::2014-07-24 10:31:04,496::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_volumeNS already registered >Thread-18::INFO::2014-07-24 10:31:04,496::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_lvmActivationNS already registered >Thread-18::DEBUG::2014-07-24 10:31:04,497::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-18::DEBUG::2014-07-24 10:31:04,648::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:31:04,649::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:31:04,658::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00062602 s, 6.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:31:05,309::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:31:05,384::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346974 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:31:07,396::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-24 10:31:07,462::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call vmGetStats with ('6fca7e11-8f3f-4784-bdab-7e7f9503cd5b',) {} flowID [12b68a95] >Thread-14::DEBUG::2014-07-24 10:31:07,466::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '23972', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-1911391925401482767', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'clientIp': '10.35.2.195', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:58:22:89', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '6fca7e11-8f3f-4784-bdab-7e7f9503cd5b', 'displayType': 'qxl', 'cpuUser': '35.65', 'disks': {u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'sda': {'readLatency': '1358467', 'apparentsize': '3221225472', 'writeLatency': '8407020', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'flushLatency': '132876', 'readRate': '3877234.43', 'truesize': '3221225472', 'writeRate': '4527344.31'}}, 'monitorResponse': '0', 'statsAge': '1.73', 'elapsedTime': '10', 'vmType': 'kvm', 'cpuSys': '5.05', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-24 10:31:07,492::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0394767 s, 25.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:31:09,504::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:31:09,579::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034685 s, 29.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:31:10,577::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call vmGetStats with ('6fca7e11-8f3f-4784-bdab-7e7f9503cd5b',) {} >Thread-14::DEBUG::2014-07-24 10:31:10,578::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '23972', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-1911391925401482767', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'clientIp': '10.35.2.195', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:58:22:89', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '6fca7e11-8f3f-4784-bdab-7e7f9503cd5b', 'displayType': 'qxl', 'cpuUser': '35.65', 'disks': {u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'sda': {'readLatency': '1358467', 'apparentsize': '3221225472', 'writeLatency': '8407020', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'flushLatency': '132876', 'readRate': '3877234.43', 'truesize': '3221225472', 'writeRate': '4527344.31'}}, 'monitorResponse': '0', 'statsAge': '0.84', 'elapsedTime': '13', 'vmType': 'kvm', 'cpuSys': '5.05', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-24 10:31:11,591::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:31:11,677::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034101 s, 30.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:31:12,798::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:31:12,798::task::595::TaskManager.Task::(_updateState) Task=`a65124f2-f8fc-4bf5-9d5b-1409a69eb97f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:31:12,798::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:31:12,799::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:31:12,799::task::1185::TaskManager.Task::(prepare) Task=`a65124f2-f8fc-4bf5-9d5b-1409a69eb97f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:31:12,799::task::595::TaskManager.Task::(_updateState) Task=`a65124f2-f8fc-4bf5-9d5b-1409a69eb97f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:31:12,799::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:31:12,799::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:31:12,799::task::990::TaskManager.Task::(_decref) Task=`a65124f2-f8fc-4bf5-9d5b-1409a69eb97f`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:31:12,832::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:31:12,833::task::595::TaskManager.Task::(_updateState) Task=`cbeb07c4-e63b-4b15-9409-c1cff83103dd`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:31:12,833::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:31:12,833::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e45edf22-0e68-4f52-afad-7cbf16fd0f83`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:31:12,833::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:31:12,834::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:31:12,834::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e45edf22-0e68-4f52-afad-7cbf16fd0f83`::Granted request >Thread-34::DEBUG::2014-07-24 10:31:12,834::task::827::TaskManager.Task::(resourceAcquired) Task=`cbeb07c4-e63b-4b15-9409-c1cff83103dd`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:31:12,834::task::990::TaskManager.Task::(_decref) Task=`cbeb07c4-e63b-4b15-9409-c1cff83103dd`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:31:12,835::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:31:12,835::task::1185::TaskManager.Task::(prepare) Task=`cbeb07c4-e63b-4b15-9409-c1cff83103dd`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:31:12,835::task::595::TaskManager.Task::(_updateState) Task=`cbeb07c4-e63b-4b15-9409-c1cff83103dd`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:31:12,836::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:31:12,836::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:31:12,836::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:31:12,836::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:31:12,836::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:31:12,836::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:31:12,837::task::990::TaskManager.Task::(_decref) Task=`cbeb07c4-e63b-4b15-9409-c1cff83103dd`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:31:13,689::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-24 10:31:13,703::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call vmGetStats with ('6fca7e11-8f3f-4784-bdab-7e7f9503cd5b',) {} >Thread-14::DEBUG::2014-07-24 10:31:13,704::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '23972', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-1911391925401482767', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'clientIp': '10.35.2.195', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:58:22:89', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '6fca7e11-8f3f-4784-bdab-7e7f9503cd5b', 'displayType': 'qxl', 'cpuUser': '28.79', 'disks': {u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'sda': {'readLatency': '1358467', 'apparentsize': '3221225472', 'writeLatency': '8407020', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'flushLatency': '132876', 'readRate': '3877234.43', 'truesize': '3221225472', 'writeRate': '4527344.31'}}, 'monitorResponse': '0', 'statsAge': '1.96', 'elapsedTime': '16', 'vmType': 'kvm', 'cpuSys': '23.59', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-24 10:31:13,765::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348971 s, 29.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:31:14,663::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:31:14,671::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000619744 s, 6.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:31:15,777::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:31:15,854::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368799 s, 27.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:31:16,804::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call vmGetStats with ('6fca7e11-8f3f-4784-bdab-7e7f9503cd5b',) {} >Thread-14::DEBUG::2014-07-24 10:31:16,805::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '23972', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-1911391925401482767', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'clientIp': '10.35.2.195', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:58:22:89', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '6fca7e11-8f3f-4784-bdab-7e7f9503cd5b', 'displayType': 'qxl', 'cpuUser': '28.79', 'disks': {u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'sda': {'readLatency': '1358467', 'apparentsize': '3221225472', 'writeLatency': '8407020', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'flushLatency': '132876', 'readRate': '3877234.43', 'truesize': '3221225472', 'writeRate': '4527344.31'}}, 'monitorResponse': '0', 'statsAge': '1.05', 'elapsedTime': '19', 'vmType': 'kvm', 'cpuSys': '23.59', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-24 10:31:17,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:31:17,942::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368133 s, 27.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:31:19,877::task::595::TaskManager.Task::(_updateState) Task=`199770cd-7fbe-498c-bf0a-ca1f1e39aaf8`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:31:19,877::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:31:19,877::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000619744', 'lastCheck': '5.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:31:19,878::task::1185::TaskManager.Task::(prepare) Task=`199770cd-7fbe-498c-bf0a-ca1f1e39aaf8`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000619744', 'lastCheck': '5.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:31:19,878::task::595::TaskManager.Task::(_updateState) Task=`199770cd-7fbe-498c-bf0a-ca1f1e39aaf8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:31:19,878::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:31:19,878::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:31:19,878::task::990::TaskManager.Task::(_decref) Task=`199770cd-7fbe-498c-bf0a-ca1f1e39aaf8`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:31:19,954::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:31:20,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.042824 s, 23.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:31:22,050::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:31:22,122::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341148 s, 30.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:31:22,903::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:31:22,904::task::595::TaskManager.Task::(_updateState) Task=`cfe9f5a6-724e-4962-a43e-074262d204f6`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:31:22,904::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:31:22,904::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:31:22,904::task::1185::TaskManager.Task::(prepare) Task=`cfe9f5a6-724e-4962-a43e-074262d204f6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:31:22,905::task::595::TaskManager.Task::(_updateState) Task=`cfe9f5a6-724e-4962-a43e-074262d204f6`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:31:22,905::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:31:22,905::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:31:22,905::task::990::TaskManager.Task::(_decref) Task=`cfe9f5a6-724e-4962-a43e-074262d204f6`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:31:22,940::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:31:22,940::task::595::TaskManager.Task::(_updateState) Task=`397c5692-ad91-4aa2-91f3-e6f68ea1f953`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:31:22,940::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:31:22,940::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`234311aa-5331-4c39-8e5a-07597152a9ee`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:31:22,941::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:31:22,941::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:31:22,941::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`234311aa-5331-4c39-8e5a-07597152a9ee`::Granted request >Thread-34::DEBUG::2014-07-24 10:31:22,941::task::827::TaskManager.Task::(resourceAcquired) Task=`397c5692-ad91-4aa2-91f3-e6f68ea1f953`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:31:22,942::task::990::TaskManager.Task::(_decref) Task=`397c5692-ad91-4aa2-91f3-e6f68ea1f953`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:31:22,942::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:31:22,942::task::1185::TaskManager.Task::(prepare) Task=`397c5692-ad91-4aa2-91f3-e6f68ea1f953`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:31:22,943::task::595::TaskManager.Task::(_updateState) Task=`397c5692-ad91-4aa2-91f3-e6f68ea1f953`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:31:22,943::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:31:22,943::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:31:22,943::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:31:22,943::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:31:22,943::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:31:22,944::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:31:22,944::task::990::TaskManager.Task::(_decref) Task=`397c5692-ad91-4aa2-91f3-e6f68ea1f953`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:31:23,124::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call vmGetStats with ('6fca7e11-8f3f-4784-bdab-7e7f9503cd5b',) {} >Thread-14::DEBUG::2014-07-24 10:31:23,124::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '23972', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-1911391925401482767', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'clientIp': '10.35.2.195', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:58:22:89', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '6fca7e11-8f3f-4784-bdab-7e7f9503cd5b', 'displayType': 'qxl', 'cpuUser': '28.79', 'disks': {u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'sda': {'readLatency': '1358467', 'apparentsize': '3221225472', 'writeLatency': '8407020', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'flushLatency': '132876', 'readRate': '3877234.43', 'truesize': '3221225472', 'writeRate': '4527344.31'}}, 'monitorResponse': '0', 'statsAge': '1.36', 'elapsedTime': '25', 'vmType': 'kvm', 'cpuSys': '23.59', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-24 10:31:24,135::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:31:24,213::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369172 s, 27.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:31:24,678::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:31:24,704::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0180383 s, 227 kB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:31:25,897::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:31:26,226::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:31:26,305::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0393094 s, 26.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:31:26,318::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call vmGetStats with ('6fca7e11-8f3f-4784-bdab-7e7f9503cd5b',) {} >Thread-14::DEBUG::2014-07-24 10:31:26,319::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '23972', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-1911391925401482767', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'clientIp': '10.35.2.195', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:58:22:89', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '6fca7e11-8f3f-4784-bdab-7e7f9503cd5b', 'displayType': 'qxl', 'cpuUser': '0.40', 'disks': {u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'sda': {'readLatency': '1358467', 'apparentsize': '3221225472', 'writeLatency': '8407020', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'flushLatency': '132876', 'readRate': '3877234.43', 'truesize': '3221225472', 'writeRate': '4527344.31'}}, 'monitorResponse': '0', 'statsAge': '0.55', 'elapsedTime': '29', 'vmType': 'kvm', 'cpuSys': '0.93', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-24 10:31:28,317::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:31:28,394::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0376262 s, 27.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:31:29,429::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call vmGetStats with ('6fca7e11-8f3f-4784-bdab-7e7f9503cd5b',) {} >Thread-14::DEBUG::2014-07-24 10:31:29,430::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '23972', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-1911391925401482767', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'clientIp': '10.35.2.195', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:58:22:89', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '6fca7e11-8f3f-4784-bdab-7e7f9503cd5b', 'displayType': 'qxl', 'cpuUser': '0.40', 'disks': {u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'sda': {'readLatency': '1358467', 'apparentsize': '3221225472', 'writeLatency': '8407020', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'flushLatency': '132876', 'readRate': '3877234.43', 'truesize': '3221225472', 'writeRate': '4527344.31'}}, 'monitorResponse': '0', 'statsAge': '1.65', 'elapsedTime': '32', 'vmType': 'kvm', 'cpuSys': '0.93', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-24 10:31:30,406::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:31:30,481::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359994 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:31:32,493::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-24 10:31:32,527::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call vmGetStats with ('6fca7e11-8f3f-4784-bdab-7e7f9503cd5b',) {} >Thread-14::DEBUG::2014-07-24 10:31:32,529::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '23972', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-1911391925401482767', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'clientIp': '10.35.2.195', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:58:22:89', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '6fca7e11-8f3f-4784-bdab-7e7f9503cd5b', 'displayType': 'qxl', 'cpuUser': '0.40', 'disks': {u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'sda': {'readLatency': '1358467', 'apparentsize': '3221225472', 'writeLatency': '8407020', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'flushLatency': '132876', 'readRate': '3877234.43', 'truesize': '3221225472', 'writeRate': '4527344.31'}}, 'monitorResponse': '0', 'statsAge': '0.74', 'elapsedTime': '35', 'vmType': 'kvm', 'cpuSys': '0.93', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-24 10:31:32,577::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0439526 s, 23.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:31:33,027::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [6674a7d7] >Thread-14::DEBUG::2014-07-24 10:31:33,027::task::595::TaskManager.Task::(_updateState) Task=`0056b296-0695-427e-861f-6cd31fe266d9`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:31:33,028::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:31:33,028::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:31:33,028::task::1185::TaskManager.Task::(prepare) Task=`0056b296-0695-427e-861f-6cd31fe266d9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:31:33,028::task::595::TaskManager.Task::(_updateState) Task=`0056b296-0695-427e-861f-6cd31fe266d9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:31:33,028::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:31:33,029::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:31:33,029::task::990::TaskManager.Task::(_decref) Task=`0056b296-0695-427e-861f-6cd31fe266d9`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:31:33,060::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [6674a7d7] >Thread-34::DEBUG::2014-07-24 10:31:33,060::task::595::TaskManager.Task::(_updateState) Task=`16a68742-3e36-4ecd-97d2-62db02e7f9b6`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:31:33,060::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:31:33,061::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`6fd2fe25-f316-4a88-bc35-ca6b52530944`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:31:33,061::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:31:33,061::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:31:33,061::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`6fd2fe25-f316-4a88-bc35-ca6b52530944`::Granted request >Thread-34::DEBUG::2014-07-24 10:31:33,062::task::827::TaskManager.Task::(resourceAcquired) Task=`16a68742-3e36-4ecd-97d2-62db02e7f9b6`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:31:33,062::task::990::TaskManager.Task::(_decref) Task=`16a68742-3e36-4ecd-97d2-62db02e7f9b6`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:31:33,062::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:31:33,063::task::1185::TaskManager.Task::(prepare) Task=`16a68742-3e36-4ecd-97d2-62db02e7f9b6`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:31:33,063::task::595::TaskManager.Task::(_updateState) Task=`16a68742-3e36-4ecd-97d2-62db02e7f9b6`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:31:33,063::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:31:33,063::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:31:33,063::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:31:33,064::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:31:33,064::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:31:33,064::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:31:33,064::task::990::TaskManager.Task::(_decref) Task=`16a68742-3e36-4ecd-97d2-62db02e7f9b6`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:31:34,589::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:31:34,663::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034373 s, 29.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:31:34,709::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:31:34,734::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000751029 s, 5.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:31:35,604::task::595::TaskManager.Task::(_updateState) Task=`af2f9da0-dab7-4176-a5cf-1db509c05821`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:31:35,612::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:31:35,612::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000751029', 'lastCheck': '0.9', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:31:35,612::task::1185::TaskManager.Task::(prepare) Task=`af2f9da0-dab7-4176-a5cf-1db509c05821`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000751029', 'lastCheck': '0.9', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:31:35,613::task::595::TaskManager.Task::(_updateState) Task=`af2f9da0-dab7-4176-a5cf-1db509c05821`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:31:35,613::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:31:35,613::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:31:35,613::task::990::TaskManager.Task::(_decref) Task=`af2f9da0-dab7-4176-a5cf-1db509c05821`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:31:36,675::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:31:36,759::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.044951 s, 22.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:31:38,771::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:31:38,862::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.045553 s, 22.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:31:38,894::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call vmGetStats with ('6fca7e11-8f3f-4784-bdab-7e7f9503cd5b',) {} >Thread-14::DEBUG::2014-07-24 10:31:38,895::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '23972', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-1911391925401482767', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'clientIp': '10.35.2.195', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:58:22:89', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '6fca7e11-8f3f-4784-bdab-7e7f9503cd5b', 'displayType': 'qxl', 'cpuUser': '0.40', 'disks': {u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'sda': {'readLatency': '1358467', 'apparentsize': '3221225472', 'writeLatency': '8407020', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'flushLatency': '132876', 'readRate': '3877234.43', 'truesize': '3221225472', 'writeRate': '4527344.31'}}, 'monitorResponse': '0', 'statsAge': '1.10', 'elapsedTime': '41', 'vmType': 'kvm', 'cpuSys': '0.93', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-24 10:31:40,874::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:31:40,968::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0529288 s, 19.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:31:42,042::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call vmGetStats with ('6fca7e11-8f3f-4784-bdab-7e7f9503cd5b',) {} flowID [22918c4c] >Thread-14::DEBUG::2014-07-24 10:31:42,043::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '23972', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-1911391925401482767', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'clientIp': '10.35.2.195', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:58:22:89', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '6fca7e11-8f3f-4784-bdab-7e7f9503cd5b', 'displayType': 'qxl', 'cpuUser': '37.75', 'disks': {u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'sda': {'readLatency': '1358467', 'apparentsize': '3221225472', 'writeLatency': '8407020', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'flushLatency': '132876', 'readRate': '3877234.43', 'truesize': '3221225472', 'writeRate': '4527344.31'}}, 'monitorResponse': '0', 'statsAge': '0.22', 'elapsedTime': '44', 'vmType': 'kvm', 'cpuSys': '25.93', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-24 10:31:42,979::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-24 10:31:43,125::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:31:43,125::task::595::TaskManager.Task::(_updateState) Task=`6e439747-9948-4455-bdc7-8bb145a6fe34`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:31:43,125::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:31:43,126::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:31:43,126::task::1185::TaskManager.Task::(prepare) Task=`6e439747-9948-4455-bdc7-8bb145a6fe34`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:31:43,126::task::595::TaskManager.Task::(_updateState) Task=`6e439747-9948-4455-bdc7-8bb145a6fe34`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:31:43,127::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:31:43,127::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:31:43,127::task::990::TaskManager.Task::(_decref) Task=`6e439747-9948-4455-bdc7-8bb145a6fe34`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:31:43,198::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:31:43,199::task::595::TaskManager.Task::(_updateState) Task=`32d019f2-466e-41e5-8fc3-638466ad3e7e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:31:43,199::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:31:43,199::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`6d14a99f-f838-49b4-b4f0-bc57c40685a9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:31:43,200::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:31:43,200::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:31:43,200::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`6d14a99f-f838-49b4-b4f0-bc57c40685a9`::Granted request >Thread-34::DEBUG::2014-07-24 10:31:43,200::task::827::TaskManager.Task::(resourceAcquired) Task=`32d019f2-466e-41e5-8fc3-638466ad3e7e`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:31:43,201::task::990::TaskManager.Task::(_decref) Task=`32d019f2-466e-41e5-8fc3-638466ad3e7e`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:31:43,201::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:31:43,201::task::1185::TaskManager.Task::(prepare) Task=`32d019f2-466e-41e5-8fc3-638466ad3e7e`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:31:43,202::task::595::TaskManager.Task::(_updateState) Task=`32d019f2-466e-41e5-8fc3-638466ad3e7e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:31:43,202::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:31:43,202::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:31:43,202::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:31:43,202::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:31:43,202::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:31:43,203::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:31:43,203::task::990::TaskManager.Task::(_decref) Task=`32d019f2-466e-41e5-8fc3-638466ad3e7e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:31:43,339::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.321026 s, 3.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:31:44,742::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:31:44,762::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0119059 s, 344 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:31:45,156::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call vmGetStats with ('6fca7e11-8f3f-4784-bdab-7e7f9503cd5b',) {} >Thread-14::DEBUG::2014-07-24 10:31:45,156::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '23972', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-1911391925401482767', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'clientIp': '10.35.2.195', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:58:22:89', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '6fca7e11-8f3f-4784-bdab-7e7f9503cd5b', 'displayType': 'qxl', 'cpuUser': '37.75', 'disks': {u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'sda': {'readLatency': '1358467', 'apparentsize': '3221225472', 'writeLatency': '8407020', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'flushLatency': '132876', 'readRate': '3877234.43', 'truesize': '3221225472', 'writeRate': '4527344.31'}}, 'monitorResponse': '0', 'statsAge': '1.33', 'elapsedTime': '47', 'vmType': 'kvm', 'cpuSys': '25.93', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-24 10:31:45,351::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:31:45,426::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351687 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:31:47,438::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:31:47,513::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036232 s, 28.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:31:48,288::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call vmGetStats with ('6fca7e11-8f3f-4784-bdab-7e7f9503cd5b',) {} >Thread-14::DEBUG::2014-07-24 10:31:48,289::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '23972', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-1911391925401482767', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'clientIp': '10.35.2.195', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:58:22:89', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '6fca7e11-8f3f-4784-bdab-7e7f9503cd5b', 'displayType': 'qxl', 'cpuUser': '37.75', 'disks': {u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'sda': {'readLatency': '1358467', 'apparentsize': '3221225472', 'writeLatency': '8407020', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'flushLatency': '132876', 'readRate': '3877234.43', 'truesize': '3221225472', 'writeRate': '4527344.31'}}, 'monitorResponse': '0', 'statsAge': '0.45', 'elapsedTime': '51', 'vmType': 'kvm', 'cpuSys': '25.93', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-24 10:31:49,526::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:31:49,617::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.041049 s, 24.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:31:51,365::task::595::TaskManager.Task::(_updateState) Task=`94002566-1784-4164-98b8-9096a5bcce8c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:31:51,366::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:31:51,366::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0119059', 'lastCheck': '6.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:31:51,366::task::1185::TaskManager.Task::(prepare) Task=`94002566-1784-4164-98b8-9096a5bcce8c`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0119059', 'lastCheck': '6.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:31:51,366::task::595::TaskManager.Task::(_updateState) Task=`94002566-1784-4164-98b8-9096a5bcce8c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:31:51,366::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:31:51,366::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:31:51,367::task::990::TaskManager.Task::(_decref) Task=`94002566-1784-4164-98b8-9096a5bcce8c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:31:51,630::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:31:51,710::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0398331 s, 25.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:31:53,265::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:31:53,266::task::595::TaskManager.Task::(_updateState) Task=`005c263f-f965-46ca-9004-a9453521d66b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:31:53,266::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:31:53,266::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:31:53,267::task::1185::TaskManager.Task::(prepare) Task=`005c263f-f965-46ca-9004-a9453521d66b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:31:53,267::task::595::TaskManager.Task::(_updateState) Task=`005c263f-f965-46ca-9004-a9453521d66b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:31:53,267::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:31:53,267::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:31:53,267::task::990::TaskManager.Task::(_decref) Task=`005c263f-f965-46ca-9004-a9453521d66b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:31:53,340::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:31:53,340::task::595::TaskManager.Task::(_updateState) Task=`bceb42d9-cee4-4db2-8f0c-bf100113bcb0`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:31:53,341::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:31:53,341::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4b3ea379-7d18-443f-a537-26fe5b14a125`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:31:53,341::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:31:53,341::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:31:53,342::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4b3ea379-7d18-443f-a537-26fe5b14a125`::Granted request >Thread-34::DEBUG::2014-07-24 10:31:53,342::task::827::TaskManager.Task::(resourceAcquired) Task=`bceb42d9-cee4-4db2-8f0c-bf100113bcb0`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:31:53,342::task::990::TaskManager.Task::(_decref) Task=`bceb42d9-cee4-4db2-8f0c-bf100113bcb0`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:31:53,343::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:31:53,343::task::1185::TaskManager.Task::(prepare) Task=`bceb42d9-cee4-4db2-8f0c-bf100113bcb0`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:31:53,343::task::595::TaskManager.Task::(_updateState) Task=`bceb42d9-cee4-4db2-8f0c-bf100113bcb0`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:31:53,343::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:31:53,343::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:31:53,344::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:31:53,344::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:31:53,344::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:31:53,344::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:31:53,344::task::990::TaskManager.Task::(_decref) Task=`bceb42d9-cee4-4db2-8f0c-bf100113bcb0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:31:53,722::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:31:53,825::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0424208 s, 24.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:31:54,616::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call vmGetStats with ('6fca7e11-8f3f-4784-bdab-7e7f9503cd5b',) {} flowID [12b68a95] >Thread-14::DEBUG::2014-07-24 10:31:54,617::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'RebootInProgress', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '23972', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-1911391925401482767', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'clientIp': '10.35.2.195', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:58:22:89', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '6fca7e11-8f3f-4784-bdab-7e7f9503cd5b', 'displayType': 'qxl', 'cpuUser': '37.75', 'disks': {u'hdc': {'readLatency': '0', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '0.00', 'truesize': '0', 'writeRate': '0.00'}, u'sda': {'readLatency': '1358467', 'apparentsize': '3221225472', 'writeLatency': '8407020', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'flushLatency': '132876', 'readRate': '3877234.43', 'truesize': '3221225472', 'writeRate': '4527344.31'}}, 'monitorResponse': '0', 'statsAge': '0.77', 'elapsedTime': '57', 'vmType': 'kvm', 'cpuSys': '25.93', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-18::DEBUG::2014-07-24 10:31:54,767::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:31:54,788::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0123342 s, 332 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:31:55,838::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-37::DEBUG::2014-07-24 10:31:55,859::task::595::TaskManager.Task::(_updateState) Task=`f4988fa4-639d-4457-96c8-8398e776faa9`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 10:31:55,859::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 10:31:55,860::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:31:55,860::task::1185::TaskManager.Task::(prepare) Task=`f4988fa4-639d-4457-96c8-8398e776faa9`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:31:55,861::task::595::TaskManager.Task::(_updateState) Task=`f4988fa4-639d-4457-96c8-8398e776faa9`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 10:31:55,861::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 10:31:55,861::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 10:31:55,861::task::990::TaskManager.Task::(_decref) Task=`f4988fa4-639d-4457-96c8-8398e776faa9`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:31:55,925::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0474849 s, 21.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:31:55,935::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-14::DEBUG::2014-07-24 10:31:57,716::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call vmGetStats with ('6fca7e11-8f3f-4784-bdab-7e7f9503cd5b',) {} >Thread-14::DEBUG::2014-07-24 10:31:57,716::BindingXMLRPC::1074::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '23972', 'displayIp': '0', 'displayPort': u'5900', 'session': 'Unknown', 'displaySecurePort': u'5901', 'timeOffset': '0', 'hash': '-1911391925401482767', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '1048576', 'balloon_cur': '1048576', 'balloon_min': '1048576'}, 'clientIp': '10.35.2.195', 'kvmEnable': 'true', 'network': {u'vnet0': {'macAddr': '00:1a:4a:58:22:89', 'rxDropped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet0'}}, 'vmId': '6fca7e11-8f3f-4784-bdab-7e7f9503cd5b', 'displayType': 'qxl', 'cpuUser': '26.70', 'disks': {u'hdc': {'readLatency': '4233', 'apparentsize': '0', 'writeLatency': '0', 'flushLatency': '0', 'readRate': '3.39', 'truesize': '0', 'writeRate': '0.00'}, u'sda': {'readLatency': '2216956', 'apparentsize': '3221225472', 'writeLatency': '1352426', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'flushLatency': '223909', 'readRate': '1375133.88', 'truesize': '3221225472', 'writeRate': '13376.01'}}, 'monitorResponse': '0', 'statsAge': '1.86', 'elapsedTime': '60', 'vmType': 'kvm', 'cpuSys': '4.78', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Dummy-33::DEBUG::2014-07-24 10:31:57,939::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:31:58,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343902 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:32:00,027::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:32:00,115::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.045371 s, 22.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:32:02,128::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:32:02,203::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356514 s, 28.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:32:03,401::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:32:03,402::task::595::TaskManager.Task::(_updateState) Task=`b116fc20-558b-4177-9760-d264b4e9e411`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:32:03,402::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:32:03,403::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:32:03,403::task::1185::TaskManager.Task::(prepare) Task=`b116fc20-558b-4177-9760-d264b4e9e411`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:32:03,403::task::595::TaskManager.Task::(_updateState) Task=`b116fc20-558b-4177-9760-d264b4e9e411`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:32:03,403::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:32:03,403::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:32:03,403::task::990::TaskManager.Task::(_decref) Task=`b116fc20-558b-4177-9760-d264b4e9e411`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:32:03,435::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:32:03,435::task::595::TaskManager.Task::(_updateState) Task=`c6140749-2f87-4b6b-a6c5-48ab8e287ec0`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:32:03,435::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:32:03,436::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7fd63931-9866-442c-8fec-2dfd2df77082`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:32:03,436::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:32:03,436::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:32:03,437::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7fd63931-9866-442c-8fec-2dfd2df77082`::Granted request >Thread-34::DEBUG::2014-07-24 10:32:03,437::task::827::TaskManager.Task::(resourceAcquired) Task=`c6140749-2f87-4b6b-a6c5-48ab8e287ec0`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:32:03,437::task::990::TaskManager.Task::(_decref) Task=`c6140749-2f87-4b6b-a6c5-48ab8e287ec0`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:32:03,438::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:32:03,438::task::1185::TaskManager.Task::(prepare) Task=`c6140749-2f87-4b6b-a6c5-48ab8e287ec0`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:32:03,438::task::595::TaskManager.Task::(_updateState) Task=`c6140749-2f87-4b6b-a6c5-48ab8e287ec0`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:32:03,438::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:32:03,438::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:32:03,439::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:32:03,439::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:32:03,439::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:32:03,439::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:32:03,439::task::990::TaskManager.Task::(_decref) Task=`c6140749-2f87-4b6b-a6c5-48ab8e287ec0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:32:04,216::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:32:04,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349451 s, 29.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:32:04,793::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:32:04,813::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0117419 s, 349 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:32:06,302::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:32:06,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359824 s, 28.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:32:06,929::task::595::TaskManager.Task::(_updateState) Task=`8910a86c-7816-4a1e-9973-1977bc618175`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:32:06,929::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:32:06,929::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0117419', 'lastCheck': '2.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:32:06,929::task::1185::TaskManager.Task::(prepare) Task=`8910a86c-7816-4a1e-9973-1977bc618175`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0117419', 'lastCheck': '2.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:32:06,930::task::595::TaskManager.Task::(_updateState) Task=`8910a86c-7816-4a1e-9973-1977bc618175`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:32:06,930::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:32:06,930::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:32:06,930::task::990::TaskManager.Task::(_decref) Task=`8910a86c-7816-4a1e-9973-1977bc618175`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:32:08,389::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:32:08,463::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355383 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:32:10,476::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:32:10,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336167 s, 30.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:32:12,562::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:32:12,914::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.312973 s, 3.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:32:13,494::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:32:13,495::task::595::TaskManager.Task::(_updateState) Task=`734e51d4-8606-430a-bc05-158a37150037`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:32:13,495::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:32:13,495::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:32:13,496::task::1185::TaskManager.Task::(prepare) Task=`734e51d4-8606-430a-bc05-158a37150037`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:32:13,496::task::595::TaskManager.Task::(_updateState) Task=`734e51d4-8606-430a-bc05-158a37150037`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:32:13,496::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:32:13,496::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:32:13,496::task::990::TaskManager.Task::(_decref) Task=`734e51d4-8606-430a-bc05-158a37150037`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:32:13,528::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:32:13,528::task::595::TaskManager.Task::(_updateState) Task=`dee23d93-3fe9-4f7f-a9ab-4b87a3834a1a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:32:13,528::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:32:13,530::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`410ae45a-766d-415e-8ed1-574157e6821f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:32:13,530::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:32:13,530::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:32:13,530::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`410ae45a-766d-415e-8ed1-574157e6821f`::Granted request >Thread-34::DEBUG::2014-07-24 10:32:13,531::task::827::TaskManager.Task::(resourceAcquired) Task=`dee23d93-3fe9-4f7f-a9ab-4b87a3834a1a`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:32:13,531::task::990::TaskManager.Task::(_decref) Task=`dee23d93-3fe9-4f7f-a9ab-4b87a3834a1a`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:32:13,531::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:32:13,532::task::1185::TaskManager.Task::(prepare) Task=`dee23d93-3fe9-4f7f-a9ab-4b87a3834a1a`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:32:13,532::task::595::TaskManager.Task::(_updateState) Task=`dee23d93-3fe9-4f7f-a9ab-4b87a3834a1a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:32:13,532::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:32:13,532::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:32:13,532::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:32:13,533::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:32:13,533::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:32:13,533::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:32:13,533::task::990::TaskManager.Task::(_decref) Task=`dee23d93-3fe9-4f7f-a9ab-4b87a3834a1a`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 10:32:14,818::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:32:14,827::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000765337 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:32:14,927::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:32:15,036::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0698379 s, 14.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:32:17,049::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:32:17,121::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335961 s, 30.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:32:19,133::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:32:19,208::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359411 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:32:21,220::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:32:21,295::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035055 s, 29.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:32:22,443::task::595::TaskManager.Task::(_updateState) Task=`9f1a464f-5fd5-4acf-9ad5-30e4fc615761`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:32:22,443::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:32:22,443::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000765337', 'lastCheck': '7.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:32:22,444::task::1185::TaskManager.Task::(prepare) Task=`9f1a464f-5fd5-4acf-9ad5-30e4fc615761`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000765337', 'lastCheck': '7.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:32:22,444::task::595::TaskManager.Task::(_updateState) Task=`9f1a464f-5fd5-4acf-9ad5-30e4fc615761`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:32:22,444::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:32:22,444::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:32:22,444::task::990::TaskManager.Task::(_decref) Task=`9f1a464f-5fd5-4acf-9ad5-30e4fc615761`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:32:23,307::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:32:23,382::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361431 s, 28.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:32:23,588::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:32:23,588::task::595::TaskManager.Task::(_updateState) Task=`b8194786-a55d-4d5e-8b5d-c21996913427`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:32:23,589::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:32:23,589::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:32:23,589::task::1185::TaskManager.Task::(prepare) Task=`b8194786-a55d-4d5e-8b5d-c21996913427`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:32:23,589::task::595::TaskManager.Task::(_updateState) Task=`b8194786-a55d-4d5e-8b5d-c21996913427`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:32:23,590::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:32:23,590::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:32:23,590::task::990::TaskManager.Task::(_decref) Task=`b8194786-a55d-4d5e-8b5d-c21996913427`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:32:23,622::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:32:23,622::task::595::TaskManager.Task::(_updateState) Task=`4a4059a7-3f1f-4726-a7d2-de8bcc9c863c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:32:23,623::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:32:23,623::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1e29e103-8910-404d-943f-2313356aeb52`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:32:23,623::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:32:23,623::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:32:23,624::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1e29e103-8910-404d-943f-2313356aeb52`::Granted request >Thread-34::DEBUG::2014-07-24 10:32:23,624::task::827::TaskManager.Task::(resourceAcquired) Task=`4a4059a7-3f1f-4726-a7d2-de8bcc9c863c`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:32:23,624::task::990::TaskManager.Task::(_decref) Task=`4a4059a7-3f1f-4726-a7d2-de8bcc9c863c`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:32:23,625::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:32:23,625::task::1185::TaskManager.Task::(prepare) Task=`4a4059a7-3f1f-4726-a7d2-de8bcc9c863c`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:32:23,625::task::595::TaskManager.Task::(_updateState) Task=`4a4059a7-3f1f-4726-a7d2-de8bcc9c863c`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:32:23,625::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:32:23,625::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:32:23,626::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:32:23,626::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:32:23,626::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:32:23,626::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:32:23,626::task::990::TaskManager.Task::(_decref) Task=`4a4059a7-3f1f-4726-a7d2-de8bcc9c863c`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 10:32:24,832::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:32:24,841::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000699265 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:32:25,394::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:32:25,471::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344688 s, 29.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:32:25,973::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:32:27,485::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:32:27,558::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343395 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:32:29,570::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:32:29,644::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347599 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:32:31,656::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:32:31,730::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345214 s, 29.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:32:33,691::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:32:33,692::task::595::TaskManager.Task::(_updateState) Task=`e672dba1-b071-4b83-84ed-e9cb201d8a41`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:32:33,692::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:32:33,692::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:32:33,692::task::1185::TaskManager.Task::(prepare) Task=`e672dba1-b071-4b83-84ed-e9cb201d8a41`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:32:33,693::task::595::TaskManager.Task::(_updateState) Task=`e672dba1-b071-4b83-84ed-e9cb201d8a41`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:32:33,693::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:32:33,693::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:32:33,693::task::990::TaskManager.Task::(_decref) Task=`e672dba1-b071-4b83-84ed-e9cb201d8a41`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:32:33,735::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:32:33,735::task::595::TaskManager.Task::(_updateState) Task=`4b0ce419-b772-4e23-a08f-96d7c5be84f4`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:32:33,735::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:32:33,735::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1f3b2b5d-c2ad-4b4f-a1a9-669953bb21b6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:32:33,736::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:32:33,736::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:32:33,736::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1f3b2b5d-c2ad-4b4f-a1a9-669953bb21b6`::Granted request >Thread-34::DEBUG::2014-07-24 10:32:33,736::task::827::TaskManager.Task::(resourceAcquired) Task=`4b0ce419-b772-4e23-a08f-96d7c5be84f4`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:32:33,737::task::990::TaskManager.Task::(_decref) Task=`4b0ce419-b772-4e23-a08f-96d7c5be84f4`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:32:33,737::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:32:33,737::task::1185::TaskManager.Task::(prepare) Task=`4b0ce419-b772-4e23-a08f-96d7c5be84f4`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:32:33,738::task::595::TaskManager.Task::(_updateState) Task=`4b0ce419-b772-4e23-a08f-96d7c5be84f4`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:32:33,738::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:32:33,738::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:32:33,738::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:32:33,738::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:32:33,738::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:32:33,739::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:32:33,739::task::990::TaskManager.Task::(_decref) Task=`4b0ce419-b772-4e23-a08f-96d7c5be84f4`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:32:33,747::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:32:33,957::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.150227 s, 6.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:32:34,846::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:32:34,855::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000806367 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:32:35,970::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:32:36,045::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362518 s, 28.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:32:37,820::task::595::TaskManager.Task::(_updateState) Task=`65dfd7ba-2641-4cd3-8d72-46326c70bca4`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:32:37,821::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:32:37,821::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000806367', 'lastCheck': '3.0', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:32:37,821::task::1185::TaskManager.Task::(prepare) Task=`65dfd7ba-2641-4cd3-8d72-46326c70bca4`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000806367', 'lastCheck': '3.0', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:32:37,821::task::595::TaskManager.Task::(_updateState) Task=`65dfd7ba-2641-4cd3-8d72-46326c70bca4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:32:37,821::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:32:37,821::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:32:37,822::task::990::TaskManager.Task::(_decref) Task=`65dfd7ba-2641-4cd3-8d72-46326c70bca4`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:32:38,057::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:32:38,133::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368333 s, 27.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:32:40,145::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:32:40,223::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379404 s, 27.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:32:42,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:32:42,313::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0380933 s, 26.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:32:43,798::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:32:43,798::task::595::TaskManager.Task::(_updateState) Task=`dbddd5b4-ce7b-468b-a210-7f74f7b5e22b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:32:43,798::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:32:43,799::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:32:43,799::task::1185::TaskManager.Task::(prepare) Task=`dbddd5b4-ce7b-468b-a210-7f74f7b5e22b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:32:43,799::task::595::TaskManager.Task::(_updateState) Task=`dbddd5b4-ce7b-468b-a210-7f74f7b5e22b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:32:43,799::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:32:43,799::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:32:43,799::task::990::TaskManager.Task::(_decref) Task=`dbddd5b4-ce7b-468b-a210-7f74f7b5e22b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:32:43,836::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:32:43,836::task::595::TaskManager.Task::(_updateState) Task=`7040a4e4-aae1-466c-98fe-dddf30be7712`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:32:43,836::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:32:43,837::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`bce609be-5df5-4e0b-b87d-57dd6be8219e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:32:43,837::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:32:43,837::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:32:43,837::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`bce609be-5df5-4e0b-b87d-57dd6be8219e`::Granted request >Thread-34::DEBUG::2014-07-24 10:32:43,838::task::827::TaskManager.Task::(resourceAcquired) Task=`7040a4e4-aae1-466c-98fe-dddf30be7712`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:32:43,838::task::990::TaskManager.Task::(_decref) Task=`7040a4e4-aae1-466c-98fe-dddf30be7712`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:32:43,839::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:32:43,839::task::1185::TaskManager.Task::(prepare) Task=`7040a4e4-aae1-466c-98fe-dddf30be7712`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:32:43,839::task::595::TaskManager.Task::(_updateState) Task=`7040a4e4-aae1-466c-98fe-dddf30be7712`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:32:43,839::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:32:43,839::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:32:43,840::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:32:43,840::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:32:43,840::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:32:43,840::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:32:43,840::task::990::TaskManager.Task::(_decref) Task=`7040a4e4-aae1-466c-98fe-dddf30be7712`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:32:44,325::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:32:44,401::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363431 s, 28.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:32:44,860::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:32:44,880::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0110577 s, 370 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:32:46,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:32:46,491::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353415 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:32:48,503::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:32:48,578::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353843 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:32:50,590::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:32:50,666::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363106 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:32:52,678::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:32:52,752::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346327 s, 29.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:32:53,235::task::595::TaskManager.Task::(_updateState) Task=`0a805db5-6ed4-4855-abf4-ca6831f5bea5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:32:53,235::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:32:53,235::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0110577', 'lastCheck': '8.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:32:53,235::task::1185::TaskManager.Task::(prepare) Task=`0a805db5-6ed4-4855-abf4-ca6831f5bea5`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0110577', 'lastCheck': '8.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:32:53,235::task::595::TaskManager.Task::(_updateState) Task=`0a805db5-6ed4-4855-abf4-ca6831f5bea5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:32:53,236::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:32:53,236::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:32:53,236::task::990::TaskManager.Task::(_decref) Task=`0a805db5-6ed4-4855-abf4-ca6831f5bea5`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:32:53,900::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [5176ccd6] >Thread-14::DEBUG::2014-07-24 10:32:53,900::task::595::TaskManager.Task::(_updateState) Task=`14b7ab9b-c169-4881-9ac7-03cfb1a26774`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:32:53,900::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:32:53,900::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:32:53,900::task::1185::TaskManager.Task::(prepare) Task=`14b7ab9b-c169-4881-9ac7-03cfb1a26774`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:32:53,901::task::595::TaskManager.Task::(_updateState) Task=`14b7ab9b-c169-4881-9ac7-03cfb1a26774`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:32:53,901::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:32:53,901::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:32:53,901::task::990::TaskManager.Task::(_decref) Task=`14b7ab9b-c169-4881-9ac7-03cfb1a26774`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:32:53,933::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [5176ccd6] >Thread-34::DEBUG::2014-07-24 10:32:53,934::task::595::TaskManager.Task::(_updateState) Task=`454521e9-04e2-493e-8726-728c5f35ec60`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:32:53,936::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:32:53,939::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`fea45550-94bf-4d03-adb9-ac136f6dd985`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:32:53,940::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:32:53,942::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:32:53,943::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`fea45550-94bf-4d03-adb9-ac136f6dd985`::Granted request >Thread-34::DEBUG::2014-07-24 10:32:53,945::task::827::TaskManager.Task::(resourceAcquired) Task=`454521e9-04e2-493e-8726-728c5f35ec60`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:32:53,947::task::990::TaskManager.Task::(_decref) Task=`454521e9-04e2-493e-8726-728c5f35ec60`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:32:53,952::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:32:53,953::task::1185::TaskManager.Task::(prepare) Task=`454521e9-04e2-493e-8726-728c5f35ec60`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:32:53,954::task::595::TaskManager.Task::(_updateState) Task=`454521e9-04e2-493e-8726-728c5f35ec60`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:32:53,955::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:32:53,956::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:32:53,958::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:32:53,959::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:32:53,960::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:32:53,961::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:32:53,963::task::990::TaskManager.Task::(_decref) Task=`454521e9-04e2-493e-8726-728c5f35ec60`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:32:54,764::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:32:54,838::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349784 s, 29.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:32:54,885::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:32:54,894::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000713727 s, 5.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:32:56,007::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-37::DEBUG::2014-07-24 10:32:56,022::task::595::TaskManager.Task::(_updateState) Task=`e25bda07-9a59-433d-824b-06e992ef0451`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 10:32:56,022::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 10:32:56,022::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:32:56,023::task::1185::TaskManager.Task::(prepare) Task=`e25bda07-9a59-433d-824b-06e992ef0451`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:32:56,023::task::595::TaskManager.Task::(_updateState) Task=`e25bda07-9a59-433d-824b-06e992ef0451`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 10:32:56,023::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 10:32:56,023::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 10:32:56,023::task::990::TaskManager.Task::(_decref) Task=`e25bda07-9a59-433d-824b-06e992ef0451`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:32:56,850::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:32:56,926::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362897 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:32:58,938::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:32:59,013::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352236 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:33:01,025::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:33:01,101::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352807 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:33:03,114::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:33:03,189::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357196 s, 28.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:33:04,028::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:33:04,029::task::595::TaskManager.Task::(_updateState) Task=`4cc72d90-eb00-4517-a1af-18a5e7f5b842`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:33:04,029::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:33:04,030::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:33:04,030::task::1185::TaskManager.Task::(prepare) Task=`4cc72d90-eb00-4517-a1af-18a5e7f5b842`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:33:04,030::task::595::TaskManager.Task::(_updateState) Task=`4cc72d90-eb00-4517-a1af-18a5e7f5b842`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:33:04,030::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:33:04,031::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:33:04,031::task::990::TaskManager.Task::(_decref) Task=`4cc72d90-eb00-4517-a1af-18a5e7f5b842`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:33:04,125::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:33:04,126::task::595::TaskManager.Task::(_updateState) Task=`275cbc8c-bb6a-4669-8d2d-bd1269251509`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:33:04,126::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:33:04,126::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`51038e64-a0c5-43c6-a630-79c14e8772fc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:33:04,126::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:33:04,127::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:33:04,127::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`51038e64-a0c5-43c6-a630-79c14e8772fc`::Granted request >Thread-34::DEBUG::2014-07-24 10:33:04,127::task::827::TaskManager.Task::(resourceAcquired) Task=`275cbc8c-bb6a-4669-8d2d-bd1269251509`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:33:04,127::task::990::TaskManager.Task::(_decref) Task=`275cbc8c-bb6a-4669-8d2d-bd1269251509`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:33:04,128::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:33:04,128::task::1185::TaskManager.Task::(prepare) Task=`275cbc8c-bb6a-4669-8d2d-bd1269251509`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:33:04,128::task::595::TaskManager.Task::(_updateState) Task=`275cbc8c-bb6a-4669-8d2d-bd1269251509`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:33:04,129::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:33:04,129::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:33:04,129::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:33:04,129::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:33:04,129::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:33:04,129::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:33:04,130::task::990::TaskManager.Task::(_decref) Task=`275cbc8c-bb6a-4669-8d2d-bd1269251509`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 10:33:04,899::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:33:04,923::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0148499 s, 276 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:33:05,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:33:05,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033753 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:33:07,287::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:33:07,361::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344147 s, 29.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:33:08,589::task::595::TaskManager.Task::(_updateState) Task=`8864be2d-f1d5-46c1-bdc6-41183fef9dce`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:33:08,589::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:33:08,589::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0148499', 'lastCheck': '3.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:33:08,589::task::1185::TaskManager.Task::(prepare) Task=`8864be2d-f1d5-46c1-bdc6-41183fef9dce`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0148499', 'lastCheck': '3.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:33:08,589::task::595::TaskManager.Task::(_updateState) Task=`8864be2d-f1d5-46c1-bdc6-41183fef9dce`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:33:08,590::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:33:08,590::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:33:08,590::task::990::TaskManager.Task::(_decref) Task=`8864be2d-f1d5-46c1-bdc6-41183fef9dce`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:33:09,374::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:33:09,470::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0417869 s, 24.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:33:11,483::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:33:11,556::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338573 s, 30.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:33:13,568::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:33:13,642::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344311 s, 29.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:33:14,191::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:33:14,191::task::595::TaskManager.Task::(_updateState) Task=`fa0b36d2-5210-49bc-a4e6-738b8895d130`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:33:14,192::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:33:14,192::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:33:14,192::task::1185::TaskManager.Task::(prepare) Task=`fa0b36d2-5210-49bc-a4e6-738b8895d130`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:33:14,192::task::595::TaskManager.Task::(_updateState) Task=`fa0b36d2-5210-49bc-a4e6-738b8895d130`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:33:14,193::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:33:14,193::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:33:14,193::task::990::TaskManager.Task::(_decref) Task=`fa0b36d2-5210-49bc-a4e6-738b8895d130`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:33:14,236::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:33:14,236::task::595::TaskManager.Task::(_updateState) Task=`e6c74f7d-75a7-40a2-b1ed-761fd44d17f8`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:33:14,237::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:33:14,237::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`532164dc-5d24-4c99-a39d-a557988b98a9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:33:14,237::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:33:14,237::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:33:14,238::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`532164dc-5d24-4c99-a39d-a557988b98a9`::Granted request >Thread-34::DEBUG::2014-07-24 10:33:14,238::task::827::TaskManager.Task::(resourceAcquired) Task=`e6c74f7d-75a7-40a2-b1ed-761fd44d17f8`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:33:14,238::task::990::TaskManager.Task::(_decref) Task=`e6c74f7d-75a7-40a2-b1ed-761fd44d17f8`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:33:14,239::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:33:14,239::task::1185::TaskManager.Task::(prepare) Task=`e6c74f7d-75a7-40a2-b1ed-761fd44d17f8`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:33:14,239::task::595::TaskManager.Task::(_updateState) Task=`e6c74f7d-75a7-40a2-b1ed-761fd44d17f8`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:33:14,239::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:33:14,240::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:33:14,240::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:33:14,240::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:33:14,240::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:33:14,240::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:33:14,240::task::990::TaskManager.Task::(_decref) Task=`e6c74f7d-75a7-40a2-b1ed-761fd44d17f8`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 10:33:14,928::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:33:14,937::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000753499 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:33:15,654::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:33:15,728::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348682 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:33:17,740::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:33:17,816::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361597 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:33:19,828::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:33:19,902::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347898 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:33:21,915::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:33:21,988::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343169 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:33:24,001::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-24 10:33:24,020::task::595::TaskManager.Task::(_updateState) Task=`922a22ee-bc9f-43ce-ac1c-8d442ae15921`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:33:24,022::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:33:24,023::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000753499', 'lastCheck': '9.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:33:24,024::task::1185::TaskManager.Task::(prepare) Task=`922a22ee-bc9f-43ce-ac1c-8d442ae15921`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000753499', 'lastCheck': '9.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:33:24,025::task::595::TaskManager.Task::(_updateState) Task=`922a22ee-bc9f-43ce-ac1c-8d442ae15921`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:33:24,026::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:33:24,027::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:33:24,028::task::990::TaskManager.Task::(_decref) Task=`922a22ee-bc9f-43ce-ac1c-8d442ae15921`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:33:24,324::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [4376fa5] >Thread-14::DEBUG::2014-07-24 10:33:24,328::task::595::TaskManager.Task::(_updateState) Task=`9cc4b68f-5381-4e68-88b6-2c2c963f65a2`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:33:24,331::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:33:24,334::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:33:24,337::task::1185::TaskManager.Task::(prepare) Task=`9cc4b68f-5381-4e68-88b6-2c2c963f65a2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:33:24,339::task::595::TaskManager.Task::(_updateState) Task=`9cc4b68f-5381-4e68-88b6-2c2c963f65a2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:33:24,341::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:33:24,343::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:33:24,346::task::990::TaskManager.Task::(_decref) Task=`9cc4b68f-5381-4e68-88b6-2c2c963f65a2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:33:24,390::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.176641 s, 5.8 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-24 10:33:24,401::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [4376fa5] >Thread-34::DEBUG::2014-07-24 10:33:24,402::task::595::TaskManager.Task::(_updateState) Task=`8debc46b-d493-4009-9dfa-27d756da1786`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:33:24,402::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:33:24,402::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c48b2cd7-7d5c-4f83-8710-57d4a76a2762`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:33:24,402::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:33:24,403::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:33:24,403::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c48b2cd7-7d5c-4f83-8710-57d4a76a2762`::Granted request >Thread-34::DEBUG::2014-07-24 10:33:24,403::task::827::TaskManager.Task::(resourceAcquired) Task=`8debc46b-d493-4009-9dfa-27d756da1786`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:33:24,403::task::990::TaskManager.Task::(_decref) Task=`8debc46b-d493-4009-9dfa-27d756da1786`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:33:24,404::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:33:24,404::task::1185::TaskManager.Task::(prepare) Task=`8debc46b-d493-4009-9dfa-27d756da1786`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:33:24,404::task::595::TaskManager.Task::(_updateState) Task=`8debc46b-d493-4009-9dfa-27d756da1786`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:33:24,404::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:33:24,405::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:33:24,405::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:33:24,405::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:33:24,405::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:33:24,405::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:33:24,405::task::990::TaskManager.Task::(_decref) Task=`8debc46b-d493-4009-9dfa-27d756da1786`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 10:33:24,942::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:33:24,951::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000804328 s, 5.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:33:26,056::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:33:26,402::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:33:26,477::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035444 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:33:28,489::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:33:28,566::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0377629 s, 27.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:33:30,578::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:33:30,654::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346978 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:33:32,666::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:33:32,741::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362727 s, 28.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:33:34,520::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:33:34,520::task::595::TaskManager.Task::(_updateState) Task=`6bea1ced-0047-42b7-9f90-3a383e4b30d0`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:33:34,521::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:33:34,521::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:33:34,521::task::1185::TaskManager.Task::(prepare) Task=`6bea1ced-0047-42b7-9f90-3a383e4b30d0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:33:34,521::task::595::TaskManager.Task::(_updateState) Task=`6bea1ced-0047-42b7-9f90-3a383e4b30d0`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:33:34,521::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:33:34,522::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:33:34,522::task::990::TaskManager.Task::(_decref) Task=`6bea1ced-0047-42b7-9f90-3a383e4b30d0`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:33:34,568::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:33:34,568::task::595::TaskManager.Task::(_updateState) Task=`3ecbc1da-84fb-496b-ac43-910259a4d64f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:33:34,569::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:33:34,569::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`dd4cf55e-6882-4f9d-88b2-3ed09115647a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:33:34,569::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:33:34,569::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:33:34,570::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`dd4cf55e-6882-4f9d-88b2-3ed09115647a`::Granted request >Thread-34::DEBUG::2014-07-24 10:33:34,570::task::827::TaskManager.Task::(resourceAcquired) Task=`3ecbc1da-84fb-496b-ac43-910259a4d64f`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:33:34,570::task::990::TaskManager.Task::(_decref) Task=`3ecbc1da-84fb-496b-ac43-910259a4d64f`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:33:34,571::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:33:34,571::task::1185::TaskManager.Task::(prepare) Task=`3ecbc1da-84fb-496b-ac43-910259a4d64f`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:33:34,571::task::595::TaskManager.Task::(_updateState) Task=`3ecbc1da-84fb-496b-ac43-910259a4d64f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:33:34,571::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:33:34,571::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:33:34,572::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:33:34,572::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:33:34,572::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:33:34,572::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:33:34,572::task::990::TaskManager.Task::(_decref) Task=`3ecbc1da-84fb-496b-ac43-910259a4d64f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:33:34,754::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:33:34,829::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364768 s, 28.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:33:34,956::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:33:34,965::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000839552 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:33:36,841::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:33:36,916::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354078 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:33:38,928::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:33:39,004::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036597 s, 28.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:33:39,516::task::595::TaskManager.Task::(_updateState) Task=`0937488b-d2d9-40ed-bcdd-2bf511b0a1ca`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:33:39,516::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:33:39,517::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000839552', 'lastCheck': '4.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:33:39,517::task::1185::TaskManager.Task::(prepare) Task=`0937488b-d2d9-40ed-bcdd-2bf511b0a1ca`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000839552', 'lastCheck': '4.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:33:39,517::task::595::TaskManager.Task::(_updateState) Task=`0937488b-d2d9-40ed-bcdd-2bf511b0a1ca`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:33:39,517::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:33:39,517::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:33:39,517::task::990::TaskManager.Task::(_decref) Task=`0937488b-d2d9-40ed-bcdd-2bf511b0a1ca`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:33:41,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:33:41,090::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347249 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:33:43,103::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:33:43,176::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352468 s, 29.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:33:44,635::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:33:44,635::task::595::TaskManager.Task::(_updateState) Task=`247ee982-aa98-4909-960c-7b71a5b6c78c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:33:44,635::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:33:44,636::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:33:44,636::task::1185::TaskManager.Task::(prepare) Task=`247ee982-aa98-4909-960c-7b71a5b6c78c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:33:44,636::task::595::TaskManager.Task::(_updateState) Task=`247ee982-aa98-4909-960c-7b71a5b6c78c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:33:44,636::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:33:44,636::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:33:44,637::task::990::TaskManager.Task::(_decref) Task=`247ee982-aa98-4909-960c-7b71a5b6c78c`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:33:44,671::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:33:44,672::task::595::TaskManager.Task::(_updateState) Task=`5f668fc5-7c8d-4fe5-b23e-730c5e1b1332`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:33:44,672::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:33:44,672::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`6bd3f3d9-0cf0-4d0f-9d25-8224bc63511f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:33:44,673::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:33:44,673::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:33:44,673::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`6bd3f3d9-0cf0-4d0f-9d25-8224bc63511f`::Granted request >Thread-34::DEBUG::2014-07-24 10:33:44,673::task::827::TaskManager.Task::(resourceAcquired) Task=`5f668fc5-7c8d-4fe5-b23e-730c5e1b1332`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:33:44,673::task::990::TaskManager.Task::(_decref) Task=`5f668fc5-7c8d-4fe5-b23e-730c5e1b1332`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:33:44,674::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:33:44,674::task::1185::TaskManager.Task::(prepare) Task=`5f668fc5-7c8d-4fe5-b23e-730c5e1b1332`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:33:44,674::task::595::TaskManager.Task::(_updateState) Task=`5f668fc5-7c8d-4fe5-b23e-730c5e1b1332`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:33:44,675::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:33:44,675::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:33:44,675::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:33:44,675::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:33:44,675::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:33:44,675::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:33:44,676::task::990::TaskManager.Task::(_decref) Task=`5f668fc5-7c8d-4fe5-b23e-730c5e1b1332`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 10:33:44,970::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:33:44,979::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000695687 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:33:45,189::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:33:45,266::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373398 s, 27.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:33:47,278::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:33:47,352::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341679 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:33:49,364::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:33:49,439::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365659 s, 28.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:33:51,452::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:33:51,528::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361515 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:33:53,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:33:53,615::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358698 s, 28.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:33:54,734::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:33:54,745::task::595::TaskManager.Task::(_updateState) Task=`b6de2099-7527-403e-b3fa-c91e3eb589a9`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:33:54,745::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:33:54,746::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:33:54,746::task::1185::TaskManager.Task::(prepare) Task=`b6de2099-7527-403e-b3fa-c91e3eb589a9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:33:54,746::task::595::TaskManager.Task::(_updateState) Task=`b6de2099-7527-403e-b3fa-c91e3eb589a9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:33:54,746::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:33:54,746::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:33:54,747::task::990::TaskManager.Task::(_decref) Task=`b6de2099-7527-403e-b3fa-c91e3eb589a9`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:33:54,786::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:33:54,786::task::595::TaskManager.Task::(_updateState) Task=`8a0ef2c1-5577-406b-bc7f-7a083f033647`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:33:54,786::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:33:54,787::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`fba6a735-27b0-4b69-bcd2-3038ae1c9f50`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:33:54,787::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:33:54,787::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:33:54,787::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`fba6a735-27b0-4b69-bcd2-3038ae1c9f50`::Granted request >Thread-34::DEBUG::2014-07-24 10:33:54,788::task::827::TaskManager.Task::(resourceAcquired) Task=`8a0ef2c1-5577-406b-bc7f-7a083f033647`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:33:54,788::task::990::TaskManager.Task::(_decref) Task=`8a0ef2c1-5577-406b-bc7f-7a083f033647`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:33:54,788::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:33:54,789::task::1185::TaskManager.Task::(prepare) Task=`8a0ef2c1-5577-406b-bc7f-7a083f033647`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:33:54,789::task::595::TaskManager.Task::(_updateState) Task=`8a0ef2c1-5577-406b-bc7f-7a083f033647`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:33:54,789::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:33:54,789::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:33:54,789::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:33:54,790::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:33:54,790::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:33:54,790::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:33:54,790::task::990::TaskManager.Task::(_decref) Task=`8a0ef2c1-5577-406b-bc7f-7a083f033647`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:33:54,926::task::595::TaskManager.Task::(_updateState) Task=`fab32362-fec1-4cab-83b7-bda40908fa7d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:33:54,926::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:33:54,926::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000695687', 'lastCheck': '9.9', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:33:54,926::task::1185::TaskManager.Task::(prepare) Task=`fab32362-fec1-4cab-83b7-bda40908fa7d`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000695687', 'lastCheck': '9.9', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:33:54,927::task::595::TaskManager.Task::(_updateState) Task=`fab32362-fec1-4cab-83b7-bda40908fa7d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:33:54,927::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:33:54,927::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:33:54,927::task::990::TaskManager.Task::(_decref) Task=`fab32362-fec1-4cab-83b7-bda40908fa7d`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 10:33:54,983::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:33:54,992::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000669483 s, 6.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:33:55,627::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:33:55,700::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340463 s, 30.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:33:56,092::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-37::DEBUG::2014-07-24 10:33:56,188::task::595::TaskManager.Task::(_updateState) Task=`e7fa5c01-6a14-4389-a7f8-8be9f416410d`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 10:33:56,188::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 10:33:56,188::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:33:56,188::task::1185::TaskManager.Task::(prepare) Task=`e7fa5c01-6a14-4389-a7f8-8be9f416410d`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:33:56,188::task::595::TaskManager.Task::(_updateState) Task=`e7fa5c01-6a14-4389-a7f8-8be9f416410d`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 10:33:56,189::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 10:33:56,189::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 10:33:56,189::task::990::TaskManager.Task::(_decref) Task=`e7fa5c01-6a14-4389-a7f8-8be9f416410d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:33:57,713::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:33:57,787::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352974 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:33:59,800::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:33:59,876::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369954 s, 27.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:34:01,888::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:34:01,969::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0403564 s, 25.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:34:03,981::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:34:04,058::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347546 s, 29.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:34:04,845::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:34:04,845::task::595::TaskManager.Task::(_updateState) Task=`7d213e20-9f0d-4344-a0ea-7d681bcc615d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:34:04,846::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:34:04,846::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:34:04,846::task::1185::TaskManager.Task::(prepare) Task=`7d213e20-9f0d-4344-a0ea-7d681bcc615d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:34:04,846::task::595::TaskManager.Task::(_updateState) Task=`7d213e20-9f0d-4344-a0ea-7d681bcc615d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:34:04,846::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:34:04,847::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:34:04,847::task::990::TaskManager.Task::(_decref) Task=`7d213e20-9f0d-4344-a0ea-7d681bcc615d`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:34:04,884::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:34:04,894::task::595::TaskManager.Task::(_updateState) Task=`8122454f-935e-4fa3-a914-ae842cf6ef0a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:34:04,894::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:34:04,895::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`6cec348d-9d15-4b48-bd00-7a728bcf000d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:34:04,895::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:34:04,895::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:34:04,895::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`6cec348d-9d15-4b48-bd00-7a728bcf000d`::Granted request >Thread-34::DEBUG::2014-07-24 10:34:04,896::task::827::TaskManager.Task::(resourceAcquired) Task=`8122454f-935e-4fa3-a914-ae842cf6ef0a`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:34:04,896::task::990::TaskManager.Task::(_decref) Task=`8122454f-935e-4fa3-a914-ae842cf6ef0a`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:34:04,896::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:34:04,897::task::1185::TaskManager.Task::(prepare) Task=`8122454f-935e-4fa3-a914-ae842cf6ef0a`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:34:04,897::task::595::TaskManager.Task::(_updateState) Task=`8122454f-935e-4fa3-a914-ae842cf6ef0a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:34:04,897::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:34:04,897::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:34:04,897::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:34:04,897::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:34:04,898::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:34:04,898::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:34:04,898::task::990::TaskManager.Task::(_decref) Task=`8122454f-935e-4fa3-a914-ae842cf6ef0a`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 10:34:04,997::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:34:05,016::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0101004 s, 406 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:34:06,072::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:34:06,155::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0387971 s, 26.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:34:08,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:34:08,243::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342695 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:34:10,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:34:10,328::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336286 s, 30.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:34:10,416::task::595::TaskManager.Task::(_updateState) Task=`ac2a8be7-8046-4676-bc2b-82890c6bd03c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:34:10,417::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:34:10,417::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0101004', 'lastCheck': '5.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:34:10,417::task::1185::TaskManager.Task::(prepare) Task=`ac2a8be7-8046-4676-bc2b-82890c6bd03c`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0101004', 'lastCheck': '5.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:34:10,417::task::595::TaskManager.Task::(_updateState) Task=`ac2a8be7-8046-4676-bc2b-82890c6bd03c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:34:10,417::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:34:10,418::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:34:10,418::task::990::TaskManager.Task::(_decref) Task=`ac2a8be7-8046-4676-bc2b-82890c6bd03c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:34:12,340::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:34:12,414::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343028 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:34:14,426::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:34:14,501::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366461 s, 27.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:34:14,960::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:34:14,961::task::595::TaskManager.Task::(_updateState) Task=`4823d087-9412-4a7f-81e4-dd0b8272cb2f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:34:14,961::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:34:14,962::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:34:14,962::task::1185::TaskManager.Task::(prepare) Task=`4823d087-9412-4a7f-81e4-dd0b8272cb2f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:34:14,962::task::595::TaskManager.Task::(_updateState) Task=`4823d087-9412-4a7f-81e4-dd0b8272cb2f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:34:14,962::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:34:14,962::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:34:14,962::task::990::TaskManager.Task::(_decref) Task=`4823d087-9412-4a7f-81e4-dd0b8272cb2f`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:34:14,994::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:34:14,994::task::595::TaskManager.Task::(_updateState) Task=`4c0b0b9a-7d86-477b-aea1-831e7f636ea2`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:34:14,994::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:34:14,995::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`dae145bb-63a7-42b1-8b54-9a20bc8215fe`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:34:14,995::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:34:14,995::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:34:14,995::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`dae145bb-63a7-42b1-8b54-9a20bc8215fe`::Granted request >Thread-34::DEBUG::2014-07-24 10:34:14,996::task::827::TaskManager.Task::(resourceAcquired) Task=`4c0b0b9a-7d86-477b-aea1-831e7f636ea2`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:34:14,996::task::990::TaskManager.Task::(_decref) Task=`4c0b0b9a-7d86-477b-aea1-831e7f636ea2`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:34:14,997::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:34:14,997::task::1185::TaskManager.Task::(prepare) Task=`4c0b0b9a-7d86-477b-aea1-831e7f636ea2`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:34:14,997::task::595::TaskManager.Task::(_updateState) Task=`4c0b0b9a-7d86-477b-aea1-831e7f636ea2`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:34:14,997::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:34:14,997::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:34:14,997::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:34:14,998::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:34:14,998::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:34:14,998::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:34:14,998::task::990::TaskManager.Task::(_decref) Task=`4c0b0b9a-7d86-477b-aea1-831e7f636ea2`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 10:34:15,021::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:34:15,030::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000781595 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:34:16,666::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:34:16,744::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0392219 s, 26.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:34:18,756::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:34:18,831::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359456 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:34:20,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:34:20,918::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355965 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:34:22,930::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:34:23,005::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357137 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:34:25,017::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-24 10:34:25,036::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:34:25,051::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000577062 s, 7.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:34:25,060::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:34:25,066::task::595::TaskManager.Task::(_updateState) Task=`e2ca5d32-a528-4e95-8ffb-31d09c1ec5fd`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:34:25,070::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:34:25,074::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:34:25,077::task::1185::TaskManager.Task::(prepare) Task=`e2ca5d32-a528-4e95-8ffb-31d09c1ec5fd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:34:25,080::task::595::TaskManager.Task::(_updateState) Task=`e2ca5d32-a528-4e95-8ffb-31d09c1ec5fd`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:34:25,083::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:34:25,086::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:34:25,089::task::990::TaskManager.Task::(_decref) Task=`e2ca5d32-a528-4e95-8ffb-31d09c1ec5fd`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:34:25,130::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:34:25,131::task::595::TaskManager.Task::(_updateState) Task=`8f99ccf2-328e-4126-a57b-7161e8075014`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:34:25,132::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:34:25,135::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`82960191-0e3d-44c0-bfb4-df8a26981b50`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:34:25,135::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:34:25,137::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:34:25,138::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`82960191-0e3d-44c0-bfb4-df8a26981b50`::Granted request >Thread-34::DEBUG::2014-07-24 10:34:25,140::task::827::TaskManager.Task::(resourceAcquired) Task=`8f99ccf2-328e-4126-a57b-7161e8075014`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:34:25,142::task::990::TaskManager.Task::(_decref) Task=`8f99ccf2-328e-4126-a57b-7161e8075014`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:34:25,145::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:34:25,146::task::1185::TaskManager.Task::(prepare) Task=`8f99ccf2-328e-4126-a57b-7161e8075014`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:34:25,147::task::595::TaskManager.Task::(_updateState) Task=`8f99ccf2-328e-4126-a57b-7161e8075014`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:34:25,148::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:34:25,149::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:34:25,150::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:34:25,151::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:34:25,152::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:34:25,153::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:34:25,154::task::990::TaskManager.Task::(_decref) Task=`8f99ccf2-328e-4126-a57b-7161e8075014`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:34:25,190::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.129553 s, 7.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:34:25,849::task::595::TaskManager.Task::(_updateState) Task=`cea21968-1034-4206-883c-092f79013203`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:34:25,849::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:34:25,849::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000577062', 'lastCheck': '0.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:34:25,850::task::1185::TaskManager.Task::(prepare) Task=`cea21968-1034-4206-883c-092f79013203`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000577062', 'lastCheck': '0.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:34:25,850::task::595::TaskManager.Task::(_updateState) Task=`cea21968-1034-4206-883c-092f79013203`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:34:25,850::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:34:25,850::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:34:25,850::task::990::TaskManager.Task::(_decref) Task=`cea21968-1034-4206-883c-092f79013203`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-07-24 10:34:26,128::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:34:27,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:34:27,281::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0389299 s, 26.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:34:29,294::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:34:29,369::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351375 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:34:31,382::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:34:31,459::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361573 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:34:33,471::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:34:33,546::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349517 s, 29.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:34:35,109::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:34:35,118::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000759532 s, 5.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:34:35,240::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:34:35,241::task::595::TaskManager.Task::(_updateState) Task=`2f5a39d2-256d-45e9-bf8c-267a7007c63e`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:34:35,241::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:34:35,241::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:34:35,241::task::1185::TaskManager.Task::(prepare) Task=`2f5a39d2-256d-45e9-bf8c-267a7007c63e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:34:35,242::task::595::TaskManager.Task::(_updateState) Task=`2f5a39d2-256d-45e9-bf8c-267a7007c63e`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:34:35,242::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:34:35,242::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:34:35,242::task::990::TaskManager.Task::(_decref) Task=`2f5a39d2-256d-45e9-bf8c-267a7007c63e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:34:35,277::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:34:35,277::task::595::TaskManager.Task::(_updateState) Task=`2db1ea7d-b9cb-4c0a-9a3b-22b5d534c7f0`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:34:35,277::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:34:35,278::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d5400924-4e84-4512-998f-aac48626a7c0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:34:35,278::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:34:35,278::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:34:35,278::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d5400924-4e84-4512-998f-aac48626a7c0`::Granted request >Thread-34::DEBUG::2014-07-24 10:34:35,279::task::827::TaskManager.Task::(resourceAcquired) Task=`2db1ea7d-b9cb-4c0a-9a3b-22b5d534c7f0`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:34:35,279::task::990::TaskManager.Task::(_decref) Task=`2db1ea7d-b9cb-4c0a-9a3b-22b5d534c7f0`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:34:35,279::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:34:35,280::task::1185::TaskManager.Task::(prepare) Task=`2db1ea7d-b9cb-4c0a-9a3b-22b5d534c7f0`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:34:35,280::task::595::TaskManager.Task::(_updateState) Task=`2db1ea7d-b9cb-4c0a-9a3b-22b5d534c7f0`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:34:35,280::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:34:35,280::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:34:35,280::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:34:35,281::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:34:35,281::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:34:35,281::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:34:35,281::task::990::TaskManager.Task::(_decref) Task=`2db1ea7d-b9cb-4c0a-9a3b-22b5d534c7f0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:34:35,558::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:34:35,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034065 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:34:37,644::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:34:37,720::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367834 s, 27.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:34:39,733::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:34:39,807::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356578 s, 28.7 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:34:41,308::task::595::TaskManager.Task::(_updateState) Task=`ce14d291-ac4b-499a-825e-9dd466627f13`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:34:41,308::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:34:41,308::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000759532', 'lastCheck': '6.2', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:34:41,308::task::1185::TaskManager.Task::(prepare) Task=`ce14d291-ac4b-499a-825e-9dd466627f13`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000759532', 'lastCheck': '6.2', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:34:41,308::task::595::TaskManager.Task::(_updateState) Task=`ce14d291-ac4b-499a-825e-9dd466627f13`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:34:41,309::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:34:41,309::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:34:41,309::task::990::TaskManager.Task::(_decref) Task=`ce14d291-ac4b-499a-825e-9dd466627f13`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:34:41,820::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:34:41,895::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349697 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:34:43,908::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:34:43,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357456 s, 28.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:34:45,123::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:34:45,132::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00067777 s, 6.0 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:34:45,343::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:34:45,344::task::595::TaskManager.Task::(_updateState) Task=`252802ee-a1ac-4b93-b7f1-9f0ef5029640`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:34:45,344::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:34:45,345::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:34:45,345::task::1185::TaskManager.Task::(prepare) Task=`252802ee-a1ac-4b93-b7f1-9f0ef5029640`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:34:45,345::task::595::TaskManager.Task::(_updateState) Task=`252802ee-a1ac-4b93-b7f1-9f0ef5029640`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:34:45,345::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:34:45,345::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:34:45,346::task::990::TaskManager.Task::(_decref) Task=`252802ee-a1ac-4b93-b7f1-9f0ef5029640`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:34:45,378::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:34:45,378::task::595::TaskManager.Task::(_updateState) Task=`1f0ed44d-7242-4438-8f4e-db00e3e283ea`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:34:45,378::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:34:45,379::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`3e82d9ae-8f02-4fcc-964b-3015b34b24d7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:34:45,379::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:34:45,379::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:34:45,379::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`3e82d9ae-8f02-4fcc-964b-3015b34b24d7`::Granted request >Thread-34::DEBUG::2014-07-24 10:34:45,380::task::827::TaskManager.Task::(resourceAcquired) Task=`1f0ed44d-7242-4438-8f4e-db00e3e283ea`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:34:45,380::task::990::TaskManager.Task::(_decref) Task=`1f0ed44d-7242-4438-8f4e-db00e3e283ea`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:34:45,381::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:34:45,381::task::1185::TaskManager.Task::(prepare) Task=`1f0ed44d-7242-4438-8f4e-db00e3e283ea`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:34:45,381::task::595::TaskManager.Task::(_updateState) Task=`1f0ed44d-7242-4438-8f4e-db00e3e283ea`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:34:45,381::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:34:45,381::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:34:45,382::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:34:45,382::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:34:45,382::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:34:45,382::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:34:45,382::task::990::TaskManager.Task::(_decref) Task=`1f0ed44d-7242-4438-8f4e-db00e3e283ea`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:34:45,995::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:34:46,069::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348677 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:34:48,081::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:34:48,155::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346051 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:34:50,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:34:50,242::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355435 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:34:52,268::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:34:52,343::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034331 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:34:54,356::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:34:54,710::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.314917 s, 3.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:34:55,137::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:34:55,147::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000596277 s, 6.9 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:34:55,437::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:34:55,447::task::595::TaskManager.Task::(_updateState) Task=`b701374d-2ed8-4e68-80aa-8db2912b47c9`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:34:55,447::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:34:55,448::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:34:55,448::task::1185::TaskManager.Task::(prepare) Task=`b701374d-2ed8-4e68-80aa-8db2912b47c9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:34:55,448::task::595::TaskManager.Task::(_updateState) Task=`b701374d-2ed8-4e68-80aa-8db2912b47c9`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:34:55,448::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:34:55,448::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:34:55,448::task::990::TaskManager.Task::(_decref) Task=`b701374d-2ed8-4e68-80aa-8db2912b47c9`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:34:55,480::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:34:55,481::task::595::TaskManager.Task::(_updateState) Task=`8a6a892c-b28b-4b95-8cc4-e4219c1599eb`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:34:55,481::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:34:55,481::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d494bf13-20e8-4d4c-af84-2b2d9e4f2377`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:34:55,482::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:34:55,482::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:34:55,482::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d494bf13-20e8-4d4c-af84-2b2d9e4f2377`::Granted request >Thread-34::DEBUG::2014-07-24 10:34:55,482::task::827::TaskManager.Task::(resourceAcquired) Task=`8a6a892c-b28b-4b95-8cc4-e4219c1599eb`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:34:55,483::task::990::TaskManager.Task::(_decref) Task=`8a6a892c-b28b-4b95-8cc4-e4219c1599eb`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:34:55,484::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:34:55,484::task::1185::TaskManager.Task::(prepare) Task=`8a6a892c-b28b-4b95-8cc4-e4219c1599eb`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:34:55,484::task::595::TaskManager.Task::(_updateState) Task=`8a6a892c-b28b-4b95-8cc4-e4219c1599eb`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:34:55,484::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:34:55,485::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:34:55,485::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:34:55,485::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:34:55,485::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:34:55,485::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:34:55,485::task::990::TaskManager.Task::(_decref) Task=`8a6a892c-b28b-4b95-8cc4-e4219c1599eb`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-07-24 10:34:56,166::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-37::DEBUG::2014-07-24 10:34:56,351::task::595::TaskManager.Task::(_updateState) Task=`c03c91e5-b686-4696-9c91-ac1d96f4f876`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 10:34:56,351::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 10:34:56,351::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:34:56,351::task::1185::TaskManager.Task::(prepare) Task=`c03c91e5-b686-4696-9c91-ac1d96f4f876`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:34:56,351::task::595::TaskManager.Task::(_updateState) Task=`c03c91e5-b686-4696-9c91-ac1d96f4f876`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 10:34:56,352::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 10:34:56,352::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 10:34:56,352::task::990::TaskManager.Task::(_decref) Task=`c03c91e5-b686-4696-9c91-ac1d96f4f876`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:34:56,721::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-13::DEBUG::2014-07-24 10:34:56,732::task::595::TaskManager.Task::(_updateState) Task=`0fbec213-3305-4c37-a704-cdd3eeb72035`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:34:56,732::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:34:56,733::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000596277', 'lastCheck': '1.6', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:34:56,733::task::1185::TaskManager.Task::(prepare) Task=`0fbec213-3305-4c37-a704-cdd3eeb72035`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000596277', 'lastCheck': '1.6', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:34:56,733::task::595::TaskManager.Task::(_updateState) Task=`0fbec213-3305-4c37-a704-cdd3eeb72035`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:34:56,733::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:34:56,734::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:34:56,734::task::990::TaskManager.Task::(_decref) Task=`0fbec213-3305-4c37-a704-cdd3eeb72035`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:34:56,794::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03429 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:34:58,807::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:34:58,882::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345879 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:35:00,894::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:35:00,968::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340127 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:35:02,980::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:35:03,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345507 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:35:05,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:35:05,148::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338996 s, 30.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:35:05,153::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:35:05,164::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000621533 s, 6.6 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:35:05,541::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:35:05,541::task::595::TaskManager.Task::(_updateState) Task=`be0b811f-7cc8-4086-8122-d0516adcb7f2`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:35:05,542::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:35:05,542::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:35:05,542::task::1185::TaskManager.Task::(prepare) Task=`be0b811f-7cc8-4086-8122-d0516adcb7f2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:35:05,542::task::595::TaskManager.Task::(_updateState) Task=`be0b811f-7cc8-4086-8122-d0516adcb7f2`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:35:05,542::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:35:05,542::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:35:05,543::task::990::TaskManager.Task::(_decref) Task=`be0b811f-7cc8-4086-8122-d0516adcb7f2`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:35:05,576::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:35:05,576::task::595::TaskManager.Task::(_updateState) Task=`2e4a5d25-1b3d-4314-a719-98f0760d0798`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:35:05,577::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:35:05,577::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`79c64695-b743-4212-bd81-76c1a2d63717`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:35:05,577::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:35:05,578::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:35:05,578::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`79c64695-b743-4212-bd81-76c1a2d63717`::Granted request >Thread-34::DEBUG::2014-07-24 10:35:05,578::task::827::TaskManager.Task::(resourceAcquired) Task=`2e4a5d25-1b3d-4314-a719-98f0760d0798`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:35:05,578::task::990::TaskManager.Task::(_decref) Task=`2e4a5d25-1b3d-4314-a719-98f0760d0798`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:35:05,579::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:35:05,579::task::1185::TaskManager.Task::(prepare) Task=`2e4a5d25-1b3d-4314-a719-98f0760d0798`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:35:05,579::task::595::TaskManager.Task::(_updateState) Task=`2e4a5d25-1b3d-4314-a719-98f0760d0798`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:35:05,579::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:35:05,580::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:35:05,580::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:35:05,580::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:35:05,580::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:35:05,580::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:35:05,581::task::990::TaskManager.Task::(_decref) Task=`2e4a5d25-1b3d-4314-a719-98f0760d0798`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:35:07,186::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:35:07,259::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339606 s, 30.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:35:09,272::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:35:09,347::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348998 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:35:11,360::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:35:11,436::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334645 s, 30.6 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:35:12,154::task::595::TaskManager.Task::(_updateState) Task=`908e4add-afdb-4bfa-9916-3fd6e4d8075b`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:35:12,155::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:35:12,155::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000621533', 'lastCheck': '7.0', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:35:12,155::task::1185::TaskManager.Task::(prepare) Task=`908e4add-afdb-4bfa-9916-3fd6e4d8075b`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000621533', 'lastCheck': '7.0', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:35:12,155::task::595::TaskManager.Task::(_updateState) Task=`908e4add-afdb-4bfa-9916-3fd6e4d8075b`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:35:12,155::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:35:12,156::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:35:12,156::task::990::TaskManager.Task::(_decref) Task=`908e4add-afdb-4bfa-9916-3fd6e4d8075b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:35:13,449::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:35:13,524::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364013 s, 28.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:35:15,179::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:35:15,187::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000692901 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:35:15,537::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:35:15,612::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361352 s, 28.3 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:35:15,644::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [1487b3f5] >Thread-13::DEBUG::2014-07-24 10:35:15,645::task::595::TaskManager.Task::(_updateState) Task=`ce92fe32-a85b-433c-b269-e1bdfbb57113`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:35:15,645::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:35:15,645::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:35:15,646::task::1185::TaskManager.Task::(prepare) Task=`ce92fe32-a85b-433c-b269-e1bdfbb57113`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:35:15,646::task::595::TaskManager.Task::(_updateState) Task=`ce92fe32-a85b-433c-b269-e1bdfbb57113`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:35:15,646::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:35:15,646::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:35:15,646::task::990::TaskManager.Task::(_decref) Task=`ce92fe32-a85b-433c-b269-e1bdfbb57113`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:35:15,680::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [1487b3f5] >Thread-34::DEBUG::2014-07-24 10:35:15,680::task::595::TaskManager.Task::(_updateState) Task=`5a5fabe3-8a3c-4257-8041-68032324e218`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:35:15,680::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:35:15,681::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ab1d33ab-d0fd-4672-8086-eccf6b3ea066`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:35:15,681::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:35:15,681::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:35:15,681::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ab1d33ab-d0fd-4672-8086-eccf6b3ea066`::Granted request >Thread-34::DEBUG::2014-07-24 10:35:15,682::task::827::TaskManager.Task::(resourceAcquired) Task=`5a5fabe3-8a3c-4257-8041-68032324e218`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:35:15,682::task::990::TaskManager.Task::(_decref) Task=`5a5fabe3-8a3c-4257-8041-68032324e218`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:35:15,682::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:35:15,683::task::1185::TaskManager.Task::(prepare) Task=`5a5fabe3-8a3c-4257-8041-68032324e218`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:35:15,683::task::595::TaskManager.Task::(_updateState) Task=`5a5fabe3-8a3c-4257-8041-68032324e218`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:35:15,683::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:35:15,683::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:35:15,683::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:35:15,684::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:35:15,684::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:35:15,684::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:35:15,684::task::990::TaskManager.Task::(_decref) Task=`5a5fabe3-8a3c-4257-8041-68032324e218`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:35:17,625::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:35:17,701::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373397 s, 27.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:35:19,713::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:35:19,790::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036217 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:35:21,803::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:35:21,877::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346949 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:35:23,890::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:35:23,965::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348885 s, 29.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:35:25,193::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:35:25,218::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0162814 s, 252 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:35:25,744::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:35:25,745::task::595::TaskManager.Task::(_updateState) Task=`6d9a6c83-944e-4c34-a762-17494e9cd4d3`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:35:25,745::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:35:25,745::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:35:25,745::task::1185::TaskManager.Task::(prepare) Task=`6d9a6c83-944e-4c34-a762-17494e9cd4d3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:35:25,745::task::595::TaskManager.Task::(_updateState) Task=`6d9a6c83-944e-4c34-a762-17494e9cd4d3`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:35:25,746::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:35:25,746::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:35:25,746::task::990::TaskManager.Task::(_decref) Task=`6d9a6c83-944e-4c34-a762-17494e9cd4d3`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:35:25,787::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:35:25,787::task::595::TaskManager.Task::(_updateState) Task=`ff9ae88c-1ba1-4485-914b-34b22332e3c1`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:35:25,788::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:35:25,788::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c84a1498-7ec9-46ef-abc4-7de4b5d49daa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:35:25,788::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:35:25,788::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:35:25,789::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c84a1498-7ec9-46ef-abc4-7de4b5d49daa`::Granted request >Thread-34::DEBUG::2014-07-24 10:35:25,789::task::827::TaskManager.Task::(resourceAcquired) Task=`ff9ae88c-1ba1-4485-914b-34b22332e3c1`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:35:25,789::task::990::TaskManager.Task::(_decref) Task=`ff9ae88c-1ba1-4485-914b-34b22332e3c1`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:35:25,790::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:35:25,790::task::1185::TaskManager.Task::(prepare) Task=`ff9ae88c-1ba1-4485-914b-34b22332e3c1`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:35:25,790::task::595::TaskManager.Task::(_updateState) Task=`ff9ae88c-1ba1-4485-914b-34b22332e3c1`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:35:25,790::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:35:25,790::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:35:25,791::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:35:25,791::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:35:25,791::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:35:25,791::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:35:25,791::task::990::TaskManager.Task::(_decref) Task=`ff9ae88c-1ba1-4485-914b-34b22332e3c1`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:35:25,977::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:35:26,051::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342587 s, 29.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:35:26,203::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-13::DEBUG::2014-07-24 10:35:27,530::task::595::TaskManager.Task::(_updateState) Task=`27eb10f3-e61a-4668-b3ca-6cb63fea273c`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:35:27,531::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:35:27,531::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0162814', 'lastCheck': '2.3', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:35:27,531::task::1185::TaskManager.Task::(prepare) Task=`27eb10f3-e61a-4668-b3ca-6cb63fea273c`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0162814', 'lastCheck': '2.3', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:35:27,531::task::595::TaskManager.Task::(_updateState) Task=`27eb10f3-e61a-4668-b3ca-6cb63fea273c`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:35:27,531::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:35:27,531::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:35:27,532::task::990::TaskManager.Task::(_decref) Task=`27eb10f3-e61a-4668-b3ca-6cb63fea273c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:35:28,064::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:35:28,138::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347287 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:35:30,150::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:35:30,233::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0417567 s, 24.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:35:32,246::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:35:32,322::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370916 s, 27.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:35:34,335::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:35:34,408::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033626 s, 30.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:35:35,222::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:35:35,243::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0124454 s, 329 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:35:35,848::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:35:35,848::task::595::TaskManager.Task::(_updateState) Task=`2a77d727-090d-488d-bd24-39e32bda0ce0`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:35:35,849::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:35:35,849::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:35:35,849::task::1185::TaskManager.Task::(prepare) Task=`2a77d727-090d-488d-bd24-39e32bda0ce0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:35:35,849::task::595::TaskManager.Task::(_updateState) Task=`2a77d727-090d-488d-bd24-39e32bda0ce0`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:35:35,849::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:35:35,850::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:35:35,850::task::990::TaskManager.Task::(_decref) Task=`2a77d727-090d-488d-bd24-39e32bda0ce0`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:35:35,881::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:35:35,881::task::595::TaskManager.Task::(_updateState) Task=`28f0a80d-6330-48c5-93f8-e4fce5850bdd`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:35:35,881::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:35:35,882::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`339ed50e-8312-4e2d-a7cd-229ceba637f9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:35:35,882::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:35:35,882::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:35:35,882::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`339ed50e-8312-4e2d-a7cd-229ceba637f9`::Granted request >Thread-34::DEBUG::2014-07-24 10:35:35,884::task::827::TaskManager.Task::(resourceAcquired) Task=`28f0a80d-6330-48c5-93f8-e4fce5850bdd`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:35:35,884::task::990::TaskManager.Task::(_decref) Task=`28f0a80d-6330-48c5-93f8-e4fce5850bdd`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:35:35,885::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:35:35,885::task::1185::TaskManager.Task::(prepare) Task=`28f0a80d-6330-48c5-93f8-e4fce5850bdd`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:35:35,885::task::595::TaskManager.Task::(_updateState) Task=`28f0a80d-6330-48c5-93f8-e4fce5850bdd`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:35:35,886::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:35:35,886::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:35:35,886::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:35:35,886::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:35:35,886::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:35:35,886::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:35:35,887::task::990::TaskManager.Task::(_decref) Task=`28f0a80d-6330-48c5-93f8-e4fce5850bdd`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:35:36,420::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:35:36,496::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337887 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:35:38,508::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:35:38,609::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0607464 s, 16.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:35:40,621::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:35:40,695::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339952 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:35:42,707::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:35:42,783::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368652 s, 27.8 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:35:42,893::task::595::TaskManager.Task::(_updateState) Task=`1d5f96c0-8577-435e-a7d5-0f094346faba`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:35:42,893::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:35:42,893::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0124454', 'lastCheck': '7.6', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:35:42,894::task::1185::TaskManager.Task::(prepare) Task=`1d5f96c0-8577-435e-a7d5-0f094346faba`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0124454', 'lastCheck': '7.6', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:35:42,894::task::595::TaskManager.Task::(_updateState) Task=`1d5f96c0-8577-435e-a7d5-0f094346faba`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:35:42,894::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:35:42,894::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:35:42,894::task::990::TaskManager.Task::(_decref) Task=`1d5f96c0-8577-435e-a7d5-0f094346faba`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:35:44,796::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:35:44,869::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338456 s, 30.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:35:45,248::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:35:45,257::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000632882 s, 6.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:35:45,944::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:35:45,944::task::595::TaskManager.Task::(_updateState) Task=`b0b675c0-2236-4a74-aef1-88a93ca02693`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:35:45,945::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:35:45,945::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:35:45,945::task::1185::TaskManager.Task::(prepare) Task=`b0b675c0-2236-4a74-aef1-88a93ca02693`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:35:45,945::task::595::TaskManager.Task::(_updateState) Task=`b0b675c0-2236-4a74-aef1-88a93ca02693`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:35:45,945::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:35:45,946::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:35:45,946::task::990::TaskManager.Task::(_decref) Task=`b0b675c0-2236-4a74-aef1-88a93ca02693`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:35:45,979::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:35:45,979::task::595::TaskManager.Task::(_updateState) Task=`1dd87b64-af64-40c7-84e0-ab49b2e2475d`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:35:45,980::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:35:45,980::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`539a4f9b-9b11-4666-9643-97bea98dc251`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:35:45,980::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:35:45,981::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:35:45,981::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`539a4f9b-9b11-4666-9643-97bea98dc251`::Granted request >Thread-34::DEBUG::2014-07-24 10:35:45,981::task::827::TaskManager.Task::(resourceAcquired) Task=`1dd87b64-af64-40c7-84e0-ab49b2e2475d`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:35:45,981::task::990::TaskManager.Task::(_decref) Task=`1dd87b64-af64-40c7-84e0-ab49b2e2475d`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:35:45,982::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:35:45,982::task::1185::TaskManager.Task::(prepare) Task=`1dd87b64-af64-40c7-84e0-ab49b2e2475d`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:35:45,982::task::595::TaskManager.Task::(_updateState) Task=`1dd87b64-af64-40c7-84e0-ab49b2e2475d`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:35:45,982::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:35:45,983::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:35:45,983::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:35:45,983::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:35:45,983::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:35:45,983::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:35:45,983::task::990::TaskManager.Task::(_decref) Task=`1dd87b64-af64-40c7-84e0-ab49b2e2475d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:35:46,882::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:35:46,957::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357343 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:35:48,969::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:35:49,043::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338039 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:35:51,055::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:35:51,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343958 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:35:53,141::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:35:53,215::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345358 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:35:55,228::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-24 10:35:55,263::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:35:55,274::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00046471 s, 8.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:35:55,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0594393 s, 17.2 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:35:56,064::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:35:56,064::task::595::TaskManager.Task::(_updateState) Task=`d8f5358a-e586-4f20-a044-6dc3a4150448`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:35:56,065::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:35:56,065::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:35:56,065::task::1185::TaskManager.Task::(prepare) Task=`d8f5358a-e586-4f20-a044-6dc3a4150448`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:35:56,065::task::595::TaskManager.Task::(_updateState) Task=`d8f5358a-e586-4f20-a044-6dc3a4150448`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:35:56,065::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:35:56,066::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:35:56,066::task::990::TaskManager.Task::(_decref) Task=`d8f5358a-e586-4f20-a044-6dc3a4150448`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:35:56,148::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:35:56,149::task::595::TaskManager.Task::(_updateState) Task=`6ed83ba8-682d-4fc3-bc77-a408e86e4a0b`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:35:56,149::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:35:56,149::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`64ceddb5-6f7f-4646-aada-745b62737d37`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:35:56,149::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:35:56,150::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:35:56,150::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`64ceddb5-6f7f-4646-aada-745b62737d37`::Granted request >Thread-34::DEBUG::2014-07-24 10:35:56,150::task::827::TaskManager.Task::(resourceAcquired) Task=`6ed83ba8-682d-4fc3-bc77-a408e86e4a0b`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:35:56,150::task::990::TaskManager.Task::(_decref) Task=`6ed83ba8-682d-4fc3-bc77-a408e86e4a0b`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:35:56,151::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:35:56,151::task::1185::TaskManager.Task::(prepare) Task=`6ed83ba8-682d-4fc3-bc77-a408e86e4a0b`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:35:56,151::task::595::TaskManager.Task::(_updateState) Task=`6ed83ba8-682d-4fc3-bc77-a408e86e4a0b`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:35:56,152::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:35:56,152::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:35:56,152::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:35:56,152::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:35:56,152::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:35:56,152::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:35:56,153::task::990::TaskManager.Task::(_decref) Task=`6ed83ba8-682d-4fc3-bc77-a408e86e4a0b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-07-24 10:35:56,240::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-37::DEBUG::2014-07-24 10:35:56,533::task::595::TaskManager.Task::(_updateState) Task=`8d2b3a84-a51a-44e4-8650-8c7d6953305d`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 10:35:56,533::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 10:35:56,534::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:35:56,534::task::1185::TaskManager.Task::(prepare) Task=`8d2b3a84-a51a-44e4-8650-8c7d6953305d`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:35:56,534::task::595::TaskManager.Task::(_updateState) Task=`8d2b3a84-a51a-44e4-8650-8c7d6953305d`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 10:35:56,534::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 10:35:56,534::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 10:35:56,534::task::990::TaskManager.Task::(_decref) Task=`8d2b3a84-a51a-44e4-8650-8c7d6953305d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:35:57,340::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:35:57,415::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342334 s, 29.9 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:35:58,590::task::595::TaskManager.Task::(_updateState) Task=`7ae52d58-138e-4f57-b2a5-6be8520106da`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:35:58,590::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:35:58,591::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00046471', 'lastCheck': '3.3', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:35:58,591::task::1185::TaskManager.Task::(prepare) Task=`7ae52d58-138e-4f57-b2a5-6be8520106da`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00046471', 'lastCheck': '3.3', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:35:58,591::task::595::TaskManager.Task::(_updateState) Task=`7ae52d58-138e-4f57-b2a5-6be8520106da`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:35:58,591::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:35:58,591::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:35:58,591::task::990::TaskManager.Task::(_decref) Task=`7ae52d58-138e-4f57-b2a5-6be8520106da`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:35:59,427::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:35:59,784::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.317732 s, 3.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:36:01,797::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:36:01,906::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0697284 s, 14.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:36:03,918::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:36:03,996::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370116 s, 27.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:36:05,289::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 23aa0606-edc3-4882-a4aa-18aa1983458f >Thread-18::DEBUG::2014-07-24 10:36:05,290::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-18::DEBUG::2014-07-24 10:36:05,290::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:36:05,310::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.0119751 s, 171 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:36:05,311::misc::264::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.0119751 s, 171 kB/s'], size: 2048 >Thread-18::DEBUG::2014-07-24 10:36:05,311::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-18::WARNING::2014-07-24 10:36:05,311::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-18::DEBUG::2014-07-24 10:36:05,311::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-18::DEBUG::2014-07-24 10:36:05,311::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 10:36:05,312::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 10:36:05,312::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 10:36:05,312::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 10:36:05,312::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 10:36:05,313::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-18::DEBUG::2014-07-24 10:36:05,515::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:36:05,516::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 10:36:05,517::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'LOCKPOLICY=', 'POOL_DOMAINS=23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'POOL_DESCRIPTION=DS1', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_UUID=637ea13c-81a8-4b44-8cab-961458b01883', 'POOL_SPM_ID=1', '_SHA_CKSUM=a749afdc7119a2d6aad840af5c63c9b28c0b612c', 'POOL_SPM_LVER=0'] >Thread-18::INFO::2014-07-24 10:36:05,517::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_imageNS already registered >Thread-18::INFO::2014-07-24 10:36:05,518::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_volumeNS already registered >Thread-18::INFO::2014-07-24 10:36:05,518::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_lvmActivationNS already registered >Thread-18::DEBUG::2014-07-24 10:36:05,518::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-18::DEBUG::2014-07-24 10:36:05,672::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:36:05,673::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:36:05,683::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00103173 s, 4.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:36:06,008::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:36:06,081::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344166 s, 29.8 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:36:06,212::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:36:06,212::task::595::TaskManager.Task::(_updateState) Task=`07c3627c-bd69-43c1-806d-48d248922892`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:36:06,212::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:36:06,213::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:36:06,213::task::1185::TaskManager.Task::(prepare) Task=`07c3627c-bd69-43c1-806d-48d248922892`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:36:06,213::task::595::TaskManager.Task::(_updateState) Task=`07c3627c-bd69-43c1-806d-48d248922892`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:36:06,213::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:36:06,213::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:36:06,214::task::990::TaskManager.Task::(_decref) Task=`07c3627c-bd69-43c1-806d-48d248922892`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:36:06,245::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:36:06,246::task::595::TaskManager.Task::(_updateState) Task=`71e1fdfd-2253-4c58-999f-916e40728e9b`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:36:06,246::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:36:06,246::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`54f9058c-4441-49ea-93fa-c8f10fe6c255`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:36:06,247::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:36:06,247::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:36:06,247::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`54f9058c-4441-49ea-93fa-c8f10fe6c255`::Granted request >Thread-34::DEBUG::2014-07-24 10:36:06,247::task::827::TaskManager.Task::(resourceAcquired) Task=`71e1fdfd-2253-4c58-999f-916e40728e9b`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:36:06,247::task::990::TaskManager.Task::(_decref) Task=`71e1fdfd-2253-4c58-999f-916e40728e9b`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:36:06,248::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:36:06,248::task::1185::TaskManager.Task::(prepare) Task=`71e1fdfd-2253-4c58-999f-916e40728e9b`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:36:06,249::task::595::TaskManager.Task::(_updateState) Task=`71e1fdfd-2253-4c58-999f-916e40728e9b`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:36:06,249::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:36:06,249::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:36:06,249::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:36:06,249::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:36:06,249::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:36:06,250::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:36:06,250::task::990::TaskManager.Task::(_decref) Task=`71e1fdfd-2253-4c58-999f-916e40728e9b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:36:08,094::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:36:08,170::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367424 s, 27.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:36:10,182::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:36:10,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343135 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:36:12,269::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:36:12,343::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338816 s, 30.2 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:36:13,980::task::595::TaskManager.Task::(_updateState) Task=`35ef71be-2f92-4e97-a465-1b84e086324e`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:36:13,981::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:36:13,981::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00103173', 'lastCheck': '8.3', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:36:13,981::task::1185::TaskManager.Task::(prepare) Task=`35ef71be-2f92-4e97-a465-1b84e086324e`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00103173', 'lastCheck': '8.3', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:36:13,981::task::595::TaskManager.Task::(_updateState) Task=`35ef71be-2f92-4e97-a465-1b84e086324e`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:36:13,981::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:36:13,981::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:36:13,982::task::990::TaskManager.Task::(_decref) Task=`35ef71be-2f92-4e97-a465-1b84e086324e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:36:14,355::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:36:14,429::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346811 s, 29.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:36:15,688::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:36:15,696::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000669449 s, 6.1 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:36:16,311::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:36:16,312::task::595::TaskManager.Task::(_updateState) Task=`2e6955f1-5a54-419f-8ff1-12bda2ef1149`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:36:16,312::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:36:16,312::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:36:16,313::task::1185::TaskManager.Task::(prepare) Task=`2e6955f1-5a54-419f-8ff1-12bda2ef1149`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:36:16,313::task::595::TaskManager.Task::(_updateState) Task=`2e6955f1-5a54-419f-8ff1-12bda2ef1149`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:36:16,313::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:36:16,313::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:36:16,313::task::990::TaskManager.Task::(_decref) Task=`2e6955f1-5a54-419f-8ff1-12bda2ef1149`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:36:16,346::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:36:16,346::task::595::TaskManager.Task::(_updateState) Task=`1c702610-373e-4ea9-8791-5fd663613a17`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:36:16,346::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:36:16,347::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`3e9132e6-9979-405d-9a89-40786d768102`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:36:16,347::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:36:16,347::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:36:16,347::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`3e9132e6-9979-405d-9a89-40786d768102`::Granted request >Thread-34::DEBUG::2014-07-24 10:36:16,348::task::827::TaskManager.Task::(resourceAcquired) Task=`1c702610-373e-4ea9-8791-5fd663613a17`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:36:16,348::task::990::TaskManager.Task::(_decref) Task=`1c702610-373e-4ea9-8791-5fd663613a17`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:36:16,349::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:36:16,349::task::1185::TaskManager.Task::(prepare) Task=`1c702610-373e-4ea9-8791-5fd663613a17`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:36:16,349::task::595::TaskManager.Task::(_updateState) Task=`1c702610-373e-4ea9-8791-5fd663613a17`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:36:16,349::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:36:16,349::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:36:16,350::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:36:16,350::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:36:16,350::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:36:16,350::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:36:16,350::task::990::TaskManager.Task::(_decref) Task=`1c702610-373e-4ea9-8791-5fd663613a17`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:36:16,441::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:36:16,517::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339746 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:36:18,530::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:36:18,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345782 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:36:20,618::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:36:20,717::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342615 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:36:22,730::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:36:22,803::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336646 s, 30.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:36:24,815::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:36:24,894::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0388855 s, 26.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:36:25,701::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:36:25,719::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0098935 s, 414 kB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:36:26,276::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-13::DEBUG::2014-07-24 10:36:26,406::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:36:26,407::task::595::TaskManager.Task::(_updateState) Task=`d3be2f32-f06e-4a84-b476-fb165b191735`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:36:26,407::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:36:26,407::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:36:26,407::task::1185::TaskManager.Task::(prepare) Task=`d3be2f32-f06e-4a84-b476-fb165b191735`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:36:26,407::task::595::TaskManager.Task::(_updateState) Task=`d3be2f32-f06e-4a84-b476-fb165b191735`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:36:26,408::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:36:26,408::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:36:26,408::task::990::TaskManager.Task::(_decref) Task=`d3be2f32-f06e-4a84-b476-fb165b191735`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:36:26,439::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:36:26,439::task::595::TaskManager.Task::(_updateState) Task=`1b90782d-4a24-49c0-b6f2-837c0d64c184`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:36:26,439::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:36:26,440::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7d06716d-8d13-486c-b232-adf95e5a50ce`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:36:26,440::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:36:26,440::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:36:26,440::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7d06716d-8d13-486c-b232-adf95e5a50ce`::Granted request >Thread-34::DEBUG::2014-07-24 10:36:26,441::task::827::TaskManager.Task::(resourceAcquired) Task=`1b90782d-4a24-49c0-b6f2-837c0d64c184`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:36:26,441::task::990::TaskManager.Task::(_decref) Task=`1b90782d-4a24-49c0-b6f2-837c0d64c184`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:36:26,441::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:36:26,442::task::1185::TaskManager.Task::(prepare) Task=`1b90782d-4a24-49c0-b6f2-837c0d64c184`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:36:26,442::task::595::TaskManager.Task::(_updateState) Task=`1b90782d-4a24-49c0-b6f2-837c0d64c184`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:36:26,442::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:36:26,442::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:36:26,442::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:36:26,443::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:36:26,443::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:36:26,443::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:36:26,443::task::990::TaskManager.Task::(_decref) Task=`1b90782d-4a24-49c0-b6f2-837c0d64c184`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:36:26,906::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:36:26,979::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341462 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:36:28,992::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:36:29,065::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340841 s, 30.0 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:36:29,341::task::595::TaskManager.Task::(_updateState) Task=`c742b7e9-4657-4b1c-a9c9-5cb61c20ca8d`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:36:29,341::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:36:29,341::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0098935', 'lastCheck': '3.6', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:36:29,342::task::1185::TaskManager.Task::(prepare) Task=`c742b7e9-4657-4b1c-a9c9-5cb61c20ca8d`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0098935', 'lastCheck': '3.6', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:36:29,342::task::595::TaskManager.Task::(_updateState) Task=`c742b7e9-4657-4b1c-a9c9-5cb61c20ca8d`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:36:29,342::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:36:29,342::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:36:29,342::task::990::TaskManager.Task::(_decref) Task=`c742b7e9-4657-4b1c-a9c9-5cb61c20ca8d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:36:31,078::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:36:31,151::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338581 s, 30.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:36:33,164::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:36:33,239::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347278 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:36:35,251::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:36:35,326::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348438 s, 29.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:36:35,724::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:36:35,732::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000629922 s, 6.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:36:36,527::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:36:36,536::task::595::TaskManager.Task::(_updateState) Task=`73c30b0e-44d4-44f0-ab55-820093fd729f`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:36:36,536::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:36:36,536::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:36:36,536::task::1185::TaskManager.Task::(prepare) Task=`73c30b0e-44d4-44f0-ab55-820093fd729f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:36:36,537::task::595::TaskManager.Task::(_updateState) Task=`73c30b0e-44d4-44f0-ab55-820093fd729f`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:36:36,537::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:36:36,537::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:36:36,537::task::990::TaskManager.Task::(_decref) Task=`73c30b0e-44d4-44f0-ab55-820093fd729f`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:36:36,579::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:36:36,580::task::595::TaskManager.Task::(_updateState) Task=`6e0221ba-34db-457b-a7f0-6ca48251cb62`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:36:36,580::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:36:36,580::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c0ebac82-487c-4bbf-9f63-dd81e6af0376`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:36:36,580::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:36:36,581::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:36:36,581::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c0ebac82-487c-4bbf-9f63-dd81e6af0376`::Granted request >Thread-34::DEBUG::2014-07-24 10:36:36,581::task::827::TaskManager.Task::(resourceAcquired) Task=`6e0221ba-34db-457b-a7f0-6ca48251cb62`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:36:36,581::task::990::TaskManager.Task::(_decref) Task=`6e0221ba-34db-457b-a7f0-6ca48251cb62`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:36:36,582::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:36:36,582::task::1185::TaskManager.Task::(prepare) Task=`6e0221ba-34db-457b-a7f0-6ca48251cb62`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:36:36,582::task::595::TaskManager.Task::(_updateState) Task=`6e0221ba-34db-457b-a7f0-6ca48251cb62`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:36:36,582::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:36:36,583::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:36:36,583::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:36:36,583::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:36:36,583::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:36:36,583::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:36:36,584::task::990::TaskManager.Task::(_decref) Task=`6e0221ba-34db-457b-a7f0-6ca48251cb62`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:36:37,338::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:36:37,412::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339919 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:36:39,424::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:36:39,499::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342411 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:36:41,512::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:36:41,587::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365492 s, 28.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:36:43,600::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:36:43,674::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340893 s, 30.0 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:36:44,711::task::595::TaskManager.Task::(_updateState) Task=`14731736-dd27-4d21-9292-907089c3e5f3`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:36:44,711::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:36:44,712::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000629922', 'lastCheck': '9.0', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:36:44,712::task::1185::TaskManager.Task::(prepare) Task=`14731736-dd27-4d21-9292-907089c3e5f3`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000629922', 'lastCheck': '9.0', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:36:44,712::task::595::TaskManager.Task::(_updateState) Task=`14731736-dd27-4d21-9292-907089c3e5f3`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:36:44,712::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:36:44,712::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:36:44,712::task::990::TaskManager.Task::(_decref) Task=`14731736-dd27-4d21-9292-907089c3e5f3`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:36:45,686::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-24 10:36:45,741::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:36:45,758::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00054621 s, 7.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:36:45,813::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0376508 s, 27.2 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:36:46,642::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:36:46,642::task::595::TaskManager.Task::(_updateState) Task=`91b94d68-51a4-4fef-b603-b9c8cab4a61f`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:36:46,642::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:36:46,643::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:36:46,643::task::1185::TaskManager.Task::(prepare) Task=`91b94d68-51a4-4fef-b603-b9c8cab4a61f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:36:46,643::task::595::TaskManager.Task::(_updateState) Task=`91b94d68-51a4-4fef-b603-b9c8cab4a61f`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:36:46,643::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:36:46,643::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:36:46,643::task::990::TaskManager.Task::(_decref) Task=`91b94d68-51a4-4fef-b603-b9c8cab4a61f`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:36:46,674::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:36:46,674::task::595::TaskManager.Task::(_updateState) Task=`e4dca906-dd1d-4b64-92d9-887ad17cd92c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:36:46,674::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:36:46,677::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`17507be1-86eb-46fb-bee3-8302168bacba`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:36:46,677::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:36:46,677::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:36:46,677::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`17507be1-86eb-46fb-bee3-8302168bacba`::Granted request >Thread-34::DEBUG::2014-07-24 10:36:46,678::task::827::TaskManager.Task::(resourceAcquired) Task=`e4dca906-dd1d-4b64-92d9-887ad17cd92c`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:36:46,678::task::990::TaskManager.Task::(_decref) Task=`e4dca906-dd1d-4b64-92d9-887ad17cd92c`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:36:46,679::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:36:46,679::task::1185::TaskManager.Task::(prepare) Task=`e4dca906-dd1d-4b64-92d9-887ad17cd92c`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:36:46,679::task::595::TaskManager.Task::(_updateState) Task=`e4dca906-dd1d-4b64-92d9-887ad17cd92c`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:36:46,679::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:36:46,679::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:36:46,679::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:36:46,680::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:36:46,680::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:36:46,680::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:36:46,680::task::990::TaskManager.Task::(_decref) Task=`e4dca906-dd1d-4b64-92d9-887ad17cd92c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:36:47,826::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:36:47,916::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0428575 s, 23.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:36:49,929::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:36:50,003::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344051 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:36:52,015::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:36:52,096::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0375448 s, 27.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:36:54,106::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:36:54,181::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358506 s, 28.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:36:55,788::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:36:55,797::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000680222 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:36:56,193::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:36:56,269::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036333 s, 28.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:36:56,312::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-37::DEBUG::2014-07-24 10:36:56,694::task::595::TaskManager.Task::(_updateState) Task=`a8952871-d94c-40f5-9ae5-f7420b179eba`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 10:36:56,695::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 10:36:56,695::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:36:56,695::task::1185::TaskManager.Task::(prepare) Task=`a8952871-d94c-40f5-9ae5-f7420b179eba`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:36:56,695::task::595::TaskManager.Task::(_updateState) Task=`a8952871-d94c-40f5-9ae5-f7420b179eba`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 10:36:56,696::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 10:36:56,696::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 10:36:56,696::task::990::TaskManager.Task::(_decref) Task=`a8952871-d94c-40f5-9ae5-f7420b179eba`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:36:56,741::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:36:56,742::task::595::TaskManager.Task::(_updateState) Task=`22d3df8e-119e-4341-89ad-613a9b3dd352`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:36:56,742::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:36:56,742::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:36:56,742::task::1185::TaskManager.Task::(prepare) Task=`22d3df8e-119e-4341-89ad-613a9b3dd352`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:36:56,743::task::595::TaskManager.Task::(_updateState) Task=`22d3df8e-119e-4341-89ad-613a9b3dd352`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:36:56,743::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:36:56,743::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:36:56,743::task::990::TaskManager.Task::(_decref) Task=`22d3df8e-119e-4341-89ad-613a9b3dd352`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:36:56,775::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:36:56,776::task::595::TaskManager.Task::(_updateState) Task=`e6d8301e-c9b8-4437-9922-00ab44b6162f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:36:56,776::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:36:56,776::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ab75ef30-035e-471e-bb95-365f8a1941d7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:36:56,776::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:36:56,777::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:36:56,777::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ab75ef30-035e-471e-bb95-365f8a1941d7`::Granted request >Thread-34::DEBUG::2014-07-24 10:36:56,777::task::827::TaskManager.Task::(resourceAcquired) Task=`e6d8301e-c9b8-4437-9922-00ab44b6162f`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:36:56,777::task::990::TaskManager.Task::(_decref) Task=`e6d8301e-c9b8-4437-9922-00ab44b6162f`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:36:56,778::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:36:56,778::task::1185::TaskManager.Task::(prepare) Task=`e6d8301e-c9b8-4437-9922-00ab44b6162f`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:36:56,778::task::595::TaskManager.Task::(_updateState) Task=`e6d8301e-c9b8-4437-9922-00ab44b6162f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:36:56,779::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:36:56,779::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:36:56,779::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:36:56,779::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:36:56,779::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:36:56,779::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:36:56,780::task::990::TaskManager.Task::(_decref) Task=`e6d8301e-c9b8-4437-9922-00ab44b6162f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:36:58,281::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:36:58,354::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338981 s, 30.2 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:37:00,117::task::595::TaskManager.Task::(_updateState) Task=`3a6aa408-e8a6-4df5-89a1-a0c36376a849`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:37:00,118::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:37:00,118::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000680222', 'lastCheck': '4.3', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:37:00,118::task::1185::TaskManager.Task::(prepare) Task=`3a6aa408-e8a6-4df5-89a1-a0c36376a849`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000680222', 'lastCheck': '4.3', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:37:00,118::task::595::TaskManager.Task::(_updateState) Task=`3a6aa408-e8a6-4df5-89a1-a0c36376a849`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:37:00,118::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:37:00,118::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:37:00,119::task::990::TaskManager.Task::(_decref) Task=`3a6aa408-e8a6-4df5-89a1-a0c36376a849`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:37:00,367::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:37:00,441::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353192 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:37:02,454::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:37:02,529::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036144 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:37:04,541::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:37:04,617::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035854 s, 28.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:37:05,802::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:37:05,820::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00902283 s, 454 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:37:06,629::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:37:06,706::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0376077 s, 27.2 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:37:06,839::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:37:06,839::task::595::TaskManager.Task::(_updateState) Task=`f621dde9-23ff-4b97-b827-fc541f484c4b`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:37:06,840::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:37:06,840::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:37:06,840::task::1185::TaskManager.Task::(prepare) Task=`f621dde9-23ff-4b97-b827-fc541f484c4b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:37:06,840::task::595::TaskManager.Task::(_updateState) Task=`f621dde9-23ff-4b97-b827-fc541f484c4b`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:37:06,841::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:37:06,841::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:37:06,841::task::990::TaskManager.Task::(_decref) Task=`f621dde9-23ff-4b97-b827-fc541f484c4b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:37:06,878::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:37:06,878::task::595::TaskManager.Task::(_updateState) Task=`ad79e93c-a5e7-4e88-9682-fd576aa68ccc`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:37:06,878::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:37:06,879::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7cbd61e9-d171-4693-b8fd-0c404bdedda4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:37:06,879::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:37:06,879::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:37:06,879::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7cbd61e9-d171-4693-b8fd-0c404bdedda4`::Granted request >Thread-34::DEBUG::2014-07-24 10:37:06,879::task::827::TaskManager.Task::(resourceAcquired) Task=`ad79e93c-a5e7-4e88-9682-fd576aa68ccc`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:37:06,880::task::990::TaskManager.Task::(_decref) Task=`ad79e93c-a5e7-4e88-9682-fd576aa68ccc`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:37:06,880::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:37:06,881::task::1185::TaskManager.Task::(prepare) Task=`ad79e93c-a5e7-4e88-9682-fd576aa68ccc`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:37:06,881::task::595::TaskManager.Task::(_updateState) Task=`ad79e93c-a5e7-4e88-9682-fd576aa68ccc`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:37:06,881::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:37:06,881::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:37:06,881::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:37:06,881::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:37:06,882::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:37:06,882::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:37:06,882::task::990::TaskManager.Task::(_decref) Task=`ad79e93c-a5e7-4e88-9682-fd576aa68ccc`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:37:08,718::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:37:08,810::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0446117 s, 23.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:37:10,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:37:10,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0496802 s, 20.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:37:12,925::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:37:12,999::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346318 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:37:15,011::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:37:15,084::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339578 s, 30.2 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:37:15,504::task::595::TaskManager.Task::(_updateState) Task=`656b58fc-e74a-42d5-962b-b7a173dce20f`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:37:15,504::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:37:15,505::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00902283', 'lastCheck': '9.7', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:37:15,505::task::1185::TaskManager.Task::(prepare) Task=`656b58fc-e74a-42d5-962b-b7a173dce20f`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00902283', 'lastCheck': '9.7', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:37:15,505::task::595::TaskManager.Task::(_updateState) Task=`656b58fc-e74a-42d5-962b-b7a173dce20f`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:37:15,505::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:37:15,505::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:37:15,505::task::990::TaskManager.Task::(_decref) Task=`656b58fc-e74a-42d5-962b-b7a173dce20f`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 10:37:15,825::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:37:15,836::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000776372 s, 5.3 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:37:16,939::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:37:16,940::task::595::TaskManager.Task::(_updateState) Task=`56bdbe58-a731-4aa5-b2be-76f61287a9bc`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:37:16,940::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:37:16,940::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:37:16,940::task::1185::TaskManager.Task::(prepare) Task=`56bdbe58-a731-4aa5-b2be-76f61287a9bc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:37:16,940::task::595::TaskManager.Task::(_updateState) Task=`56bdbe58-a731-4aa5-b2be-76f61287a9bc`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:37:16,941::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:37:16,941::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:37:16,941::task::990::TaskManager.Task::(_decref) Task=`56bdbe58-a731-4aa5-b2be-76f61287a9bc`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:37:16,972::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:37:16,972::task::595::TaskManager.Task::(_updateState) Task=`e98e2360-1e14-4a52-bbd6-1e512a17cdbc`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:37:16,972::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:37:16,973::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`8fd2186e-ddd0-4ef4-a0d2-4ceb59d2b0e2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:37:16,973::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:37:16,973::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:37:16,973::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`8fd2186e-ddd0-4ef4-a0d2-4ceb59d2b0e2`::Granted request >Thread-34::DEBUG::2014-07-24 10:37:16,973::task::827::TaskManager.Task::(resourceAcquired) Task=`e98e2360-1e14-4a52-bbd6-1e512a17cdbc`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:37:16,974::task::990::TaskManager.Task::(_decref) Task=`e98e2360-1e14-4a52-bbd6-1e512a17cdbc`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:37:16,974::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:37:16,974::task::1185::TaskManager.Task::(prepare) Task=`e98e2360-1e14-4a52-bbd6-1e512a17cdbc`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:37:16,975::task::595::TaskManager.Task::(_updateState) Task=`e98e2360-1e14-4a52-bbd6-1e512a17cdbc`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:37:16,975::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:37:16,975::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:37:16,975::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:37:16,975::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:37:16,975::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:37:16,976::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:37:16,976::task::990::TaskManager.Task::(_decref) Task=`e98e2360-1e14-4a52-bbd6-1e512a17cdbc`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:37:17,097::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:37:17,172::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364266 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:37:19,185::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:37:19,258::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341823 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:37:21,270::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:37:21,345::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357376 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:37:23,358::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:37:23,431::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343184 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:37:25,443::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:37:25,522::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352706 s, 29.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:37:25,841::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:37:25,851::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000976737 s, 4.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:37:26,350::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-13::DEBUG::2014-07-24 10:37:27,033::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:37:27,034::task::595::TaskManager.Task::(_updateState) Task=`45054b9a-492d-49a3-8375-ed378d6bed49`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:37:27,034::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:37:27,034::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:37:27,034::task::1185::TaskManager.Task::(prepare) Task=`45054b9a-492d-49a3-8375-ed378d6bed49`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:37:27,035::task::595::TaskManager.Task::(_updateState) Task=`45054b9a-492d-49a3-8375-ed378d6bed49`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:37:27,035::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:37:27,035::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:37:27,035::task::990::TaskManager.Task::(_decref) Task=`45054b9a-492d-49a3-8375-ed378d6bed49`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:37:27,070::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:37:27,070::task::595::TaskManager.Task::(_updateState) Task=`0e66574f-1ff0-4d58-8782-2a9e0e888d73`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:37:27,070::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:37:27,071::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b1e21979-ce92-427f-8308-2f49f4416194`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:37:27,071::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:37:27,071::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:37:27,071::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b1e21979-ce92-427f-8308-2f49f4416194`::Granted request >Thread-34::DEBUG::2014-07-24 10:37:27,072::task::827::TaskManager.Task::(resourceAcquired) Task=`0e66574f-1ff0-4d58-8782-2a9e0e888d73`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:37:27,072::task::990::TaskManager.Task::(_decref) Task=`0e66574f-1ff0-4d58-8782-2a9e0e888d73`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:37:27,073::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:37:27,073::task::1185::TaskManager.Task::(prepare) Task=`0e66574f-1ff0-4d58-8782-2a9e0e888d73`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:37:27,073::task::595::TaskManager.Task::(_updateState) Task=`0e66574f-1ff0-4d58-8782-2a9e0e888d73`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:37:27,073::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:37:27,073::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:37:27,074::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:37:27,074::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:37:27,074::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:37:27,074::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:37:27,074::task::990::TaskManager.Task::(_decref) Task=`0e66574f-1ff0-4d58-8782-2a9e0e888d73`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:37:27,534::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:37:27,608::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345085 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:37:29,620::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:37:29,697::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352707 s, 29.0 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:37:30,908::task::595::TaskManager.Task::(_updateState) Task=`329b2806-4ad2-43ff-9553-08085627553b`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:37:30,921::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:37:30,921::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000976737', 'lastCheck': '5.1', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:37:30,921::task::1185::TaskManager.Task::(prepare) Task=`329b2806-4ad2-43ff-9553-08085627553b`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000976737', 'lastCheck': '5.1', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:37:30,921::task::595::TaskManager.Task::(_updateState) Task=`329b2806-4ad2-43ff-9553-08085627553b`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:37:30,921::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:37:30,921::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:37:30,922::task::990::TaskManager.Task::(_decref) Task=`329b2806-4ad2-43ff-9553-08085627553b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:37:31,709::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:37:31,782::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344435 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:37:33,795::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:37:33,869::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350328 s, 29.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:37:35,856::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:37:35,865::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000768313 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:37:35,882::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:37:35,958::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365096 s, 28.0 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:37:37,138::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [5176ccd6] >Thread-13::DEBUG::2014-07-24 10:37:37,139::task::595::TaskManager.Task::(_updateState) Task=`181dbb8f-cf4d-485e-bc3a-fc61ce5f336f`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:37:37,139::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:37:37,139::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:37:37,139::task::1185::TaskManager.Task::(prepare) Task=`181dbb8f-cf4d-485e-bc3a-fc61ce5f336f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:37:37,140::task::595::TaskManager.Task::(_updateState) Task=`181dbb8f-cf4d-485e-bc3a-fc61ce5f336f`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:37:37,140::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:37:37,140::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:37:37,140::task::990::TaskManager.Task::(_decref) Task=`181dbb8f-cf4d-485e-bc3a-fc61ce5f336f`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:37:37,174::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [5176ccd6] >Thread-34::DEBUG::2014-07-24 10:37:37,174::task::595::TaskManager.Task::(_updateState) Task=`ac4e298c-5075-4f7f-ba99-babad5422c06`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:37:37,175::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:37:37,175::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`544b1a8d-8aca-4d93-91d4-3150e959bf49`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:37:37,175::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:37:37,175::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:37:37,176::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`544b1a8d-8aca-4d93-91d4-3150e959bf49`::Granted request >Thread-34::DEBUG::2014-07-24 10:37:37,176::task::827::TaskManager.Task::(resourceAcquired) Task=`ac4e298c-5075-4f7f-ba99-babad5422c06`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:37:37,176::task::990::TaskManager.Task::(_decref) Task=`ac4e298c-5075-4f7f-ba99-babad5422c06`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:37:37,177::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:37:37,177::task::1185::TaskManager.Task::(prepare) Task=`ac4e298c-5075-4f7f-ba99-babad5422c06`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:37:37,177::task::595::TaskManager.Task::(_updateState) Task=`ac4e298c-5075-4f7f-ba99-babad5422c06`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:37:37,177::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:37:37,178::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:37:37,178::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:37:37,178::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:37:37,178::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:37:37,178::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:37:37,178::task::990::TaskManager.Task::(_decref) Task=`ac4e298c-5075-4f7f-ba99-babad5422c06`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:37:37,970::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:37:38,046::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370161 s, 27.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:37:40,058::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:37:40,135::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367554 s, 27.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:37:42,147::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:37:42,222::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034925 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:37:44,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:37:44,314::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0395361 s, 25.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:37:45,870::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:37:45,879::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000704044 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:37:46,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-13::DEBUG::2014-07-24 10:37:46,349::task::595::TaskManager.Task::(_updateState) Task=`6f20c24d-04fa-4a7b-9587-2b69c9b8f7c8`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:37:46,351::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:37:46,352::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000704044', 'lastCheck': '0.5', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:37:46,352::task::1185::TaskManager.Task::(prepare) Task=`6f20c24d-04fa-4a7b-9587-2b69c9b8f7c8`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000704044', 'lastCheck': '0.5', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:37:46,353::task::595::TaskManager.Task::(_updateState) Task=`6f20c24d-04fa-4a7b-9587-2b69c9b8f7c8`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:37:46,354::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:37:46,355::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:37:46,356::task::990::TaskManager.Task::(_decref) Task=`6f20c24d-04fa-4a7b-9587-2b69c9b8f7c8`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:37:46,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0572213 s, 17.9 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:37:47,271::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:37:47,271::task::595::TaskManager.Task::(_updateState) Task=`fd61387a-3eb6-4dac-8de8-348af9e1ed8b`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:37:47,271::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:37:47,272::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:37:47,272::task::1185::TaskManager.Task::(prepare) Task=`fd61387a-3eb6-4dac-8de8-348af9e1ed8b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:37:47,272::task::595::TaskManager.Task::(_updateState) Task=`fd61387a-3eb6-4dac-8de8-348af9e1ed8b`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:37:47,272::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:37:47,272::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:37:47,272::task::990::TaskManager.Task::(_decref) Task=`fd61387a-3eb6-4dac-8de8-348af9e1ed8b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:37:47,308::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:37:47,308::task::595::TaskManager.Task::(_updateState) Task=`fe88a3f9-6a24-4c0f-9332-31dc1cd741f1`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:37:47,308::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:37:47,308::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`8c292db8-1096-4493-9866-d1593e5c6ece`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:37:47,309::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:37:47,309::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:37:47,309::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`8c292db8-1096-4493-9866-d1593e5c6ece`::Granted request >Thread-34::DEBUG::2014-07-24 10:37:47,309::task::827::TaskManager.Task::(resourceAcquired) Task=`fe88a3f9-6a24-4c0f-9332-31dc1cd741f1`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:37:47,310::task::990::TaskManager.Task::(_decref) Task=`fe88a3f9-6a24-4c0f-9332-31dc1cd741f1`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:37:47,310::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:37:47,310::task::1185::TaskManager.Task::(prepare) Task=`fe88a3f9-6a24-4c0f-9332-31dc1cd741f1`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:37:47,311::task::595::TaskManager.Task::(_updateState) Task=`fe88a3f9-6a24-4c0f-9332-31dc1cd741f1`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:37:47,311::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:37:47,311::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:37:47,311::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:37:47,311::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:37:47,312::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:37:47,312::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:37:47,312::task::990::TaskManager.Task::(_decref) Task=`fe88a3f9-6a24-4c0f-9332-31dc1cd741f1`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:37:48,435::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:37:48,509::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034877 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:37:50,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:37:50,602::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349677 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:37:52,614::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:37:52,688::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351799 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:37:54,701::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:37:54,775::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348435 s, 29.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:37:55,884::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:37:55,905::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0124935 s, 328 kB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:37:56,388::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:37:56,787::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-37::DEBUG::2014-07-24 10:37:56,850::task::595::TaskManager.Task::(_updateState) Task=`8c80e3e8-57f4-463f-be3b-083637409aae`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 10:37:56,852::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 10:37:56,853::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:37:56,853::task::1185::TaskManager.Task::(prepare) Task=`8c80e3e8-57f4-463f-be3b-083637409aae`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:37:56,854::task::595::TaskManager.Task::(_updateState) Task=`8c80e3e8-57f4-463f-be3b-083637409aae`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 10:37:56,855::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 10:37:56,855::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 10:37:56,856::task::990::TaskManager.Task::(_decref) Task=`8c80e3e8-57f4-463f-be3b-083637409aae`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:37:56,871::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034365 s, 29.8 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:37:57,396::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:37:57,396::task::595::TaskManager.Task::(_updateState) Task=`9ed63b02-a03e-44b7-89ae-62847ee1e304`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:37:57,396::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:37:57,397::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:37:57,397::task::1185::TaskManager.Task::(prepare) Task=`9ed63b02-a03e-44b7-89ae-62847ee1e304`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:37:57,397::task::595::TaskManager.Task::(_updateState) Task=`9ed63b02-a03e-44b7-89ae-62847ee1e304`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:37:57,397::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:37:57,397::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:37:57,397::task::990::TaskManager.Task::(_decref) Task=`9ed63b02-a03e-44b7-89ae-62847ee1e304`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:37:57,463::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:37:57,463::task::595::TaskManager.Task::(_updateState) Task=`5cc60ab2-6e36-4037-be22-af01232f8fec`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:37:57,463::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:37:57,464::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`136cec17-cf43-4a57-890b-0381adc9becc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:37:57,464::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:37:57,464::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:37:57,464::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`136cec17-cf43-4a57-890b-0381adc9becc`::Granted request >Thread-34::DEBUG::2014-07-24 10:37:57,465::task::827::TaskManager.Task::(resourceAcquired) Task=`5cc60ab2-6e36-4037-be22-af01232f8fec`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:37:57,466::task::990::TaskManager.Task::(_decref) Task=`5cc60ab2-6e36-4037-be22-af01232f8fec`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:37:57,466::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:37:57,467::task::1185::TaskManager.Task::(prepare) Task=`5cc60ab2-6e36-4037-be22-af01232f8fec`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:37:57,467::task::595::TaskManager.Task::(_updateState) Task=`5cc60ab2-6e36-4037-be22-af01232f8fec`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:37:57,467::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:37:57,467::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:37:57,467::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:37:57,468::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:37:57,468::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:37:57,468::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:37:57,468::task::990::TaskManager.Task::(_decref) Task=`5cc60ab2-6e36-4037-be22-af01232f8fec`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:37:58,885::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:37:58,960::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358284 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:38:00,976::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:38:01,063::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0480679 s, 21.3 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:38:01,976::task::595::TaskManager.Task::(_updateState) Task=`cf0afda8-e779-4ee1-9bfb-720c940e4c9e`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:38:01,976::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:38:01,976::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0124935', 'lastCheck': '6.1', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:38:01,976::task::1185::TaskManager.Task::(prepare) Task=`cf0afda8-e779-4ee1-9bfb-720c940e4c9e`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0124935', 'lastCheck': '6.1', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:38:01,976::task::595::TaskManager.Task::(_updateState) Task=`cf0afda8-e779-4ee1-9bfb-720c940e4c9e`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:38:01,977::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:38:01,977::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:38:01,977::task::990::TaskManager.Task::(_decref) Task=`cf0afda8-e779-4ee1-9bfb-720c940e4c9e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:38:03,076::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:38:03,148::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033988 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:38:05,161::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:38:05,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348602 s, 29.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:38:05,910::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:38:05,919::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00072243 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:38:07,247::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:38:07,322::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346645 s, 29.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:38:07,557::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:38:07,558::task::595::TaskManager.Task::(_updateState) Task=`e26b3179-35f4-461c-b582-851fcdf5c34e`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:38:07,558::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:38:07,559::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:38:07,559::task::1185::TaskManager.Task::(prepare) Task=`e26b3179-35f4-461c-b582-851fcdf5c34e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:38:07,559::task::595::TaskManager.Task::(_updateState) Task=`e26b3179-35f4-461c-b582-851fcdf5c34e`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:38:07,559::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:38:07,559::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:38:07,559::task::990::TaskManager.Task::(_decref) Task=`e26b3179-35f4-461c-b582-851fcdf5c34e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:38:07,612::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:38:07,612::task::595::TaskManager.Task::(_updateState) Task=`640b9c57-2f78-4187-a5e5-f69d34850785`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:38:07,613::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:38:07,613::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`26f3c639-1cfc-4670-ada6-368c4324b838`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:38:07,613::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:38:07,613::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:38:07,614::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`26f3c639-1cfc-4670-ada6-368c4324b838`::Granted request >Thread-34::DEBUG::2014-07-24 10:38:07,614::task::827::TaskManager.Task::(resourceAcquired) Task=`640b9c57-2f78-4187-a5e5-f69d34850785`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:38:07,614::task::990::TaskManager.Task::(_decref) Task=`640b9c57-2f78-4187-a5e5-f69d34850785`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:38:07,615::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:38:07,615::task::1185::TaskManager.Task::(prepare) Task=`640b9c57-2f78-4187-a5e5-f69d34850785`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:38:07,615::task::595::TaskManager.Task::(_updateState) Task=`640b9c57-2f78-4187-a5e5-f69d34850785`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:38:07,615::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:38:07,615::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:38:07,616::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:38:07,616::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:38:07,616::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:38:07,616::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:38:07,616::task::990::TaskManager.Task::(_decref) Task=`640b9c57-2f78-4187-a5e5-f69d34850785`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:38:09,334::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:38:09,408::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337565 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:38:11,420::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:38:11,493::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337671 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:38:13,505::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:38:13,577::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338179 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:38:15,590::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:38:15,663::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341729 s, 30.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:38:15,924::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:38:15,933::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000648507 s, 6.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:38:17,678::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-13::DEBUG::2014-07-24 10:38:17,688::task::595::TaskManager.Task::(_updateState) Task=`b55bf22a-d0ee-444b-a38f-9e5c644b94b7`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:38:17,688::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:38:17,689::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000648507', 'lastCheck': '1.7', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:38:17,689::task::1185::TaskManager.Task::(prepare) Task=`b55bf22a-d0ee-444b-a38f-9e5c644b94b7`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000648507', 'lastCheck': '1.7', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:38:17,689::task::595::TaskManager.Task::(_updateState) Task=`b55bf22a-d0ee-444b-a38f-9e5c644b94b7`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:38:17,689::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:38:17,690::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:38:17,690::task::990::TaskManager.Task::(_decref) Task=`b55bf22a-d0ee-444b-a38f-9e5c644b94b7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:38:17,753::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354971 s, 28.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:38:17,873::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:38:17,874::task::595::TaskManager.Task::(_updateState) Task=`866595c1-0499-497f-b98a-a3ab244280c1`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:38:17,874::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:38:17,874::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:38:17,874::task::1185::TaskManager.Task::(prepare) Task=`866595c1-0499-497f-b98a-a3ab244280c1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:38:17,874::task::595::TaskManager.Task::(_updateState) Task=`866595c1-0499-497f-b98a-a3ab244280c1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:38:17,875::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:38:17,875::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:38:17,875::task::990::TaskManager.Task::(_decref) Task=`866595c1-0499-497f-b98a-a3ab244280c1`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:38:17,933::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:38:17,933::task::595::TaskManager.Task::(_updateState) Task=`706399a2-9f4a-4773-9380-7335771c374f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:38:17,933::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:38:17,933::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`9fb57f57-e158-4a74-8286-2e067e705c3c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:38:17,934::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:38:17,934::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:38:17,934::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`9fb57f57-e158-4a74-8286-2e067e705c3c`::Granted request >Thread-34::DEBUG::2014-07-24 10:38:17,934::task::827::TaskManager.Task::(resourceAcquired) Task=`706399a2-9f4a-4773-9380-7335771c374f`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:38:17,935::task::990::TaskManager.Task::(_decref) Task=`706399a2-9f4a-4773-9380-7335771c374f`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:38:17,935::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:38:17,935::task::1185::TaskManager.Task::(prepare) Task=`706399a2-9f4a-4773-9380-7335771c374f`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:38:17,936::task::595::TaskManager.Task::(_updateState) Task=`706399a2-9f4a-4773-9380-7335771c374f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:38:17,936::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:38:17,936::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:38:17,936::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:38:17,936::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:38:17,936::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:38:17,937::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:38:17,937::task::990::TaskManager.Task::(_decref) Task=`706399a2-9f4a-4773-9380-7335771c374f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:38:19,766::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:38:19,844::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034899 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:38:21,858::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:38:21,930::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336036 s, 30.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:38:23,943::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:38:24,018::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357009 s, 28.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:38:25,940::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:38:25,950::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000680625 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:38:26,031::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:38:26,114::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0444332 s, 23.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:38:26,425::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:38:28,126::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:38:28,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363021 s, 28.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:38:28,255::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:38:28,256::task::595::TaskManager.Task::(_updateState) Task=`a9b5e595-99ec-4990-a4db-6b94689d5a31`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:38:28,256::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:38:28,256::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:38:28,256::task::1185::TaskManager.Task::(prepare) Task=`a9b5e595-99ec-4990-a4db-6b94689d5a31`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:38:28,257::task::595::TaskManager.Task::(_updateState) Task=`a9b5e595-99ec-4990-a4db-6b94689d5a31`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:38:28,257::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:38:28,257::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:38:28,257::task::990::TaskManager.Task::(_decref) Task=`a9b5e595-99ec-4990-a4db-6b94689d5a31`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:38:28,311::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:38:28,311::task::595::TaskManager.Task::(_updateState) Task=`7c60b07f-783f-41cd-9b53-6328d36a4349`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:38:28,312::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:38:28,312::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d2dd722b-82f3-4f94-bc41-eb418ac37e77`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:38:28,312::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:38:28,313::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:38:28,313::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d2dd722b-82f3-4f94-bc41-eb418ac37e77`::Granted request >Thread-34::DEBUG::2014-07-24 10:38:28,313::task::827::TaskManager.Task::(resourceAcquired) Task=`7c60b07f-783f-41cd-9b53-6328d36a4349`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:38:28,313::task::990::TaskManager.Task::(_decref) Task=`7c60b07f-783f-41cd-9b53-6328d36a4349`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:38:28,314::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:38:28,314::task::1185::TaskManager.Task::(prepare) Task=`7c60b07f-783f-41cd-9b53-6328d36a4349`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:38:28,314::task::595::TaskManager.Task::(_updateState) Task=`7c60b07f-783f-41cd-9b53-6328d36a4349`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:38:28,314::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:38:28,315::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:38:28,315::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:38:28,315::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:38:28,315::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:38:28,315::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:38:28,315::task::990::TaskManager.Task::(_decref) Task=`7c60b07f-783f-41cd-9b53-6328d36a4349`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:38:30,214::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:38:30,291::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373578 s, 27.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:38:32,303::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:38:32,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350295 s, 29.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:38:33,588::task::595::TaskManager.Task::(_updateState) Task=`8935e4fb-4350-4c31-a374-d9c74c4f2912`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:38:33,588::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:38:33,588::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000680625', 'lastCheck': '7.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:38:33,589::task::1185::TaskManager.Task::(prepare) Task=`8935e4fb-4350-4c31-a374-d9c74c4f2912`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000680625', 'lastCheck': '7.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:38:33,589::task::595::TaskManager.Task::(_updateState) Task=`8935e4fb-4350-4c31-a374-d9c74c4f2912`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:38:33,589::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:38:33,589::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:38:33,589::task::990::TaskManager.Task::(_decref) Task=`8935e4fb-4350-4c31-a374-d9c74c4f2912`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:38:34,390::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:38:34,463::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340459 s, 30.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:38:35,954::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:38:35,963::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000694843 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:38:36,476::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:38:36,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346843 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:38:38,562::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-24 10:38:38,587::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:38:38,589::task::595::TaskManager.Task::(_updateState) Task=`60ec840a-aa83-4a7b-8a13-d3575691e728`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:38:38,590::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:38:38,591::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:38:38,592::task::1185::TaskManager.Task::(prepare) Task=`60ec840a-aa83-4a7b-8a13-d3575691e728`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:38:38,593::task::595::TaskManager.Task::(_updateState) Task=`60ec840a-aa83-4a7b-8a13-d3575691e728`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:38:38,593::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:38:38,594::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:38:38,595::task::990::TaskManager.Task::(_decref) Task=`60ec840a-aa83-4a7b-8a13-d3575691e728`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:38:38,649::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.046141 s, 22.2 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-24 10:38:38,649::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:38:38,651::task::595::TaskManager.Task::(_updateState) Task=`e3e0eeed-73f5-41cb-9b45-1f762705b1dd`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:38:38,652::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:38:38,654::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`43342979-b5f6-4cc3-ac99-5a217810557f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:38:38,655::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:38:38,656::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:38:38,657::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`43342979-b5f6-4cc3-ac99-5a217810557f`::Granted request >Thread-34::DEBUG::2014-07-24 10:38:38,659::task::827::TaskManager.Task::(resourceAcquired) Task=`e3e0eeed-73f5-41cb-9b45-1f762705b1dd`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:38:38,660::task::990::TaskManager.Task::(_decref) Task=`e3e0eeed-73f5-41cb-9b45-1f762705b1dd`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:38:38,665::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:38:38,665::task::1185::TaskManager.Task::(prepare) Task=`e3e0eeed-73f5-41cb-9b45-1f762705b1dd`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:38:38,666::task::595::TaskManager.Task::(_updateState) Task=`e3e0eeed-73f5-41cb-9b45-1f762705b1dd`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:38:38,666::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:38:38,667::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:38:38,668::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:38:38,669::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:38:38,669::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:38:38,670::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:38:38,671::task::990::TaskManager.Task::(_decref) Task=`e3e0eeed-73f5-41cb-9b45-1f762705b1dd`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:38:40,684::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:38:40,759::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355252 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:38:42,772::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:38:42,847::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363569 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:38:44,859::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:38:44,936::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370226 s, 27.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:38:45,968::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:38:45,977::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000700628 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:38:46,949::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:38:47,024::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361825 s, 28.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:38:48,844::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:38:48,844::task::595::TaskManager.Task::(_updateState) Task=`16ec4671-ee82-4acc-848a-15598ed61417`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:38:48,844::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:38:48,845::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:38:48,845::task::1185::TaskManager.Task::(prepare) Task=`16ec4671-ee82-4acc-848a-15598ed61417`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:38:48,845::task::595::TaskManager.Task::(_updateState) Task=`16ec4671-ee82-4acc-848a-15598ed61417`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:38:48,845::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:38:48,845::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:38:48,846::task::990::TaskManager.Task::(_decref) Task=`16ec4671-ee82-4acc-848a-15598ed61417`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:38:48,914::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:38:48,914::task::595::TaskManager.Task::(_updateState) Task=`cfd9d3da-eda0-403e-9bf3-a4dcb158dabd`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:38:48,914::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:38:48,915::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`8983952a-5c3e-4a66-9946-cff40114fa9f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:38:48,915::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:38:48,915::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:38:48,915::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`8983952a-5c3e-4a66-9946-cff40114fa9f`::Granted request >Thread-34::DEBUG::2014-07-24 10:38:48,916::task::827::TaskManager.Task::(resourceAcquired) Task=`cfd9d3da-eda0-403e-9bf3-a4dcb158dabd`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:38:48,916::task::990::TaskManager.Task::(_decref) Task=`cfd9d3da-eda0-403e-9bf3-a4dcb158dabd`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:38:48,917::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:38:48,917::task::1185::TaskManager.Task::(prepare) Task=`cfd9d3da-eda0-403e-9bf3-a4dcb158dabd`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:38:48,917::task::595::TaskManager.Task::(_updateState) Task=`cfd9d3da-eda0-403e-9bf3-a4dcb158dabd`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:38:48,917::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:38:48,917::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:38:48,918::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:38:48,918::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:38:48,918::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:38:48,918::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:38:48,918::task::990::TaskManager.Task::(_decref) Task=`cfd9d3da-eda0-403e-9bf3-a4dcb158dabd`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:38:49,040::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:38:49,114::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343448 s, 29.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:38:49,130::task::595::TaskManager.Task::(_updateState) Task=`83c1ddce-d9da-403f-abfa-f1bee9b17f70`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:38:49,130::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:38:49,131::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700628', 'lastCheck': '3.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:38:49,131::task::1185::TaskManager.Task::(prepare) Task=`83c1ddce-d9da-403f-abfa-f1bee9b17f70`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700628', 'lastCheck': '3.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:38:49,131::task::595::TaskManager.Task::(_updateState) Task=`83c1ddce-d9da-403f-abfa-f1bee9b17f70`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:38:49,131::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:38:49,131::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:38:49,131::task::990::TaskManager.Task::(_decref) Task=`83c1ddce-d9da-403f-abfa-f1bee9b17f70`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:38:51,126::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:38:51,213::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0476439 s, 21.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:38:53,226::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:38:53,301::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364034 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:38:55,314::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:38:55,389::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363975 s, 28.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:38:55,982::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:38:55,998::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0074508 s, 550 kB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:38:56,461::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-37::DEBUG::2014-07-24 10:38:57,050::task::595::TaskManager.Task::(_updateState) Task=`d58b3102-edb7-4365-908c-a45ef1321123`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 10:38:57,050::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 10:38:57,050::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:38:57,050::task::1185::TaskManager.Task::(prepare) Task=`d58b3102-edb7-4365-908c-a45ef1321123`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:38:57,051::task::595::TaskManager.Task::(_updateState) Task=`d58b3102-edb7-4365-908c-a45ef1321123`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 10:38:57,051::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 10:38:57,051::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 10:38:57,051::task::990::TaskManager.Task::(_decref) Task=`d58b3102-edb7-4365-908c-a45ef1321123`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:38:57,402::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:38:57,476::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346567 s, 29.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:38:59,046::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:38:59,046::task::595::TaskManager.Task::(_updateState) Task=`13e08e28-4656-4ed7-9576-9567a873dbf6`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:38:59,047::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:38:59,047::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:38:59,047::task::1185::TaskManager.Task::(prepare) Task=`13e08e28-4656-4ed7-9576-9567a873dbf6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:38:59,047::task::595::TaskManager.Task::(_updateState) Task=`13e08e28-4656-4ed7-9576-9567a873dbf6`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:38:59,048::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:38:59,048::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:38:59,048::task::990::TaskManager.Task::(_decref) Task=`13e08e28-4656-4ed7-9576-9567a873dbf6`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:38:59,080::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:38:59,080::task::595::TaskManager.Task::(_updateState) Task=`72c1db84-9530-4545-b679-5e3d6f4356f3`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:38:59,080::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:38:59,081::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`55ef952d-2627-4a7c-b98f-ec6d0b035be0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:38:59,081::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:38:59,081::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:38:59,081::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`55ef952d-2627-4a7c-b98f-ec6d0b035be0`::Granted request >Thread-34::DEBUG::2014-07-24 10:38:59,082::task::827::TaskManager.Task::(resourceAcquired) Task=`72c1db84-9530-4545-b679-5e3d6f4356f3`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:38:59,082::task::990::TaskManager.Task::(_decref) Task=`72c1db84-9530-4545-b679-5e3d6f4356f3`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:38:59,083::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:38:59,084::task::1185::TaskManager.Task::(prepare) Task=`72c1db84-9530-4545-b679-5e3d6f4356f3`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:38:59,084::task::595::TaskManager.Task::(_updateState) Task=`72c1db84-9530-4545-b679-5e3d6f4356f3`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:38:59,084::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:38:59,084::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:38:59,084::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:38:59,085::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:38:59,085::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:38:59,085::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:38:59,085::task::990::TaskManager.Task::(_decref) Task=`72c1db84-9530-4545-b679-5e3d6f4356f3`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:38:59,488::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:38:59,564::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366164 s, 28.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:39:01,576::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:39:01,656::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.040592 s, 25.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:39:03,669::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:39:03,744::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036333 s, 28.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:39:04,639::task::595::TaskManager.Task::(_updateState) Task=`b0bbc6c1-a6ac-4917-ad2d-e05df438af63`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:39:04,639::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:39:04,639::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0074508', 'lastCheck': '8.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:39:04,640::task::1185::TaskManager.Task::(prepare) Task=`b0bbc6c1-a6ac-4917-ad2d-e05df438af63`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0074508', 'lastCheck': '8.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:39:04,640::task::595::TaskManager.Task::(_updateState) Task=`b0bbc6c1-a6ac-4917-ad2d-e05df438af63`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:39:04,640::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:39:04,640::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:39:04,640::task::990::TaskManager.Task::(_decref) Task=`b0bbc6c1-a6ac-4917-ad2d-e05df438af63`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:39:05,757::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-24 10:39:06,003::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:39:06,300::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.283812 s, 14.4 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:39:06,386::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.590096 s, 1.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:39:08,398::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:39:08,474::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366221 s, 28.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:39:09,146::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:39:09,146::task::595::TaskManager.Task::(_updateState) Task=`4defa4da-0882-4079-8262-fdd60cef1490`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:39:09,147::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:39:09,147::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:39:09,147::task::1185::TaskManager.Task::(prepare) Task=`4defa4da-0882-4079-8262-fdd60cef1490`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:39:09,147::task::595::TaskManager.Task::(_updateState) Task=`4defa4da-0882-4079-8262-fdd60cef1490`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:39:09,147::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:39:09,148::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:39:09,148::task::990::TaskManager.Task::(_decref) Task=`4defa4da-0882-4079-8262-fdd60cef1490`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:39:09,178::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:39:09,179::task::595::TaskManager.Task::(_updateState) Task=`530853ef-232b-4031-8005-8dc07938dbcd`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:39:09,179::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:39:09,179::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b8765254-81d8-4429-b299-19358dee9558`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:39:09,180::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:39:09,180::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:39:09,180::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b8765254-81d8-4429-b299-19358dee9558`::Granted request >Thread-34::DEBUG::2014-07-24 10:39:09,181::task::827::TaskManager.Task::(resourceAcquired) Task=`530853ef-232b-4031-8005-8dc07938dbcd`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:39:09,182::task::990::TaskManager.Task::(_decref) Task=`530853ef-232b-4031-8005-8dc07938dbcd`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:39:09,182::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:39:09,183::task::1185::TaskManager.Task::(prepare) Task=`530853ef-232b-4031-8005-8dc07938dbcd`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:39:09,183::task::595::TaskManager.Task::(_updateState) Task=`530853ef-232b-4031-8005-8dc07938dbcd`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:39:09,183::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:39:09,183::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:39:09,183::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:39:09,183::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:39:09,184::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:39:09,184::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:39:09,184::task::990::TaskManager.Task::(_decref) Task=`530853ef-232b-4031-8005-8dc07938dbcd`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:39:10,486::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:39:10,567::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0415633 s, 24.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:39:12,580::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:39:12,655::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357716 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:39:14,667::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:39:14,742::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351184 s, 29.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:39:16,333::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:39:16,343::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000650804 s, 6.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:39:16,754::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:39:16,830::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036129 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:39:18,842::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:39:18,917::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349808 s, 29.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:39:19,258::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [6674a7d7] >Thread-14::DEBUG::2014-07-24 10:39:19,259::task::595::TaskManager.Task::(_updateState) Task=`612c3131-01b3-440a-9915-a452ea0c616f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:39:19,259::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:39:19,259::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:39:19,260::task::1185::TaskManager.Task::(prepare) Task=`612c3131-01b3-440a-9915-a452ea0c616f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:39:19,260::task::595::TaskManager.Task::(_updateState) Task=`612c3131-01b3-440a-9915-a452ea0c616f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:39:19,260::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:39:19,260::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:39:19,260::task::990::TaskManager.Task::(_decref) Task=`612c3131-01b3-440a-9915-a452ea0c616f`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:39:19,292::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [6674a7d7] >Thread-34::DEBUG::2014-07-24 10:39:19,293::task::595::TaskManager.Task::(_updateState) Task=`3e2f3503-e1a6-486f-8549-626726286ab5`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:39:19,293::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:39:19,293::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`52a23213-0ee7-47fd-88ab-2695c53e626a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:39:19,293::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:39:19,294::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:39:19,294::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`52a23213-0ee7-47fd-88ab-2695c53e626a`::Granted request >Thread-34::DEBUG::2014-07-24 10:39:19,294::task::827::TaskManager.Task::(resourceAcquired) Task=`3e2f3503-e1a6-486f-8549-626726286ab5`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:39:19,294::task::990::TaskManager.Task::(_decref) Task=`3e2f3503-e1a6-486f-8549-626726286ab5`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:39:19,295::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:39:19,295::task::1185::TaskManager.Task::(prepare) Task=`3e2f3503-e1a6-486f-8549-626726286ab5`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:39:19,295::task::595::TaskManager.Task::(_updateState) Task=`3e2f3503-e1a6-486f-8549-626726286ab5`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:39:19,296::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:39:19,296::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:39:19,296::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:39:19,296::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:39:19,296::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:39:19,297::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:39:19,297::task::990::TaskManager.Task::(_decref) Task=`3e2f3503-e1a6-486f-8549-626726286ab5`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:39:20,071::task::595::TaskManager.Task::(_updateState) Task=`9255d993-e4d0-4023-b446-142488b7257a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:39:20,072::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:39:20,072::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000650804', 'lastCheck': '3.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:39:20,072::task::1185::TaskManager.Task::(prepare) Task=`9255d993-e4d0-4023-b446-142488b7257a`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000650804', 'lastCheck': '3.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:39:20,072::task::595::TaskManager.Task::(_updateState) Task=`9255d993-e4d0-4023-b446-142488b7257a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:39:20,073::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:39:20,073::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:39:20,073::task::990::TaskManager.Task::(_decref) Task=`9255d993-e4d0-4023-b446-142488b7257a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:39:20,928::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:39:21,003::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363691 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:39:23,015::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:39:23,089::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346531 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:39:25,101::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:39:25,178::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368461 s, 27.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:39:26,347::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:39:26,357::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000814862 s, 5.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:39:26,498::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:39:27,190::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:39:27,265::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345351 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:39:29,281::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:39:29,355::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353971 s, 28.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:39:29,368::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:39:29,368::task::595::TaskManager.Task::(_updateState) Task=`8aa4949d-04b8-4573-801f-e8c6ab6fca3f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:39:29,368::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:39:29,369::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:39:29,369::task::1185::TaskManager.Task::(prepare) Task=`8aa4949d-04b8-4573-801f-e8c6ab6fca3f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:39:29,369::task::595::TaskManager.Task::(_updateState) Task=`8aa4949d-04b8-4573-801f-e8c6ab6fca3f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:39:29,369::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:39:29,369::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:39:29,370::task::990::TaskManager.Task::(_decref) Task=`8aa4949d-04b8-4573-801f-e8c6ab6fca3f`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:39:29,423::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:39:29,423::task::595::TaskManager.Task::(_updateState) Task=`e2da2df5-9804-45c5-8b9f-a430c12feda1`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:39:29,423::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:39:29,423::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`bc07ca4f-f897-44db-b996-abcc3cd6a4bd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:39:29,424::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:39:29,424::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:39:29,424::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`bc07ca4f-f897-44db-b996-abcc3cd6a4bd`::Granted request >Thread-34::DEBUG::2014-07-24 10:39:29,424::task::827::TaskManager.Task::(resourceAcquired) Task=`e2da2df5-9804-45c5-8b9f-a430c12feda1`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:39:29,425::task::990::TaskManager.Task::(_decref) Task=`e2da2df5-9804-45c5-8b9f-a430c12feda1`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:39:29,425::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:39:29,425::task::1185::TaskManager.Task::(prepare) Task=`e2da2df5-9804-45c5-8b9f-a430c12feda1`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:39:29,426::task::595::TaskManager.Task::(_updateState) Task=`e2da2df5-9804-45c5-8b9f-a430c12feda1`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:39:29,426::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:39:29,426::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:39:29,426::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:39:29,426::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:39:29,427::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:39:29,427::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:39:29,427::task::990::TaskManager.Task::(_decref) Task=`e2da2df5-9804-45c5-8b9f-a430c12feda1`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:39:31,367::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:39:31,442::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355974 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:39:33,455::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:39:33,536::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0415642 s, 24.6 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:39:35,486::task::595::TaskManager.Task::(_updateState) Task=`2521c9df-15d0-48a8-8030-d81a2bb86c77`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:39:35,486::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:39:35,487::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000814862', 'lastCheck': '9.1', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:39:35,487::task::1185::TaskManager.Task::(prepare) Task=`2521c9df-15d0-48a8-8030-d81a2bb86c77`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000814862', 'lastCheck': '9.1', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:39:35,487::task::595::TaskManager.Task::(_updateState) Task=`2521c9df-15d0-48a8-8030-d81a2bb86c77`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:39:35,487::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:39:35,487::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:39:35,488::task::990::TaskManager.Task::(_decref) Task=`2521c9df-15d0-48a8-8030-d81a2bb86c77`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:39:35,548::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:39:35,868::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.150818 s, 6.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:39:36,362::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:39:36,383::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0116812 s, 351 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:39:37,880::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:39:37,955::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348383 s, 29.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:39:39,488::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:39:39,488::task::595::TaskManager.Task::(_updateState) Task=`ff86f7a7-b7a8-4ee8-934f-327cf8205657`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:39:39,489::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:39:39,489::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:39:39,489::task::1185::TaskManager.Task::(prepare) Task=`ff86f7a7-b7a8-4ee8-934f-327cf8205657`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:39:39,489::task::595::TaskManager.Task::(_updateState) Task=`ff86f7a7-b7a8-4ee8-934f-327cf8205657`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:39:39,489::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:39:39,489::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:39:39,490::task::990::TaskManager.Task::(_decref) Task=`ff86f7a7-b7a8-4ee8-934f-327cf8205657`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:39:39,520::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:39:39,520::task::595::TaskManager.Task::(_updateState) Task=`9c92b784-507b-4665-b5cb-1c365ade3af7`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:39:39,521::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:39:39,521::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`168a0824-42db-41f0-bdee-50f91880601f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:39:39,521::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:39:39,522::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:39:39,522::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`168a0824-42db-41f0-bdee-50f91880601f`::Granted request >Thread-34::DEBUG::2014-07-24 10:39:39,522::task::827::TaskManager.Task::(resourceAcquired) Task=`9c92b784-507b-4665-b5cb-1c365ade3af7`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:39:39,522::task::990::TaskManager.Task::(_decref) Task=`9c92b784-507b-4665-b5cb-1c365ade3af7`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:39:39,523::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:39:39,523::task::1185::TaskManager.Task::(prepare) Task=`9c92b784-507b-4665-b5cb-1c365ade3af7`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:39:39,523::task::595::TaskManager.Task::(_updateState) Task=`9c92b784-507b-4665-b5cb-1c365ade3af7`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:39:39,523::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:39:39,524::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:39:39,524::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:39:39,524::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:39:39,524::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:39:39,524::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:39:39,525::task::990::TaskManager.Task::(_decref) Task=`9c92b784-507b-4665-b5cb-1c365ade3af7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:39:39,967::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:39:40,044::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347924 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:39:42,056::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:39:42,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341315 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:39:44,141::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:39:44,215::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341314 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:39:46,227::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:39:46,301::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352639 s, 29.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:39:46,388::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:39:46,397::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00105984 s, 3.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:39:48,314::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:39:48,387::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342913 s, 29.9 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:39:49,589::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [3b38bf98] >Thread-13::DEBUG::2014-07-24 10:39:49,589::task::595::TaskManager.Task::(_updateState) Task=`2455a0b6-60f9-4989-8a47-7356d82d3134`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:39:49,590::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:39:49,590::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:39:49,590::task::1185::TaskManager.Task::(prepare) Task=`2455a0b6-60f9-4989-8a47-7356d82d3134`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:39:49,590::task::595::TaskManager.Task::(_updateState) Task=`2455a0b6-60f9-4989-8a47-7356d82d3134`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:39:49,591::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:39:49,591::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:39:49,591::task::990::TaskManager.Task::(_decref) Task=`2455a0b6-60f9-4989-8a47-7356d82d3134`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:39:49,625::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [3b38bf98] >Thread-34::DEBUG::2014-07-24 10:39:49,625::task::595::TaskManager.Task::(_updateState) Task=`53526805-2cb4-406f-88cb-94b4dc181c79`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:39:49,625::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:39:49,626::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ffda544a-ca6a-4d59-b5fc-76a20359d8aa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:39:49,626::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:39:49,626::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:39:49,626::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ffda544a-ca6a-4d59-b5fc-76a20359d8aa`::Granted request >Thread-34::DEBUG::2014-07-24 10:39:49,627::task::827::TaskManager.Task::(resourceAcquired) Task=`53526805-2cb4-406f-88cb-94b4dc181c79`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:39:49,627::task::990::TaskManager.Task::(_decref) Task=`53526805-2cb4-406f-88cb-94b4dc181c79`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:39:49,628::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:39:49,628::task::1185::TaskManager.Task::(prepare) Task=`53526805-2cb4-406f-88cb-94b4dc181c79`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:39:49,628::task::595::TaskManager.Task::(_updateState) Task=`53526805-2cb4-406f-88cb-94b4dc181c79`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:39:49,628::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:39:49,628::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:39:49,629::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:39:49,629::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:39:49,629::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:39:49,629::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:39:49,629::task::990::TaskManager.Task::(_decref) Task=`53526805-2cb4-406f-88cb-94b4dc181c79`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:39:50,400::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:39:50,473::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342564 s, 29.9 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:39:50,911::task::595::TaskManager.Task::(_updateState) Task=`3ef03586-17e2-4cad-a571-95630034a08d`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:39:50,911::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:39:50,911::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00105984', 'lastCheck': '4.5', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:39:50,912::task::1185::TaskManager.Task::(prepare) Task=`3ef03586-17e2-4cad-a571-95630034a08d`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00105984', 'lastCheck': '4.5', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:39:50,912::task::595::TaskManager.Task::(_updateState) Task=`3ef03586-17e2-4cad-a571-95630034a08d`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:39:50,912::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:39:50,912::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:39:50,912::task::990::TaskManager.Task::(_decref) Task=`3ef03586-17e2-4cad-a571-95630034a08d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:39:52,485::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:39:52,564::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373729 s, 27.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:39:54,577::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:39:54,650::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349138 s, 29.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:39:56,402::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:39:56,416::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00574854 s, 713 kB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:39:56,534::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:39:56,663::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:39:56,738::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360006 s, 28.4 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 10:39:57,202::task::595::TaskManager.Task::(_updateState) Task=`313c07f4-cb84-4b8c-9286-1f80c8c82643`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 10:39:57,202::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 10:39:57,203::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:39:57,203::task::1185::TaskManager.Task::(prepare) Task=`313c07f4-cb84-4b8c-9286-1f80c8c82643`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:39:57,203::task::595::TaskManager.Task::(_updateState) Task=`313c07f4-cb84-4b8c-9286-1f80c8c82643`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 10:39:57,203::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 10:39:57,203::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 10:39:57,204::task::990::TaskManager.Task::(_decref) Task=`313c07f4-cb84-4b8c-9286-1f80c8c82643`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:39:58,751::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:39:58,826::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364751 s, 28.1 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:39:59,688::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:39:59,689::task::595::TaskManager.Task::(_updateState) Task=`fa0d971b-c44b-4be5-b9e1-7fd9a585dead`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:39:59,689::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:39:59,689::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:39:59,690::task::1185::TaskManager.Task::(prepare) Task=`fa0d971b-c44b-4be5-b9e1-7fd9a585dead`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:39:59,690::task::595::TaskManager.Task::(_updateState) Task=`fa0d971b-c44b-4be5-b9e1-7fd9a585dead`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:39:59,690::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:39:59,690::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:39:59,690::task::990::TaskManager.Task::(_decref) Task=`fa0d971b-c44b-4be5-b9e1-7fd9a585dead`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:39:59,721::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:39:59,721::task::595::TaskManager.Task::(_updateState) Task=`ce88b6c5-385e-4c86-89de-17a3642dcfda`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:39:59,721::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:39:59,722::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ba13b8a3-d59e-4d61-990a-75b7f9146431`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:39:59,722::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:39:59,722::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:39:59,722::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ba13b8a3-d59e-4d61-990a-75b7f9146431`::Granted request >Thread-34::DEBUG::2014-07-24 10:39:59,723::task::827::TaskManager.Task::(resourceAcquired) Task=`ce88b6c5-385e-4c86-89de-17a3642dcfda`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:39:59,723::task::990::TaskManager.Task::(_decref) Task=`ce88b6c5-385e-4c86-89de-17a3642dcfda`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:39:59,724::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:39:59,724::task::1185::TaskManager.Task::(prepare) Task=`ce88b6c5-385e-4c86-89de-17a3642dcfda`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:39:59,724::task::595::TaskManager.Task::(_updateState) Task=`ce88b6c5-385e-4c86-89de-17a3642dcfda`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:39:59,724::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:39:59,724::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:39:59,725::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:39:59,725::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:39:59,725::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:39:59,725::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:39:59,725::task::990::TaskManager.Task::(_decref) Task=`ce88b6c5-385e-4c86-89de-17a3642dcfda`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:40:00,838::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:40:00,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342042 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:40:02,925::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:40:02,998::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340039 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:40:05,015::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:40:05,100::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0408871 s, 25.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:40:06,420::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:40:06,441::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0117768 s, 348 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:40:06,460::task::595::TaskManager.Task::(_updateState) Task=`72f9803b-b507-4865-951d-c87430528b3e`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:40:06,460::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:40:06,461::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0117768', 'lastCheck': '0.0', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:40:06,461::task::1185::TaskManager.Task::(prepare) Task=`72f9803b-b507-4865-951d-c87430528b3e`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0117768', 'lastCheck': '0.0', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:40:06,461::task::595::TaskManager.Task::(_updateState) Task=`72f9803b-b507-4865-951d-c87430528b3e`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:40:06,461::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:40:06,461::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:40:06,462::task::990::TaskManager.Task::(_decref) Task=`72f9803b-b507-4865-951d-c87430528b3e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:40:07,113::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:40:07,187::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349184 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:40:09,199::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:40:09,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365547 s, 28.0 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:40:09,789::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:40:09,790::task::595::TaskManager.Task::(_updateState) Task=`c85d9f0f-77c9-4830-8ba3-ec51711a3834`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:40:09,790::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:40:09,790::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:40:09,790::task::1185::TaskManager.Task::(prepare) Task=`c85d9f0f-77c9-4830-8ba3-ec51711a3834`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:40:09,791::task::595::TaskManager.Task::(_updateState) Task=`c85d9f0f-77c9-4830-8ba3-ec51711a3834`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:40:09,791::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:40:09,791::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:40:09,791::task::990::TaskManager.Task::(_decref) Task=`c85d9f0f-77c9-4830-8ba3-ec51711a3834`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:40:09,824::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:40:09,824::task::595::TaskManager.Task::(_updateState) Task=`f0049ff2-0d75-4034-be2c-81e2d6f65dc9`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:40:09,824::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:40:09,825::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e65623e5-fc11-4e58-858b-136e53cfbabe`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:40:09,825::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:40:09,825::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:40:09,825::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e65623e5-fc11-4e58-858b-136e53cfbabe`::Granted request >Thread-34::DEBUG::2014-07-24 10:40:09,826::task::827::TaskManager.Task::(resourceAcquired) Task=`f0049ff2-0d75-4034-be2c-81e2d6f65dc9`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:40:09,826::task::990::TaskManager.Task::(_decref) Task=`f0049ff2-0d75-4034-be2c-81e2d6f65dc9`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:40:09,826::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:40:09,827::task::1185::TaskManager.Task::(prepare) Task=`f0049ff2-0d75-4034-be2c-81e2d6f65dc9`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:40:09,827::task::595::TaskManager.Task::(_updateState) Task=`f0049ff2-0d75-4034-be2c-81e2d6f65dc9`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:40:09,827::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:40:09,827::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:40:09,827::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:40:09,828::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:40:09,828::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:40:09,828::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:40:09,828::task::990::TaskManager.Task::(_decref) Task=`f0049ff2-0d75-4034-be2c-81e2d6f65dc9`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:40:11,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:40:11,362::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336002 s, 30.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:40:13,374::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:40:13,472::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035129 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:40:15,484::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:40:15,558::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342475 s, 29.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:40:16,446::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:40:16,475::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0200252 s, 205 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:40:17,570::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:40:17,646::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362093 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:40:19,658::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:40:19,733::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350134 s, 29.2 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:40:19,889::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:40:19,890::task::595::TaskManager.Task::(_updateState) Task=`257261b7-db1f-4a46-8b22-59acf39072ee`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:40:19,890::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:40:19,890::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:40:19,890::task::1185::TaskManager.Task::(prepare) Task=`257261b7-db1f-4a46-8b22-59acf39072ee`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:40:19,891::task::595::TaskManager.Task::(_updateState) Task=`257261b7-db1f-4a46-8b22-59acf39072ee`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:40:19,891::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:40:19,891::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:40:19,891::task::990::TaskManager.Task::(_decref) Task=`257261b7-db1f-4a46-8b22-59acf39072ee`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:40:19,925::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:40:19,925::task::595::TaskManager.Task::(_updateState) Task=`f4fc7102-ce90-4c6a-a22b-9450c549931b`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:40:19,925::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:40:19,926::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`836ccf97-1334-472c-94c6-8ae6e3acd5a8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:40:19,926::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:40:19,926::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:40:19,928::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`836ccf97-1334-472c-94c6-8ae6e3acd5a8`::Granted request >Thread-34::DEBUG::2014-07-24 10:40:19,928::task::827::TaskManager.Task::(resourceAcquired) Task=`f4fc7102-ce90-4c6a-a22b-9450c549931b`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:40:19,928::task::990::TaskManager.Task::(_decref) Task=`f4fc7102-ce90-4c6a-a22b-9450c549931b`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:40:19,929::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:40:19,929::task::1185::TaskManager.Task::(prepare) Task=`f4fc7102-ce90-4c6a-a22b-9450c549931b`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:40:19,929::task::595::TaskManager.Task::(_updateState) Task=`f4fc7102-ce90-4c6a-a22b-9450c549931b`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:40:19,930::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:40:19,930::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:40:19,930::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:40:19,930::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:40:19,930::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:40:19,930::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:40:19,931::task::990::TaskManager.Task::(_decref) Task=`f4fc7102-ce90-4c6a-a22b-9450c549931b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:40:21,746::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:40:21,820::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342845 s, 29.9 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:40:22,092::task::595::TaskManager.Task::(_updateState) Task=`19854d01-c57d-45dd-8764-de7479e5136b`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:40:22,093::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:40:22,093::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0200252', 'lastCheck': '5.6', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:40:22,093::task::1185::TaskManager.Task::(prepare) Task=`19854d01-c57d-45dd-8764-de7479e5136b`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0200252', 'lastCheck': '5.6', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:40:22,093::task::595::TaskManager.Task::(_updateState) Task=`19854d01-c57d-45dd-8764-de7479e5136b`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:40:22,093::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:40:22,093::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:40:22,094::task::990::TaskManager.Task::(_decref) Task=`19854d01-c57d-45dd-8764-de7479e5136b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:40:23,832::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:40:23,906::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351229 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:40:25,918::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:40:26,159::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358179 s, 28.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:40:26,480::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:40:26,489::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000701767 s, 5.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:40:26,570::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:40:28,247::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:40:28,323::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362825 s, 28.2 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:40:29,990::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:40:29,990::task::595::TaskManager.Task::(_updateState) Task=`a13f40a7-d9f4-4d96-9754-6a72ee5317f6`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:40:29,991::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:40:29,991::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:40:29,991::task::1185::TaskManager.Task::(prepare) Task=`a13f40a7-d9f4-4d96-9754-6a72ee5317f6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:40:29,991::task::595::TaskManager.Task::(_updateState) Task=`a13f40a7-d9f4-4d96-9754-6a72ee5317f6`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:40:29,991::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:40:29,992::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:40:29,992::task::990::TaskManager.Task::(_decref) Task=`a13f40a7-d9f4-4d96-9754-6a72ee5317f6`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:40:30,023::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:40:30,023::task::595::TaskManager.Task::(_updateState) Task=`90cba13e-1a8e-4d5a-9391-2a639aa316ed`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:40:30,024::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:40:30,024::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`0e0e7690-5a91-4133-a0da-69c2cbaf16d9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:40:30,024::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:40:30,024::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:40:30,025::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`0e0e7690-5a91-4133-a0da-69c2cbaf16d9`::Granted request >Thread-34::DEBUG::2014-07-24 10:40:30,025::task::827::TaskManager.Task::(resourceAcquired) Task=`90cba13e-1a8e-4d5a-9391-2a639aa316ed`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:40:30,025::task::990::TaskManager.Task::(_decref) Task=`90cba13e-1a8e-4d5a-9391-2a639aa316ed`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:40:30,026::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:40:30,026::task::1185::TaskManager.Task::(prepare) Task=`90cba13e-1a8e-4d5a-9391-2a639aa316ed`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:40:30,026::task::595::TaskManager.Task::(_updateState) Task=`90cba13e-1a8e-4d5a-9391-2a639aa316ed`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:40:30,026::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:40:30,027::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:40:30,027::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:40:30,027::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:40:30,027::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:40:30,027::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:40:30,027::task::990::TaskManager.Task::(_decref) Task=`90cba13e-1a8e-4d5a-9391-2a639aa316ed`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:40:30,335::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:40:30,411::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361306 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:40:32,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:40:32,498::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362699 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:40:34,510::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:40:34,593::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0393506 s, 26.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:40:36,493::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:40:36,503::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000845759 s, 4.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:40:36,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:40:36,679::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346517 s, 29.6 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:40:37,618::task::595::TaskManager.Task::(_updateState) Task=`20dd241d-a71e-436a-b8e1-2e187f1cf595`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:40:37,618::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:40:37,618::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000845759', 'lastCheck': '1.1', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:40:37,618::task::1185::TaskManager.Task::(prepare) Task=`20dd241d-a71e-436a-b8e1-2e187f1cf595`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000845759', 'lastCheck': '1.1', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:40:37,619::task::595::TaskManager.Task::(_updateState) Task=`20dd241d-a71e-436a-b8e1-2e187f1cf595`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:40:37,619::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:40:37,619::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:40:37,619::task::990::TaskManager.Task::(_decref) Task=`20dd241d-a71e-436a-b8e1-2e187f1cf595`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:40:38,693::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:40:38,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351593 s, 29.1 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:40:40,100::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:40:40,101::task::595::TaskManager.Task::(_updateState) Task=`29408452-8897-4e1a-9ea6-c41245769ab5`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:40:40,101::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:40:40,101::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:40:40,101::task::1185::TaskManager.Task::(prepare) Task=`29408452-8897-4e1a-9ea6-c41245769ab5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:40:40,101::task::595::TaskManager.Task::(_updateState) Task=`29408452-8897-4e1a-9ea6-c41245769ab5`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:40:40,102::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:40:40,102::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:40:40,102::task::990::TaskManager.Task::(_decref) Task=`29408452-8897-4e1a-9ea6-c41245769ab5`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:40:40,268::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:40:40,268::task::595::TaskManager.Task::(_updateState) Task=`08ab3bf0-6a6b-4485-a8af-8e2d64c3141e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:40:40,268::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:40:40,269::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`5a981157-66cf-4a8c-bf08-a35a2db9da5d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:40:40,269::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:40:40,269::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:40:40,269::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`5a981157-66cf-4a8c-bf08-a35a2db9da5d`::Granted request >Thread-34::DEBUG::2014-07-24 10:40:40,270::task::827::TaskManager.Task::(resourceAcquired) Task=`08ab3bf0-6a6b-4485-a8af-8e2d64c3141e`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:40:40,270::task::990::TaskManager.Task::(_decref) Task=`08ab3bf0-6a6b-4485-a8af-8e2d64c3141e`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:40:40,270::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:40:40,271::task::1185::TaskManager.Task::(prepare) Task=`08ab3bf0-6a6b-4485-a8af-8e2d64c3141e`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:40:40,271::task::595::TaskManager.Task::(_updateState) Task=`08ab3bf0-6a6b-4485-a8af-8e2d64c3141e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:40:40,271::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:40:40,271::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:40:40,271::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:40:40,271::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:40:40,272::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:40:40,272::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:40:40,272::task::990::TaskManager.Task::(_decref) Task=`08ab3bf0-6a6b-4485-a8af-8e2d64c3141e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:40:40,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:40:40,858::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0385214 s, 26.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:40:42,870::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:40:42,944::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339845 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:40:44,956::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:40:45,048::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0431495 s, 23.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:40:46,508::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:40:46,516::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000646832 s, 6.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:40:47,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:40:47,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354787 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:40:49,150::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:40:49,225::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368182 s, 27.8 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:40:50,381::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:40:50,392::task::595::TaskManager.Task::(_updateState) Task=`163df804-1023-4bf3-b6df-4e821fcd4611`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:40:50,392::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:40:50,393::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:40:50,393::task::1185::TaskManager.Task::(prepare) Task=`163df804-1023-4bf3-b6df-4e821fcd4611`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:40:50,393::task::595::TaskManager.Task::(_updateState) Task=`163df804-1023-4bf3-b6df-4e821fcd4611`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:40:50,393::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:40:50,393::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:40:50,393::task::990::TaskManager.Task::(_decref) Task=`163df804-1023-4bf3-b6df-4e821fcd4611`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:40:50,434::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:40:50,434::task::595::TaskManager.Task::(_updateState) Task=`7827972c-5231-4439-bb8b-039cdb495d44`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:40:50,435::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:40:50,435::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`db1e9975-cf6b-450f-a9a6-f3c4cb5990ce`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:40:50,435::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:40:50,435::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:40:50,436::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`db1e9975-cf6b-450f-a9a6-f3c4cb5990ce`::Granted request >Thread-34::DEBUG::2014-07-24 10:40:50,436::task::827::TaskManager.Task::(resourceAcquired) Task=`7827972c-5231-4439-bb8b-039cdb495d44`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:40:50,436::task::990::TaskManager.Task::(_decref) Task=`7827972c-5231-4439-bb8b-039cdb495d44`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:40:50,437::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:40:50,437::task::1185::TaskManager.Task::(prepare) Task=`7827972c-5231-4439-bb8b-039cdb495d44`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:40:50,437::task::595::TaskManager.Task::(_updateState) Task=`7827972c-5231-4439-bb8b-039cdb495d44`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:40:50,437::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:40:50,437::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:40:50,438::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:40:50,438::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:40:50,438::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:40:50,438::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:40:50,438::task::990::TaskManager.Task::(_decref) Task=`7827972c-5231-4439-bb8b-039cdb495d44`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:40:51,238::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:40:51,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341063 s, 30.0 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:40:53,306::task::595::TaskManager.Task::(_updateState) Task=`5e489505-e6e5-4cd3-b9eb-c6d45173891f`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:40:53,306::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:40:53,306::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000646832', 'lastCheck': '6.8', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:40:53,307::task::1185::TaskManager.Task::(prepare) Task=`5e489505-e6e5-4cd3-b9eb-c6d45173891f`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000646832', 'lastCheck': '6.8', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:40:53,307::task::595::TaskManager.Task::(_updateState) Task=`5e489505-e6e5-4cd3-b9eb-c6d45173891f`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:40:53,307::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:40:53,307::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:40:53,307::task::990::TaskManager.Task::(_decref) Task=`5e489505-e6e5-4cd3-b9eb-c6d45173891f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:40:53,324::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:40:53,401::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365183 s, 28.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:40:55,414::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:40:55,489::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355724 s, 28.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:40:56,521::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:40:56,530::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000657337 s, 6.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:40:56,606::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-37::DEBUG::2014-07-24 10:40:57,362::task::595::TaskManager.Task::(_updateState) Task=`4342854a-2e2c-49ba-8de2-51b597067d46`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 10:40:57,362::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 10:40:57,362::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:40:57,362::task::1185::TaskManager.Task::(prepare) Task=`4342854a-2e2c-49ba-8de2-51b597067d46`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:40:57,363::task::595::TaskManager.Task::(_updateState) Task=`4342854a-2e2c-49ba-8de2-51b597067d46`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 10:40:57,363::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 10:40:57,363::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 10:40:57,363::task::990::TaskManager.Task::(_decref) Task=`4342854a-2e2c-49ba-8de2-51b597067d46`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:40:57,502::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:40:57,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337347 s, 30.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:40:59,599::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:40:59,676::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0377758 s, 27.1 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:41:00,521::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:41:00,541::task::595::TaskManager.Task::(_updateState) Task=`a55cd0f6-b592-4014-b28f-40e9c81b29e9`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:41:00,541::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:41:00,541::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:41:00,542::task::1185::TaskManager.Task::(prepare) Task=`a55cd0f6-b592-4014-b28f-40e9c81b29e9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:41:00,542::task::595::TaskManager.Task::(_updateState) Task=`a55cd0f6-b592-4014-b28f-40e9c81b29e9`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:41:00,542::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:41:00,542::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:41:00,542::task::990::TaskManager.Task::(_decref) Task=`a55cd0f6-b592-4014-b28f-40e9c81b29e9`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:41:00,585::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:41:00,585::task::595::TaskManager.Task::(_updateState) Task=`d67772da-d990-40a0-950c-fcf4c02318f6`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:41:00,586::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:41:00,586::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`68def60c-8faa-4351-8898-cbcbc2738cb2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:41:00,586::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:41:00,586::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:41:00,587::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`68def60c-8faa-4351-8898-cbcbc2738cb2`::Granted request >Thread-34::DEBUG::2014-07-24 10:41:00,587::task::827::TaskManager.Task::(resourceAcquired) Task=`d67772da-d990-40a0-950c-fcf4c02318f6`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:41:00,587::task::990::TaskManager.Task::(_decref) Task=`d67772da-d990-40a0-950c-fcf4c02318f6`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:41:00,588::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:41:00,588::task::1185::TaskManager.Task::(prepare) Task=`d67772da-d990-40a0-950c-fcf4c02318f6`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:41:00,588::task::595::TaskManager.Task::(_updateState) Task=`d67772da-d990-40a0-950c-fcf4c02318f6`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:41:00,588::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:41:00,589::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:41:00,589::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:41:00,589::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:41:00,589::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:41:00,589::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:41:00,589::task::990::TaskManager.Task::(_decref) Task=`d67772da-d990-40a0-950c-fcf4c02318f6`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:41:01,689::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:41:01,764::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350554 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:41:03,776::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:41:04,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.326952 s, 3.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:41:06,155::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:41:06,231::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367435 s, 27.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:41:06,534::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 23aa0606-edc3-4882-a4aa-18aa1983458f >Thread-18::DEBUG::2014-07-24 10:41:06,535::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-18::DEBUG::2014-07-24 10:41:06,535::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:41:06,544::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000714137 s, 2.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:41:06,545::misc::264::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000714137 s, 2.9 MB/s'], size: 2048 >Thread-18::DEBUG::2014-07-24 10:41:06,545::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-18::WARNING::2014-07-24 10:41:06,545::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-18::DEBUG::2014-07-24 10:41:06,545::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-18::DEBUG::2014-07-24 10:41:06,546::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 10:41:06,546::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 10:41:06,546::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 10:41:06,546::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 10:41:06,546::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 10:41:06,547::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-18::DEBUG::2014-07-24 10:41:06,740::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:41:06,742::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 10:41:06,742::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'LOCKPOLICY=', 'POOL_DOMAINS=23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'POOL_DESCRIPTION=DS1', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_UUID=637ea13c-81a8-4b44-8cab-961458b01883', 'POOL_SPM_ID=1', '_SHA_CKSUM=a749afdc7119a2d6aad840af5c63c9b28c0b612c', 'POOL_SPM_LVER=0'] >Thread-18::INFO::2014-07-24 10:41:06,743::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_imageNS already registered >Thread-18::INFO::2014-07-24 10:41:06,743::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_volumeNS already registered >Thread-18::INFO::2014-07-24 10:41:06,743::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_lvmActivationNS already registered >Thread-18::DEBUG::2014-07-24 10:41:06,744::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-18::DEBUG::2014-07-24 10:41:06,896::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:41:06,897::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:41:06,906::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000611838 s, 6.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:41:08,244::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:41:08,317::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341599 s, 30.0 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:41:08,740::task::595::TaskManager.Task::(_updateState) Task=`34e293f7-16db-4349-ae86-84ade7cae2b8`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:41:08,740::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:41:08,741::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000611838', 'lastCheck': '1.8', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:41:08,741::task::1185::TaskManager.Task::(prepare) Task=`34e293f7-16db-4349-ae86-84ade7cae2b8`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000611838', 'lastCheck': '1.8', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:41:08,741::task::595::TaskManager.Task::(_updateState) Task=`34e293f7-16db-4349-ae86-84ade7cae2b8`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:41:08,741::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:41:08,741::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:41:08,741::task::990::TaskManager.Task::(_decref) Task=`34e293f7-16db-4349-ae86-84ade7cae2b8`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:41:10,330::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:41:10,403::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348666 s, 29.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:41:10,649::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:41:10,649::task::595::TaskManager.Task::(_updateState) Task=`4fe6b4f2-e041-4cc3-a846-80b957c5a953`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:41:10,650::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:41:10,650::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:41:10,650::task::1185::TaskManager.Task::(prepare) Task=`4fe6b4f2-e041-4cc3-a846-80b957c5a953`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:41:10,650::task::595::TaskManager.Task::(_updateState) Task=`4fe6b4f2-e041-4cc3-a846-80b957c5a953`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:41:10,650::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:41:10,651::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:41:10,651::task::990::TaskManager.Task::(_decref) Task=`4fe6b4f2-e041-4cc3-a846-80b957c5a953`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:41:10,682::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:41:10,682::task::595::TaskManager.Task::(_updateState) Task=`1edff996-3cec-4696-bece-86b51badf409`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:41:10,682::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:41:10,683::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`72f4d226-cc88-4891-a273-b76db83c707d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:41:10,683::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:41:10,683::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:41:10,683::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`72f4d226-cc88-4891-a273-b76db83c707d`::Granted request >Thread-34::DEBUG::2014-07-24 10:41:10,684::task::827::TaskManager.Task::(resourceAcquired) Task=`1edff996-3cec-4696-bece-86b51badf409`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:41:10,684::task::990::TaskManager.Task::(_decref) Task=`1edff996-3cec-4696-bece-86b51badf409`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:41:10,685::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:41:10,685::task::1185::TaskManager.Task::(prepare) Task=`1edff996-3cec-4696-bece-86b51badf409`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:41:10,685::task::595::TaskManager.Task::(_updateState) Task=`1edff996-3cec-4696-bece-86b51badf409`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:41:10,685::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:41:10,685::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:41:10,685::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:41:10,686::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:41:10,686::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:41:10,686::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:41:10,686::task::990::TaskManager.Task::(_decref) Task=`1edff996-3cec-4696-bece-86b51badf409`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:41:12,416::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:41:12,490::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347213 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:41:14,502::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:41:14,578::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367361 s, 27.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:41:16,590::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:41:16,665::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354249 s, 28.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:41:16,911::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:41:16,921::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000636545 s, 6.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:41:18,678::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:41:18,752::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347942 s, 29.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:41:20,740::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:41:20,741::task::595::TaskManager.Task::(_updateState) Task=`5978dc5d-1c66-4e9c-ad95-dc66a49e2762`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:41:20,741::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:41:20,741::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:41:20,741::task::1185::TaskManager.Task::(prepare) Task=`5978dc5d-1c66-4e9c-ad95-dc66a49e2762`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:41:20,741::task::595::TaskManager.Task::(_updateState) Task=`5978dc5d-1c66-4e9c-ad95-dc66a49e2762`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:41:20,742::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:41:20,742::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:41:20,742::task::990::TaskManager.Task::(_decref) Task=`5978dc5d-1c66-4e9c-ad95-dc66a49e2762`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:41:20,764::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-34::DEBUG::2014-07-24 10:41:20,775::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:41:20,776::task::595::TaskManager.Task::(_updateState) Task=`35569a5f-cadd-42ce-9b4c-7eee10fa1964`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:41:20,776::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:41:20,776::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e9720fce-4cb3-4fa9-9286-f39d6a509d36`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:41:20,777::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:41:20,777::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:41:20,777::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e9720fce-4cb3-4fa9-9286-f39d6a509d36`::Granted request >Thread-34::DEBUG::2014-07-24 10:41:20,777::task::827::TaskManager.Task::(resourceAcquired) Task=`35569a5f-cadd-42ce-9b4c-7eee10fa1964`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:41:20,778::task::990::TaskManager.Task::(_decref) Task=`35569a5f-cadd-42ce-9b4c-7eee10fa1964`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:41:20,778::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:41:20,779::task::1185::TaskManager.Task::(prepare) Task=`35569a5f-cadd-42ce-9b4c-7eee10fa1964`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:41:20,779::task::595::TaskManager.Task::(_updateState) Task=`35569a5f-cadd-42ce-9b4c-7eee10fa1964`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:41:20,779::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:41:20,779::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:41:20,779::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:41:20,780::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:41:20,780::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:41:20,780::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:41:20,780::task::990::TaskManager.Task::(_decref) Task=`35569a5f-cadd-42ce-9b4c-7eee10fa1964`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:41:20,840::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366299 s, 28.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:41:22,852::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:41:22,929::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0381221 s, 26.9 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:41:24,170::task::595::TaskManager.Task::(_updateState) Task=`2e5dfe9c-20ac-49da-8659-a9fd5744ae33`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:41:24,170::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:41:24,170::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636545', 'lastCheck': '7.2', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:41:24,170::task::1185::TaskManager.Task::(prepare) Task=`2e5dfe9c-20ac-49da-8659-a9fd5744ae33`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000636545', 'lastCheck': '7.2', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:41:24,171::task::595::TaskManager.Task::(_updateState) Task=`2e5dfe9c-20ac-49da-8659-a9fd5744ae33`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:41:24,171::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:41:24,171::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:41:24,171::task::990::TaskManager.Task::(_decref) Task=`2e5dfe9c-20ac-49da-8659-a9fd5744ae33`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:41:24,942::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:41:25,020::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359983 s, 28.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:41:26,642::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-18::DEBUG::2014-07-24 10:41:26,926::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:41:26,935::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000712115 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:41:27,032::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:41:27,110::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0375019 s, 27.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:41:29,122::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:41:29,197::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035065 s, 29.2 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:41:30,851::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:41:30,851::task::595::TaskManager.Task::(_updateState) Task=`acfd8d79-0227-434d-9c82-f319cb23a37c`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:41:30,852::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:41:30,852::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:41:30,852::task::1185::TaskManager.Task::(prepare) Task=`acfd8d79-0227-434d-9c82-f319cb23a37c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:41:30,852::task::595::TaskManager.Task::(_updateState) Task=`acfd8d79-0227-434d-9c82-f319cb23a37c`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:41:30,852::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:41:30,853::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:41:30,853::task::990::TaskManager.Task::(_decref) Task=`acfd8d79-0227-434d-9c82-f319cb23a37c`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:41:30,904::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:41:30,904::task::595::TaskManager.Task::(_updateState) Task=`4d544458-7bac-4a41-b8ea-324ad4bdd8c0`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:41:30,904::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:41:30,906::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c9195368-6db4-451b-9c55-fd25f012fe5f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:41:30,906::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:41:30,906::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:41:30,906::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c9195368-6db4-451b-9c55-fd25f012fe5f`::Granted request >Thread-34::DEBUG::2014-07-24 10:41:30,906::task::827::TaskManager.Task::(resourceAcquired) Task=`4d544458-7bac-4a41-b8ea-324ad4bdd8c0`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:41:30,907::task::990::TaskManager.Task::(_decref) Task=`4d544458-7bac-4a41-b8ea-324ad4bdd8c0`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:41:30,907::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:41:30,907::task::1185::TaskManager.Task::(prepare) Task=`4d544458-7bac-4a41-b8ea-324ad4bdd8c0`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:41:30,908::task::595::TaskManager.Task::(_updateState) Task=`4d544458-7bac-4a41-b8ea-324ad4bdd8c0`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:41:30,908::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:41:30,908::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:41:30,908::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:41:30,908::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:41:30,909::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:41:30,909::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:41:30,909::task::990::TaskManager.Task::(_decref) Task=`4d544458-7bac-4a41-b8ea-324ad4bdd8c0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:41:31,209::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:41:31,286::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362766 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:41:33,298::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:41:33,408::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0710452 s, 14.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:41:35,421::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:41:35,495::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340972 s, 30.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:41:36,940::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:41:36,949::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000737937 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:41:37,507::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:41:37,584::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0375824 s, 27.2 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:41:39,557::task::595::TaskManager.Task::(_updateState) Task=`f6b8b127-064f-4ef1-b683-5ccc44644dc2`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:41:39,557::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:41:39,558::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000737937', 'lastCheck': '2.6', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:41:39,558::task::1185::TaskManager.Task::(prepare) Task=`f6b8b127-064f-4ef1-b683-5ccc44644dc2`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000737937', 'lastCheck': '2.6', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:41:39,558::task::595::TaskManager.Task::(_updateState) Task=`f6b8b127-064f-4ef1-b683-5ccc44644dc2`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:41:39,558::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:41:39,558::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:41:39,558::task::990::TaskManager.Task::(_decref) Task=`f6b8b127-064f-4ef1-b683-5ccc44644dc2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:41:39,597::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:41:39,951::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.315196 s, 3.2 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:41:41,001::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:41:41,011::task::595::TaskManager.Task::(_updateState) Task=`4e702a4a-b2c0-4fa7-88ab-52d2679bc839`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:41:41,011::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:41:41,012::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:41:41,012::task::1185::TaskManager.Task::(prepare) Task=`4e702a4a-b2c0-4fa7-88ab-52d2679bc839`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:41:41,012::task::595::TaskManager.Task::(_updateState) Task=`4e702a4a-b2c0-4fa7-88ab-52d2679bc839`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:41:41,012::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:41:41,012::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:41:41,013::task::990::TaskManager.Task::(_decref) Task=`4e702a4a-b2c0-4fa7-88ab-52d2679bc839`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:41:41,049::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:41:41,049::task::595::TaskManager.Task::(_updateState) Task=`a13a165a-249b-4037-8c5d-195f3ef45892`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:41:41,049::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:41:41,050::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b1bd5a5c-f86a-4582-90d6-866b182f86d6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:41:41,050::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:41:41,050::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:41:41,050::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b1bd5a5c-f86a-4582-90d6-866b182f86d6`::Granted request >Thread-34::DEBUG::2014-07-24 10:41:41,051::task::827::TaskManager.Task::(resourceAcquired) Task=`a13a165a-249b-4037-8c5d-195f3ef45892`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:41:41,051::task::990::TaskManager.Task::(_decref) Task=`a13a165a-249b-4037-8c5d-195f3ef45892`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:41:41,051::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:41:41,052::task::1185::TaskManager.Task::(prepare) Task=`a13a165a-249b-4037-8c5d-195f3ef45892`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:41:41,052::task::595::TaskManager.Task::(_updateState) Task=`a13a165a-249b-4037-8c5d-195f3ef45892`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:41:41,052::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:41:41,052::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:41:41,052::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:41:41,053::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:41:41,053::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:41:41,053::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:41:41,053::task::990::TaskManager.Task::(_decref) Task=`a13a165a-249b-4037-8c5d-195f3ef45892`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:41:41,964::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:41:42,038::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350237 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:41:44,050::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:41:44,126::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366164 s, 28.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:41:46,138::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:41:46,219::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0388984 s, 26.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:41:46,954::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:41:46,963::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000795851 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:41:48,231::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:41:48,308::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369005 s, 27.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:41:50,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:41:50,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351904 s, 29.1 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:41:51,118::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:41:51,118::task::595::TaskManager.Task::(_updateState) Task=`c3bf0fb2-ee29-428b-8d82-4cd380234bf2`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:41:51,119::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:41:51,119::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:41:51,119::task::1185::TaskManager.Task::(prepare) Task=`c3bf0fb2-ee29-428b-8d82-4cd380234bf2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:41:51,119::task::595::TaskManager.Task::(_updateState) Task=`c3bf0fb2-ee29-428b-8d82-4cd380234bf2`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:41:51,120::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:41:51,120::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:41:51,120::task::990::TaskManager.Task::(_decref) Task=`c3bf0fb2-ee29-428b-8d82-4cd380234bf2`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:41:51,152::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:41:51,166::task::595::TaskManager.Task::(_updateState) Task=`b36e0374-b8ae-41ca-889b-161246595077`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:41:51,166::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:41:51,167::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`948efe31-73e1-48ef-8615-c5876fccffec`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:41:51,167::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:41:51,167::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:41:51,167::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`948efe31-73e1-48ef-8615-c5876fccffec`::Granted request >Thread-34::DEBUG::2014-07-24 10:41:51,167::task::827::TaskManager.Task::(resourceAcquired) Task=`b36e0374-b8ae-41ca-889b-161246595077`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:41:51,168::task::990::TaskManager.Task::(_decref) Task=`b36e0374-b8ae-41ca-889b-161246595077`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:41:51,168::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:41:51,169::task::1185::TaskManager.Task::(prepare) Task=`b36e0374-b8ae-41ca-889b-161246595077`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:41:51,169::task::595::TaskManager.Task::(_updateState) Task=`b36e0374-b8ae-41ca-889b-161246595077`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:41:51,169::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:41:51,169::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:41:51,169::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:41:51,169::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:41:51,170::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:41:51,170::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:41:51,170::task::990::TaskManager.Task::(_decref) Task=`b36e0374-b8ae-41ca-889b-161246595077`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:41:52,407::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:41:52,483::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036624 s, 28.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:41:54,495::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:41:54,569::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346644 s, 29.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:41:54,951::task::595::TaskManager.Task::(_updateState) Task=`0dbcbce1-b2be-47af-af20-ba1535a268b0`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:41:54,951::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:41:54,952::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000795851', 'lastCheck': '8.0', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:41:54,952::task::1185::TaskManager.Task::(prepare) Task=`0dbcbce1-b2be-47af-af20-ba1535a268b0`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000795851', 'lastCheck': '8.0', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:41:54,952::task::595::TaskManager.Task::(_updateState) Task=`0dbcbce1-b2be-47af-af20-ba1535a268b0`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:41:54,952::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:41:54,952::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:41:54,952::task::990::TaskManager.Task::(_decref) Task=`0dbcbce1-b2be-47af-af20-ba1535a268b0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:41:56,582::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:41:56,658::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367771 s, 27.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:41:56,678::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-18::DEBUG::2014-07-24 10:41:56,968::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:41:56,978::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000789298 s, 5.2 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 10:41:57,519::task::595::TaskManager.Task::(_updateState) Task=`736ec6ce-8121-4ca5-8578-0e37c5c21023`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 10:41:57,519::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 10:41:57,520::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:41:57,520::task::1185::TaskManager.Task::(prepare) Task=`736ec6ce-8121-4ca5-8578-0e37c5c21023`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:41:57,520::task::595::TaskManager.Task::(_updateState) Task=`736ec6ce-8121-4ca5-8578-0e37c5c21023`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 10:41:57,520::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 10:41:57,520::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 10:41:57,520::task::990::TaskManager.Task::(_decref) Task=`736ec6ce-8121-4ca5-8578-0e37c5c21023`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:41:58,670::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:41:58,744::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340127 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:42:00,756::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:42:00,831::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355133 s, 28.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:42:01,240::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:42:01,240::task::595::TaskManager.Task::(_updateState) Task=`1d88fc73-0c1a-4329-99e5-f7b278e567f8`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:42:01,240::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:42:01,241::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:42:01,241::task::1185::TaskManager.Task::(prepare) Task=`1d88fc73-0c1a-4329-99e5-f7b278e567f8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:42:01,241::task::595::TaskManager.Task::(_updateState) Task=`1d88fc73-0c1a-4329-99e5-f7b278e567f8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:42:01,241::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:42:01,241::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:42:01,242::task::990::TaskManager.Task::(_decref) Task=`1d88fc73-0c1a-4329-99e5-f7b278e567f8`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:42:01,277::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:42:01,278::task::595::TaskManager.Task::(_updateState) Task=`7034124e-987a-4128-b698-01a009b51416`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:42:01,278::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:42:01,278::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`9d260243-d90d-4357-80cc-3d366720816b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:42:01,279::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:42:01,279::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:42:01,279::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`9d260243-d90d-4357-80cc-3d366720816b`::Granted request >Thread-34::DEBUG::2014-07-24 10:42:01,279::task::827::TaskManager.Task::(resourceAcquired) Task=`7034124e-987a-4128-b698-01a009b51416`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:42:01,279::task::990::TaskManager.Task::(_decref) Task=`7034124e-987a-4128-b698-01a009b51416`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:42:01,280::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:42:01,280::task::1185::TaskManager.Task::(prepare) Task=`7034124e-987a-4128-b698-01a009b51416`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:42:01,281::task::595::TaskManager.Task::(_updateState) Task=`7034124e-987a-4128-b698-01a009b51416`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:42:01,281::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:42:01,281::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:42:01,281::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:42:01,281::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:42:01,281::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:42:01,282::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:42:01,282::task::990::TaskManager.Task::(_decref) Task=`7034124e-987a-4128-b698-01a009b51416`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:42:02,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:42:02,918::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354324 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:42:04,930::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:42:05,004::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344978 s, 29.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:42:06,983::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:42:06,993::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000699622 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:42:07,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:42:07,090::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346359 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:42:09,103::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:42:09,177::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348931 s, 29.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:42:10,385::task::595::TaskManager.Task::(_updateState) Task=`359b8cf1-9ca4-454b-9593-5c6c02772bf1`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:42:10,386::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:42:10,386::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000699622', 'lastCheck': '3.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:42:10,386::task::1185::TaskManager.Task::(prepare) Task=`359b8cf1-9ca4-454b-9593-5c6c02772bf1`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000699622', 'lastCheck': '3.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:42:10,386::task::595::TaskManager.Task::(_updateState) Task=`359b8cf1-9ca4-454b-9593-5c6c02772bf1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:42:10,386::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:42:10,387::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:42:10,387::task::990::TaskManager.Task::(_decref) Task=`359b8cf1-9ca4-454b-9593-5c6c02772bf1`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:42:11,189::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:42:11,265::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363698 s, 28.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:42:11,346::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:42:11,346::task::595::TaskManager.Task::(_updateState) Task=`ebae3cfa-a387-426e-ad58-d21d8f9a8a0a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:42:11,346::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:42:11,347::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:42:11,347::task::1185::TaskManager.Task::(prepare) Task=`ebae3cfa-a387-426e-ad58-d21d8f9a8a0a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:42:11,347::task::595::TaskManager.Task::(_updateState) Task=`ebae3cfa-a387-426e-ad58-d21d8f9a8a0a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:42:11,347::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:42:11,347::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:42:11,347::task::990::TaskManager.Task::(_decref) Task=`ebae3cfa-a387-426e-ad58-d21d8f9a8a0a`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:42:11,388::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:42:11,388::task::595::TaskManager.Task::(_updateState) Task=`790129ef-7a44-4b92-8b9d-c4a68544e0c9`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:42:11,389::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:42:11,389::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`31ef2c17-88cd-48e1-873d-6e8b0ac5069e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:42:11,389::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:42:11,389::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:42:11,390::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`31ef2c17-88cd-48e1-873d-6e8b0ac5069e`::Granted request >Thread-34::DEBUG::2014-07-24 10:42:11,390::task::827::TaskManager.Task::(resourceAcquired) Task=`790129ef-7a44-4b92-8b9d-c4a68544e0c9`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:42:11,390::task::990::TaskManager.Task::(_decref) Task=`790129ef-7a44-4b92-8b9d-c4a68544e0c9`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:42:11,391::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:42:11,391::task::1185::TaskManager.Task::(prepare) Task=`790129ef-7a44-4b92-8b9d-c4a68544e0c9`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:42:11,391::task::595::TaskManager.Task::(_updateState) Task=`790129ef-7a44-4b92-8b9d-c4a68544e0c9`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:42:11,391::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:42:11,392::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:42:11,392::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:42:11,392::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:42:11,392::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:42:11,392::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:42:11,393::task::990::TaskManager.Task::(_decref) Task=`790129ef-7a44-4b92-8b9d-c4a68544e0c9`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:42:13,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:42:13,351::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349536 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:42:15,364::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:42:15,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346427 s, 29.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:42:16,998::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:42:17,011::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00507918 s, 806 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:42:17,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:42:17,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034299 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:42:19,535::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:42:19,612::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354976 s, 28.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:42:21,452::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:42:21,452::task::595::TaskManager.Task::(_updateState) Task=`b8d7b11b-94fd-463a-aa22-6bc402af2a1d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:42:21,452::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:42:21,453::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:42:21,453::task::1185::TaskManager.Task::(prepare) Task=`b8d7b11b-94fd-463a-aa22-6bc402af2a1d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:42:21,453::task::595::TaskManager.Task::(_updateState) Task=`b8d7b11b-94fd-463a-aa22-6bc402af2a1d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:42:21,453::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:42:21,453::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:42:21,453::task::990::TaskManager.Task::(_decref) Task=`b8d7b11b-94fd-463a-aa22-6bc402af2a1d`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:42:21,488::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:42:21,488::task::595::TaskManager.Task::(_updateState) Task=`0845e550-159d-4757-bfe6-f9dabaac4edb`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:42:21,489::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:42:21,489::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`a6cbc8cd-7497-4547-b787-f8ae105767f8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:42:21,489::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:42:21,489::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:42:21,490::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`a6cbc8cd-7497-4547-b787-f8ae105767f8`::Granted request >Thread-34::DEBUG::2014-07-24 10:42:21,490::task::827::TaskManager.Task::(resourceAcquired) Task=`0845e550-159d-4757-bfe6-f9dabaac4edb`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:42:21,490::task::990::TaskManager.Task::(_decref) Task=`0845e550-159d-4757-bfe6-f9dabaac4edb`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:42:21,491::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:42:21,491::task::1185::TaskManager.Task::(prepare) Task=`0845e550-159d-4757-bfe6-f9dabaac4edb`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:42:21,491::task::595::TaskManager.Task::(_updateState) Task=`0845e550-159d-4757-bfe6-f9dabaac4edb`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:42:21,491::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:42:21,491::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:42:21,492::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:42:21,492::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:42:21,492::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:42:21,492::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:42:21,492::task::990::TaskManager.Task::(_decref) Task=`0845e550-159d-4757-bfe6-f9dabaac4edb`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:42:21,624::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:42:21,698::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034744 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:42:23,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:42:23,787::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358296 s, 28.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:42:25,747::task::595::TaskManager.Task::(_updateState) Task=`c3e20fc9-5566-4b7c-adc1-1027c0b1b423`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:42:25,747::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:42:25,747::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00507918', 'lastCheck': '8.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:42:25,748::task::1185::TaskManager.Task::(prepare) Task=`c3e20fc9-5566-4b7c-adc1-1027c0b1b423`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00507918', 'lastCheck': '8.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:42:25,748::task::595::TaskManager.Task::(_updateState) Task=`c3e20fc9-5566-4b7c-adc1-1027c0b1b423`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:42:25,748::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:42:25,748::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:42:25,748::task::990::TaskManager.Task::(_decref) Task=`c3e20fc9-5566-4b7c-adc1-1027c0b1b423`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:42:25,799::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:42:25,893::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344933 s, 29.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:42:26,714::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-18::DEBUG::2014-07-24 10:42:27,016::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:42:27,028::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00340161 s, 1.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:42:27,906::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:42:27,982::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365214 s, 28.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:42:29,994::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:42:30,068::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351241 s, 29.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:42:31,551::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:42:31,552::task::595::TaskManager.Task::(_updateState) Task=`909f024d-5cf8-4af0-b105-1bc6f30da7fa`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:42:31,552::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:42:31,552::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:42:31,552::task::1185::TaskManager.Task::(prepare) Task=`909f024d-5cf8-4af0-b105-1bc6f30da7fa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:42:31,553::task::595::TaskManager.Task::(_updateState) Task=`909f024d-5cf8-4af0-b105-1bc6f30da7fa`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:42:31,553::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:42:31,554::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:42:31,554::task::990::TaskManager.Task::(_decref) Task=`909f024d-5cf8-4af0-b105-1bc6f30da7fa`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:42:31,585::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:42:31,585::task::595::TaskManager.Task::(_updateState) Task=`228bf91c-acb6-4ac3-9a57-417205dcaf58`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:42:31,585::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:42:31,586::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`dabdbc0b-c883-4c20-b958-a7753ee5ea42`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:42:31,586::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:42:31,586::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:42:31,586::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`dabdbc0b-c883-4c20-b958-a7753ee5ea42`::Granted request >Thread-34::DEBUG::2014-07-24 10:42:31,587::task::827::TaskManager.Task::(resourceAcquired) Task=`228bf91c-acb6-4ac3-9a57-417205dcaf58`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:42:31,587::task::990::TaskManager.Task::(_decref) Task=`228bf91c-acb6-4ac3-9a57-417205dcaf58`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:42:31,588::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:42:31,588::task::1185::TaskManager.Task::(prepare) Task=`228bf91c-acb6-4ac3-9a57-417205dcaf58`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:42:31,588::task::595::TaskManager.Task::(_updateState) Task=`228bf91c-acb6-4ac3-9a57-417205dcaf58`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:42:31,588::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:42:31,588::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:42:31,588::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:42:31,589::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:42:31,589::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:42:31,589::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:42:31,589::task::990::TaskManager.Task::(_decref) Task=`228bf91c-acb6-4ac3-9a57-417205dcaf58`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:42:32,081::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:42:32,158::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037598 s, 27.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:42:34,170::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:42:34,244::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034576 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:42:36,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:42:36,331::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363492 s, 28.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:42:37,033::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:42:37,053::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0115977 s, 353 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:42:38,344::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:42:38,419::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354072 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:42:40,431::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:42:40,505::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344068 s, 29.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:42:41,157::task::595::TaskManager.Task::(_updateState) Task=`ebd72d19-bd9f-4a9b-9af6-9cbba0839ea3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:42:41,157::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:42:41,157::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0115977', 'lastCheck': '4.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:42:41,157::task::1185::TaskManager.Task::(prepare) Task=`ebd72d19-bd9f-4a9b-9af6-9cbba0839ea3`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0115977', 'lastCheck': '4.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:42:41,158::task::595::TaskManager.Task::(_updateState) Task=`ebd72d19-bd9f-4a9b-9af6-9cbba0839ea3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:42:41,158::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:42:41,158::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:42:41,158::task::990::TaskManager.Task::(_decref) Task=`ebd72d19-bd9f-4a9b-9af6-9cbba0839ea3`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:42:41,650::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:42:41,650::task::595::TaskManager.Task::(_updateState) Task=`16dc75f9-7577-4448-b22b-2087cd8d397d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:42:41,650::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:42:41,651::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:42:41,651::task::1185::TaskManager.Task::(prepare) Task=`16dc75f9-7577-4448-b22b-2087cd8d397d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:42:41,651::task::595::TaskManager.Task::(_updateState) Task=`16dc75f9-7577-4448-b22b-2087cd8d397d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:42:41,651::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:42:41,651::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:42:41,652::task::990::TaskManager.Task::(_decref) Task=`16dc75f9-7577-4448-b22b-2087cd8d397d`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:42:41,691::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:42:41,691::task::595::TaskManager.Task::(_updateState) Task=`1780c931-cdde-49fa-b587-98f7736d4e2e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:42:41,691::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:42:41,691::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`689fac7f-c258-4a07-be16-24b83f15e42b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:42:41,692::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:42:41,692::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:42:41,692::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`689fac7f-c258-4a07-be16-24b83f15e42b`::Granted request >Thread-34::DEBUG::2014-07-24 10:42:41,693::task::827::TaskManager.Task::(resourceAcquired) Task=`1780c931-cdde-49fa-b587-98f7736d4e2e`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:42:41,694::task::990::TaskManager.Task::(_decref) Task=`1780c931-cdde-49fa-b587-98f7736d4e2e`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:42:41,694::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:42:41,694::task::1185::TaskManager.Task::(prepare) Task=`1780c931-cdde-49fa-b587-98f7736d4e2e`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:42:41,695::task::595::TaskManager.Task::(_updateState) Task=`1780c931-cdde-49fa-b587-98f7736d4e2e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:42:41,695::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:42:41,695::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:42:41,695::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:42:41,695::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:42:41,696::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:42:41,696::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:42:41,696::task::990::TaskManager.Task::(_decref) Task=`1780c931-cdde-49fa-b587-98f7736d4e2e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:42:42,517::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:42:42,591::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03536 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:42:44,604::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:42:44,677::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341434 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:42:46,689::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:42:46,764::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350892 s, 29.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:42:47,058::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:42:47,067::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000651954 s, 6.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:42:48,776::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:42:48,852::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036271 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:42:50,864::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:42:50,939::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361035 s, 28.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:42:51,757::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:42:51,757::task::595::TaskManager.Task::(_updateState) Task=`23be5ca3-58fd-479a-8f32-04c38a44cd24`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:42:51,758::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:42:51,758::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:42:51,758::task::1185::TaskManager.Task::(prepare) Task=`23be5ca3-58fd-479a-8f32-04c38a44cd24`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:42:51,758::task::595::TaskManager.Task::(_updateState) Task=`23be5ca3-58fd-479a-8f32-04c38a44cd24`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:42:51,758::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:42:51,759::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:42:51,759::task::990::TaskManager.Task::(_decref) Task=`23be5ca3-58fd-479a-8f32-04c38a44cd24`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:42:51,791::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:42:51,791::task::595::TaskManager.Task::(_updateState) Task=`bf774ba8-3b18-4633-b09d-debe84c6ced8`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:42:51,792::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:42:51,792::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`113d1ee7-fe5d-4e7a-a96d-5b132ae52f7e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:42:51,792::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:42:51,793::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:42:51,793::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`113d1ee7-fe5d-4e7a-a96d-5b132ae52f7e`::Granted request >Thread-34::DEBUG::2014-07-24 10:42:51,793::task::827::TaskManager.Task::(resourceAcquired) Task=`bf774ba8-3b18-4633-b09d-debe84c6ced8`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:42:51,793::task::990::TaskManager.Task::(_decref) Task=`bf774ba8-3b18-4633-b09d-debe84c6ced8`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:42:51,794::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:42:51,794::task::1185::TaskManager.Task::(prepare) Task=`bf774ba8-3b18-4633-b09d-debe84c6ced8`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:42:51,794::task::595::TaskManager.Task::(_updateState) Task=`bf774ba8-3b18-4633-b09d-debe84c6ced8`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:42:51,794::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:42:51,795::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:42:51,795::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:42:51,795::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:42:51,795::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:42:51,795::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:42:51,795::task::990::TaskManager.Task::(_decref) Task=`bf774ba8-3b18-4633-b09d-debe84c6ced8`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:42:52,952::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:42:53,026::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342833 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:42:55,038::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:42:55,111::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338692 s, 30.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:42:56,573::task::595::TaskManager.Task::(_updateState) Task=`2815faeb-2a9c-436b-a959-7911173d7e00`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:42:56,573::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:42:56,573::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000651954', 'lastCheck': '9.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:42:56,574::task::1185::TaskManager.Task::(prepare) Task=`2815faeb-2a9c-436b-a959-7911173d7e00`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000651954', 'lastCheck': '9.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:42:56,574::task::595::TaskManager.Task::(_updateState) Task=`2815faeb-2a9c-436b-a959-7911173d7e00`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:42:56,574::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:42:56,574::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:42:56,574::task::990::TaskManager.Task::(_decref) Task=`2815faeb-2a9c-436b-a959-7911173d7e00`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-07-24 10:42:56,750::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-18::DEBUG::2014-07-24 10:42:57,072::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:42:57,081::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000729306 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:42:57,123::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:42:57,198::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344478 s, 29.7 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 10:42:57,685::task::595::TaskManager.Task::(_updateState) Task=`1b609584-7be6-4916-95f4-5cb2230bc9be`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 10:42:57,685::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 10:42:57,686::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:42:57,686::task::1185::TaskManager.Task::(prepare) Task=`1b609584-7be6-4916-95f4-5cb2230bc9be`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:42:57,686::task::595::TaskManager.Task::(_updateState) Task=`1b609584-7be6-4916-95f4-5cb2230bc9be`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 10:42:57,686::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 10:42:57,687::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 10:42:57,687::task::990::TaskManager.Task::(_decref) Task=`1b609584-7be6-4916-95f4-5cb2230bc9be`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:42:59,210::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:42:59,286::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350425 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:43:01,299::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:43:01,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0387122 s, 26.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:43:01,878::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:43:01,879::task::595::TaskManager.Task::(_updateState) Task=`f03c2cd1-b672-4378-bc7d-1adc37b70e8a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:43:01,879::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:43:01,879::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:43:01,879::task::1185::TaskManager.Task::(prepare) Task=`f03c2cd1-b672-4378-bc7d-1adc37b70e8a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:43:01,880::task::595::TaskManager.Task::(_updateState) Task=`f03c2cd1-b672-4378-bc7d-1adc37b70e8a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:43:01,880::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:43:01,880::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:43:01,880::task::990::TaskManager.Task::(_decref) Task=`f03c2cd1-b672-4378-bc7d-1adc37b70e8a`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:43:01,926::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:43:01,926::task::595::TaskManager.Task::(_updateState) Task=`d0c858fb-ef0b-4daf-98fb-ae08f540e360`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:43:01,926::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:43:01,927::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f440ecaa-7b14-4b20-8184-1d8379108431`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:43:01,927::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:43:01,927::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:43:01,927::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f440ecaa-7b14-4b20-8184-1d8379108431`::Granted request >Thread-34::DEBUG::2014-07-24 10:43:01,928::task::827::TaskManager.Task::(resourceAcquired) Task=`d0c858fb-ef0b-4daf-98fb-ae08f540e360`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:43:01,928::task::990::TaskManager.Task::(_decref) Task=`d0c858fb-ef0b-4daf-98fb-ae08f540e360`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:43:01,929::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:43:01,929::task::1185::TaskManager.Task::(prepare) Task=`d0c858fb-ef0b-4daf-98fb-ae08f540e360`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:43:01,929::task::595::TaskManager.Task::(_updateState) Task=`d0c858fb-ef0b-4daf-98fb-ae08f540e360`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:43:01,929::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:43:01,929::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:43:01,929::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:43:01,930::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:43:01,930::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:43:01,930::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:43:01,930::task::990::TaskManager.Task::(_decref) Task=`d0c858fb-ef0b-4daf-98fb-ae08f540e360`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:43:03,388::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:43:03,463::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348683 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:43:05,476::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:43:05,552::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366723 s, 27.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:43:07,086::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:43:07,095::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000730432 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:43:07,564::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:43:07,640::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368151 s, 27.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:43:09,653::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:43:09,727::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343272 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:43:11,741::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:43:11,816::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359699 s, 28.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:43:11,961::task::595::TaskManager.Task::(_updateState) Task=`82d2a17c-5183-4058-8aba-729fbae26aa0`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:43:11,961::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:43:11,961::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000730432', 'lastCheck': '4.9', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:43:11,961::task::1185::TaskManager.Task::(prepare) Task=`82d2a17c-5183-4058-8aba-729fbae26aa0`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000730432', 'lastCheck': '4.9', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:43:11,962::task::595::TaskManager.Task::(_updateState) Task=`82d2a17c-5183-4058-8aba-729fbae26aa0`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:43:11,962::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:43:11,962::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:43:11,962::task::990::TaskManager.Task::(_decref) Task=`82d2a17c-5183-4058-8aba-729fbae26aa0`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:43:12,091::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:43:12,093::task::595::TaskManager.Task::(_updateState) Task=`49993e72-f3fe-49bc-931e-64c7ccb897f9`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:43:12,093::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:43:12,094::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:43:12,095::task::1185::TaskManager.Task::(prepare) Task=`49993e72-f3fe-49bc-931e-64c7ccb897f9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:43:12,095::task::595::TaskManager.Task::(_updateState) Task=`49993e72-f3fe-49bc-931e-64c7ccb897f9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:43:12,095::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:43:12,095::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:43:12,095::task::990::TaskManager.Task::(_decref) Task=`49993e72-f3fe-49bc-931e-64c7ccb897f9`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:43:12,128::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:43:12,128::task::595::TaskManager.Task::(_updateState) Task=`6a491adf-fd7e-4cdd-b4fa-b1274a7e5d20`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:43:12,129::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:43:12,129::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`0c34107f-8def-4521-8e53-98ab2a63ee60`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:43:12,129::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:43:12,130::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:43:12,130::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`0c34107f-8def-4521-8e53-98ab2a63ee60`::Granted request >Thread-34::DEBUG::2014-07-24 10:43:12,130::task::827::TaskManager.Task::(resourceAcquired) Task=`6a491adf-fd7e-4cdd-b4fa-b1274a7e5d20`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:43:12,130::task::990::TaskManager.Task::(_decref) Task=`6a491adf-fd7e-4cdd-b4fa-b1274a7e5d20`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:43:12,131::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:43:12,131::task::1185::TaskManager.Task::(prepare) Task=`6a491adf-fd7e-4cdd-b4fa-b1274a7e5d20`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:43:12,132::task::595::TaskManager.Task::(_updateState) Task=`6a491adf-fd7e-4cdd-b4fa-b1274a7e5d20`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:43:12,132::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:43:12,132::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:43:12,132::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:43:12,132::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:43:12,132::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:43:12,133::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:43:12,133::task::990::TaskManager.Task::(_decref) Task=`6a491adf-fd7e-4cdd-b4fa-b1274a7e5d20`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:43:13,828::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:43:13,904::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362462 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:43:15,916::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:43:15,991::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354212 s, 28.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:43:17,099::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:43:17,108::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000718763 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:43:18,003::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:43:18,078::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351551 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:43:20,091::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:43:20,166::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363653 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:43:22,178::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-24 10:43:22,240::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:43:22,242::task::595::TaskManager.Task::(_updateState) Task=`c3ae8d32-6e20-4d24-a55e-5260086f9e4d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:43:22,243::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:43:22,244::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:43:22,245::task::1185::TaskManager.Task::(prepare) Task=`c3ae8d32-6e20-4d24-a55e-5260086f9e4d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:43:22,246::task::595::TaskManager.Task::(_updateState) Task=`c3ae8d32-6e20-4d24-a55e-5260086f9e4d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:43:22,246::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:43:22,247::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:43:22,248::task::990::TaskManager.Task::(_decref) Task=`c3ae8d32-6e20-4d24-a55e-5260086f9e4d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:43:22,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0423605 s, 24.2 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-24 10:43:22,292::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:43:22,292::task::595::TaskManager.Task::(_updateState) Task=`e562e3d8-46f7-4a8c-b101-0d08ea7faaf5`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:43:22,292::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:43:22,292::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`59542faf-e005-42f9-801f-66975e7b75d7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:43:22,293::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:43:22,293::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:43:22,293::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`59542faf-e005-42f9-801f-66975e7b75d7`::Granted request >Thread-34::DEBUG::2014-07-24 10:43:22,293::task::827::TaskManager.Task::(resourceAcquired) Task=`e562e3d8-46f7-4a8c-b101-0d08ea7faaf5`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:43:22,294::task::990::TaskManager.Task::(_decref) Task=`e562e3d8-46f7-4a8c-b101-0d08ea7faaf5`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:43:22,294::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:43:22,294::task::1185::TaskManager.Task::(prepare) Task=`e562e3d8-46f7-4a8c-b101-0d08ea7faaf5`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:43:22,295::task::595::TaskManager.Task::(_updateState) Task=`e562e3d8-46f7-4a8c-b101-0d08ea7faaf5`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:43:22,295::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:43:22,295::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:43:22,295::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:43:22,295::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:43:22,296::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:43:22,296::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:43:22,296::task::990::TaskManager.Task::(_decref) Task=`e562e3d8-46f7-4a8c-b101-0d08ea7faaf5`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:43:24,287::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:43:24,362::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363877 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:43:26,375::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:43:26,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036514 s, 28.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:43:26,787::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-18::DEBUG::2014-07-24 10:43:27,113::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:43:27,123::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000723311 s, 5.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:43:27,432::task::595::TaskManager.Task::(_updateState) Task=`4b05fbd8-b47e-44e5-a6a5-deb7ad6f3d23`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:43:27,446::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:43:27,446::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000723311', 'lastCheck': '0.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:43:27,447::task::1185::TaskManager.Task::(prepare) Task=`4b05fbd8-b47e-44e5-a6a5-deb7ad6f3d23`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000723311', 'lastCheck': '0.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:43:27,447::task::595::TaskManager.Task::(_updateState) Task=`4b05fbd8-b47e-44e5-a6a5-deb7ad6f3d23`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:43:27,447::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:43:27,447::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:43:27,447::task::990::TaskManager.Task::(_decref) Task=`4b05fbd8-b47e-44e5-a6a5-deb7ad6f3d23`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:43:28,463::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:43:28,537::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355434 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:43:30,549::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:43:30,625::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366238 s, 28.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:43:32,358::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:43:32,358::task::595::TaskManager.Task::(_updateState) Task=`5e01a820-e561-4e6c-9d27-7b1e5ad61b21`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:43:32,358::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:43:32,359::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:43:32,359::task::1185::TaskManager.Task::(prepare) Task=`5e01a820-e561-4e6c-9d27-7b1e5ad61b21`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:43:32,360::task::595::TaskManager.Task::(_updateState) Task=`5e01a820-e561-4e6c-9d27-7b1e5ad61b21`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:43:32,361::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:43:32,361::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:43:32,361::task::990::TaskManager.Task::(_decref) Task=`5e01a820-e561-4e6c-9d27-7b1e5ad61b21`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:43:32,434::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:43:32,440::task::595::TaskManager.Task::(_updateState) Task=`26bffc33-ff43-40df-995f-59e2cbeda64f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:43:32,440::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:43:32,440::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e7c23213-862d-47d6-abb1-85eb18847df5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:43:32,441::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:43:32,441::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:43:32,441::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e7c23213-862d-47d6-abb1-85eb18847df5`::Granted request >Thread-34::DEBUG::2014-07-24 10:43:32,441::task::827::TaskManager.Task::(resourceAcquired) Task=`26bffc33-ff43-40df-995f-59e2cbeda64f`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:43:32,442::task::990::TaskManager.Task::(_decref) Task=`26bffc33-ff43-40df-995f-59e2cbeda64f`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:43:32,442::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:43:32,442::task::1185::TaskManager.Task::(prepare) Task=`26bffc33-ff43-40df-995f-59e2cbeda64f`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:43:32,443::task::595::TaskManager.Task::(_updateState) Task=`26bffc33-ff43-40df-995f-59e2cbeda64f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:43:32,443::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:43:32,443::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:43:32,443::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:43:32,443::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:43:32,443::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:43:32,444::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:43:32,444::task::990::TaskManager.Task::(_decref) Task=`26bffc33-ff43-40df-995f-59e2cbeda64f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:43:32,638::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:43:32,711::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343667 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:43:34,723::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:43:34,797::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343727 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:43:36,810::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:43:36,885::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362148 s, 28.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:43:37,128::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:43:37,146::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00891247 s, 460 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:43:38,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:43:38,981::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0436064 s, 23.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:43:40,993::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:43:41,070::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0382853 s, 26.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:43:42,503::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:43:42,504::task::595::TaskManager.Task::(_updateState) Task=`d6fef803-a58b-4ae6-8002-2b30900fe00e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:43:42,504::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:43:42,504::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:43:42,504::task::1185::TaskManager.Task::(prepare) Task=`d6fef803-a58b-4ae6-8002-2b30900fe00e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:43:42,505::task::595::TaskManager.Task::(_updateState) Task=`d6fef803-a58b-4ae6-8002-2b30900fe00e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:43:42,505::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:43:42,505::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:43:42,505::task::990::TaskManager.Task::(_decref) Task=`d6fef803-a58b-4ae6-8002-2b30900fe00e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:43:42,537::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:43:42,537::task::595::TaskManager.Task::(_updateState) Task=`d65e8a24-4e5b-476a-a24e-f6ae8200f902`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:43:42,538::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:43:42,538::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ae980dfd-9faf-4767-a080-5969e82719a0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:43:42,538::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:43:42,539::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:43:42,539::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ae980dfd-9faf-4767-a080-5969e82719a0`::Granted request >Thread-34::DEBUG::2014-07-24 10:43:42,539::task::827::TaskManager.Task::(resourceAcquired) Task=`d65e8a24-4e5b-476a-a24e-f6ae8200f902`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:43:42,539::task::990::TaskManager.Task::(_decref) Task=`d65e8a24-4e5b-476a-a24e-f6ae8200f902`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:43:42,540::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:43:42,540::task::1185::TaskManager.Task::(prepare) Task=`d65e8a24-4e5b-476a-a24e-f6ae8200f902`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:43:42,540::task::595::TaskManager.Task::(_updateState) Task=`d65e8a24-4e5b-476a-a24e-f6ae8200f902`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:43:42,540::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:43:42,541::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:43:42,541::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:43:42,541::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:43:42,541::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:43:42,541::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:43:42,541::task::990::TaskManager.Task::(_decref) Task=`d65e8a24-4e5b-476a-a24e-f6ae8200f902`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:43:42,822::task::595::TaskManager.Task::(_updateState) Task=`5d9fdf77-1814-4feb-a491-1ca8bb9a6436`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:43:42,823::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:43:42,823::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00891247', 'lastCheck': '5.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:43:42,823::task::1185::TaskManager.Task::(prepare) Task=`5d9fdf77-1814-4feb-a491-1ca8bb9a6436`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00891247', 'lastCheck': '5.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:43:42,823::task::595::TaskManager.Task::(_updateState) Task=`5d9fdf77-1814-4feb-a491-1ca8bb9a6436`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:43:42,823::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:43:42,823::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:43:42,824::task::990::TaskManager.Task::(_decref) Task=`5d9fdf77-1814-4feb-a491-1ca8bb9a6436`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:43:43,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:43:43,156::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346195 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:43:45,169::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:43:45,248::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368592 s, 27.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:43:47,151::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:43:47,160::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000653737 s, 6.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:43:47,261::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:43:47,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355803 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:43:49,348::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:43:49,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349406 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:43:51,435::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:43:51,509::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349556 s, 29.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:43:52,601::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:43:52,602::task::595::TaskManager.Task::(_updateState) Task=`0ca4863a-1b8f-46d4-a563-957f46558beb`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:43:52,602::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:43:52,602::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:43:52,603::task::1185::TaskManager.Task::(prepare) Task=`0ca4863a-1b8f-46d4-a563-957f46558beb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:43:52,603::task::595::TaskManager.Task::(_updateState) Task=`0ca4863a-1b8f-46d4-a563-957f46558beb`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:43:52,603::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:43:52,603::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:43:52,603::task::990::TaskManager.Task::(_decref) Task=`0ca4863a-1b8f-46d4-a563-957f46558beb`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:43:52,636::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:43:52,637::task::595::TaskManager.Task::(_updateState) Task=`703eaabe-c423-4e74-9304-41df56649fc8`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:43:52,637::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:43:52,637::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`caa62a44-5598-4788-8baf-0ad4f250be6e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:43:52,638::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:43:52,638::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:43:52,638::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`caa62a44-5598-4788-8baf-0ad4f250be6e`::Granted request >Thread-34::DEBUG::2014-07-24 10:43:52,639::task::827::TaskManager.Task::(resourceAcquired) Task=`703eaabe-c423-4e74-9304-41df56649fc8`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:43:52,640::task::990::TaskManager.Task::(_decref) Task=`703eaabe-c423-4e74-9304-41df56649fc8`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:43:52,640::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:43:52,640::task::1185::TaskManager.Task::(prepare) Task=`703eaabe-c423-4e74-9304-41df56649fc8`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:43:52,641::task::595::TaskManager.Task::(_updateState) Task=`703eaabe-c423-4e74-9304-41df56649fc8`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:43:52,641::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:43:52,641::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:43:52,641::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:43:52,641::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:43:52,641::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:43:52,642::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:43:52,642::task::990::TaskManager.Task::(_decref) Task=`703eaabe-c423-4e74-9304-41df56649fc8`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:43:53,522::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:43:53,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343862 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:43:55,607::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:43:55,681::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034268 s, 29.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:43:56,823::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-18::DEBUG::2014-07-24 10:43:57,165::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:43:57,180::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00615669 s, 665 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:43:57,693::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:43:57,768::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035361 s, 29.0 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 10:43:57,866::task::595::TaskManager.Task::(_updateState) Task=`60ed4ca3-b7e6-44cd-aaf9-9207d13a7469`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 10:43:57,866::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 10:43:57,866::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:43:57,866::task::1185::TaskManager.Task::(prepare) Task=`60ed4ca3-b7e6-44cd-aaf9-9207d13a7469`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:43:57,867::task::595::TaskManager.Task::(_updateState) Task=`60ed4ca3-b7e6-44cd-aaf9-9207d13a7469`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 10:43:57,867::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 10:43:57,867::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 10:43:57,867::task::990::TaskManager.Task::(_decref) Task=`60ed4ca3-b7e6-44cd-aaf9-9207d13a7469`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:43:58,213::task::595::TaskManager.Task::(_updateState) Task=`a86cac4a-8176-4275-a06b-ab72bab8e76e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:43:58,213::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:43:58,213::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00615669', 'lastCheck': '1.0', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:43:58,213::task::1185::TaskManager.Task::(prepare) Task=`a86cac4a-8176-4275-a06b-ab72bab8e76e`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00615669', 'lastCheck': '1.0', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:43:58,213::task::595::TaskManager.Task::(_updateState) Task=`a86cac4a-8176-4275-a06b-ab72bab8e76e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:43:58,214::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:43:58,214::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:43:58,214::task::990::TaskManager.Task::(_decref) Task=`a86cac4a-8176-4275-a06b-ab72bab8e76e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:43:59,780::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:43:59,857::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035245 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:44:01,869::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:44:01,945::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365644 s, 28.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:44:02,731::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:44:02,731::task::595::TaskManager.Task::(_updateState) Task=`c34a118c-38d4-47d0-9d1f-2e384e350d8e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:44:02,732::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:44:02,732::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:44:02,732::task::1185::TaskManager.Task::(prepare) Task=`c34a118c-38d4-47d0-9d1f-2e384e350d8e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:44:02,732::task::595::TaskManager.Task::(_updateState) Task=`c34a118c-38d4-47d0-9d1f-2e384e350d8e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:44:02,733::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:44:02,733::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:44:02,733::task::990::TaskManager.Task::(_decref) Task=`c34a118c-38d4-47d0-9d1f-2e384e350d8e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:44:02,765::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:44:02,766::task::595::TaskManager.Task::(_updateState) Task=`85d5f3a2-756e-4c42-ae99-b3c6da58043b`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:44:02,766::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:44:02,766::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`062e0ceb-6e35-45da-9ce3-1fa3e2d0e07c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:44:02,767::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:44:02,767::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:44:02,767::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`062e0ceb-6e35-45da-9ce3-1fa3e2d0e07c`::Granted request >Thread-34::DEBUG::2014-07-24 10:44:02,767::task::827::TaskManager.Task::(resourceAcquired) Task=`85d5f3a2-756e-4c42-ae99-b3c6da58043b`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:44:02,767::task::990::TaskManager.Task::(_decref) Task=`85d5f3a2-756e-4c42-ae99-b3c6da58043b`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:44:02,768::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:44:02,768::task::1185::TaskManager.Task::(prepare) Task=`85d5f3a2-756e-4c42-ae99-b3c6da58043b`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:44:02,769::task::595::TaskManager.Task::(_updateState) Task=`85d5f3a2-756e-4c42-ae99-b3c6da58043b`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:44:02,769::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:44:02,769::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:44:02,769::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:44:02,769::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:44:02,769::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:44:02,770::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:44:02,770::task::990::TaskManager.Task::(_decref) Task=`85d5f3a2-756e-4c42-ae99-b3c6da58043b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:44:03,957::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:44:04,033::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363833 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:44:06,045::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:44:06,120::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357962 s, 28.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:44:07,184::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:44:07,194::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000791527 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:44:08,132::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:44:08,219::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0475273 s, 21.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:44:10,232::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:44:10,311::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0397954 s, 25.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:44:12,324::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:44:12,400::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373793 s, 27.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:44:12,846::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:44:12,847::task::595::TaskManager.Task::(_updateState) Task=`b0bb7e20-32c9-4fe2-966b-4319f8eb2a43`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:44:12,847::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:44:12,847::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:44:12,848::task::1185::TaskManager.Task::(prepare) Task=`b0bb7e20-32c9-4fe2-966b-4319f8eb2a43`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:44:12,848::task::595::TaskManager.Task::(_updateState) Task=`b0bb7e20-32c9-4fe2-966b-4319f8eb2a43`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:44:12,848::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:44:12,848::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:44:12,848::task::990::TaskManager.Task::(_decref) Task=`b0bb7e20-32c9-4fe2-966b-4319f8eb2a43`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:44:12,881::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:44:12,882::task::595::TaskManager.Task::(_updateState) Task=`b06b7d3f-713d-4854-99eb-d224aebb2df3`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:44:12,882::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:44:12,882::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1dc22b57-d9e2-4ef6-bec6-0e6b36b0e5f9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:44:12,883::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:44:12,883::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:44:12,883::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1dc22b57-d9e2-4ef6-bec6-0e6b36b0e5f9`::Granted request >Thread-34::DEBUG::2014-07-24 10:44:12,883::task::827::TaskManager.Task::(resourceAcquired) Task=`b06b7d3f-713d-4854-99eb-d224aebb2df3`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:44:12,884::task::990::TaskManager.Task::(_decref) Task=`b06b7d3f-713d-4854-99eb-d224aebb2df3`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:44:12,884::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:44:12,884::task::1185::TaskManager.Task::(prepare) Task=`b06b7d3f-713d-4854-99eb-d224aebb2df3`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:44:12,885::task::595::TaskManager.Task::(_updateState) Task=`b06b7d3f-713d-4854-99eb-d224aebb2df3`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:44:12,885::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:44:12,885::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:44:12,885::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:44:12,885::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:44:12,885::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:44:12,886::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:44:12,886::task::990::TaskManager.Task::(_decref) Task=`b06b7d3f-713d-4854-99eb-d224aebb2df3`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:44:13,589::task::595::TaskManager.Task::(_updateState) Task=`5766954e-b0f7-4559-883e-e39cd10c504c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:44:13,589::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:44:13,589::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000791527', 'lastCheck': '6.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:44:13,589::task::1185::TaskManager.Task::(prepare) Task=`5766954e-b0f7-4559-883e-e39cd10c504c`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000791527', 'lastCheck': '6.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:44:13,589::task::595::TaskManager.Task::(_updateState) Task=`5766954e-b0f7-4559-883e-e39cd10c504c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:44:13,590::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:44:13,590::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:44:13,590::task::990::TaskManager.Task::(_decref) Task=`5766954e-b0f7-4559-883e-e39cd10c504c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:44:14,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:44:14,488::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364751 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:44:16,501::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:44:16,580::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359719 s, 28.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:44:17,198::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:44:17,207::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000699028 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:44:18,592::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:44:18,666::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343827 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:44:20,678::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:44:20,752::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349781 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:44:22,765::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:44:22,840::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366227 s, 28.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:44:22,968::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:44:22,969::task::595::TaskManager.Task::(_updateState) Task=`5606d1de-8927-42a4-a1ec-6af582fc371e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:44:22,969::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:44:22,969::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:44:22,969::task::1185::TaskManager.Task::(prepare) Task=`5606d1de-8927-42a4-a1ec-6af582fc371e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:44:22,970::task::595::TaskManager.Task::(_updateState) Task=`5606d1de-8927-42a4-a1ec-6af582fc371e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:44:22,970::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:44:22,970::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:44:22,970::task::990::TaskManager.Task::(_decref) Task=`5606d1de-8927-42a4-a1ec-6af582fc371e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:44:23,002::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:44:23,002::task::595::TaskManager.Task::(_updateState) Task=`78f62825-e84c-4156-bda1-75bfa94e0a36`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:44:23,002::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:44:23,003::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`012b452c-39f5-4cb6-9692-543c60bdafa5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:44:23,003::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:44:23,003::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:44:23,003::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`012b452c-39f5-4cb6-9692-543c60bdafa5`::Granted request >Thread-34::DEBUG::2014-07-24 10:44:23,004::task::827::TaskManager.Task::(resourceAcquired) Task=`78f62825-e84c-4156-bda1-75bfa94e0a36`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:44:23,004::task::990::TaskManager.Task::(_decref) Task=`78f62825-e84c-4156-bda1-75bfa94e0a36`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:44:23,005::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:44:23,005::task::1185::TaskManager.Task::(prepare) Task=`78f62825-e84c-4156-bda1-75bfa94e0a36`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:44:23,005::task::595::TaskManager.Task::(_updateState) Task=`78f62825-e84c-4156-bda1-75bfa94e0a36`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:44:23,005::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:44:23,005::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:44:23,005::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:44:23,006::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:44:23,006::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:44:23,006::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:44:23,006::task::990::TaskManager.Task::(_decref) Task=`78f62825-e84c-4156-bda1-75bfa94e0a36`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:44:24,852::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:44:25,223::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.329521 s, 3.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:44:26,863::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-18::DEBUG::2014-07-24 10:44:27,212::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:44:27,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-24 10:44:27,245::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0244272 s, 168 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:44:27,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0375417 s, 27.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:44:29,006::task::595::TaskManager.Task::(_updateState) Task=`ea6b00df-68d6-4479-afd2-2c74df41a453`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:44:29,006::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:44:29,006::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0244272', 'lastCheck': '1.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:44:29,006::task::1185::TaskManager.Task::(prepare) Task=`ea6b00df-68d6-4479-afd2-2c74df41a453`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0244272', 'lastCheck': '1.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:44:29,006::task::595::TaskManager.Task::(_updateState) Task=`ea6b00df-68d6-4479-afd2-2c74df41a453`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:44:29,007::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:44:29,007::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:44:29,007::task::990::TaskManager.Task::(_decref) Task=`ea6b00df-68d6-4479-afd2-2c74df41a453`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:44:29,325::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:44:29,398::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341584 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:44:31,411::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:44:31,485::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345872 s, 29.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:44:33,076::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:44:33,077::task::595::TaskManager.Task::(_updateState) Task=`bb4033c2-0108-4ac8-a3fe-845b2238e65c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:44:33,077::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:44:33,078::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:44:33,078::task::1185::TaskManager.Task::(prepare) Task=`bb4033c2-0108-4ac8-a3fe-845b2238e65c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:44:33,078::task::595::TaskManager.Task::(_updateState) Task=`bb4033c2-0108-4ac8-a3fe-845b2238e65c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:44:33,078::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:44:33,078::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:44:33,078::task::990::TaskManager.Task::(_decref) Task=`bb4033c2-0108-4ac8-a3fe-845b2238e65c`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:44:33,112::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:44:33,112::task::595::TaskManager.Task::(_updateState) Task=`274fb34a-bde2-4156-91e1-9740e8a8d682`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:44:33,112::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:44:33,113::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1d16ab70-bdec-4e9b-950d-886b4739aab8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:44:33,113::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:44:33,113::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:44:33,114::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1d16ab70-bdec-4e9b-950d-886b4739aab8`::Granted request >Thread-34::DEBUG::2014-07-24 10:44:33,114::task::827::TaskManager.Task::(resourceAcquired) Task=`274fb34a-bde2-4156-91e1-9740e8a8d682`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:44:33,114::task::990::TaskManager.Task::(_decref) Task=`274fb34a-bde2-4156-91e1-9740e8a8d682`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:44:33,115::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:44:33,115::task::1185::TaskManager.Task::(prepare) Task=`274fb34a-bde2-4156-91e1-9740e8a8d682`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:44:33,115::task::595::TaskManager.Task::(_updateState) Task=`274fb34a-bde2-4156-91e1-9740e8a8d682`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:44:33,115::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:44:33,116::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:44:33,116::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:44:33,116::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:44:33,116::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:44:33,116::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:44:33,117::task::990::TaskManager.Task::(_decref) Task=`274fb34a-bde2-4156-91e1-9740e8a8d682`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:44:33,497::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:44:33,573::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366967 s, 27.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:44:35,586::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:44:35,662::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372807 s, 27.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:44:37,250::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:44:37,259::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000819611 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:44:37,674::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:44:37,751::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355649 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:44:39,763::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:44:39,837::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340329 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:44:41,849::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:44:42,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.329836 s, 3.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:44:43,180::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:44:43,181::task::595::TaskManager.Task::(_updateState) Task=`04aaa935-8dea-45cc-a9df-83095504239b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:44:43,181::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:44:43,182::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:44:43,182::task::1185::TaskManager.Task::(prepare) Task=`04aaa935-8dea-45cc-a9df-83095504239b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:44:43,182::task::595::TaskManager.Task::(_updateState) Task=`04aaa935-8dea-45cc-a9df-83095504239b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:44:43,182::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:44:43,182::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:44:43,182::task::990::TaskManager.Task::(_decref) Task=`04aaa935-8dea-45cc-a9df-83095504239b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:44:43,214::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:44:43,215::task::595::TaskManager.Task::(_updateState) Task=`145ed5f6-93ba-411c-9bf4-862c7f24b862`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:44:43,215::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:44:43,215::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`75b59f31-c2a3-42de-8e9c-409537bd28e2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:44:43,216::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:44:43,216::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:44:43,216::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`75b59f31-c2a3-42de-8e9c-409537bd28e2`::Granted request >Thread-34::DEBUG::2014-07-24 10:44:43,216::task::827::TaskManager.Task::(resourceAcquired) Task=`145ed5f6-93ba-411c-9bf4-862c7f24b862`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:44:43,216::task::990::TaskManager.Task::(_decref) Task=`145ed5f6-93ba-411c-9bf4-862c7f24b862`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:44:43,217::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:44:43,217::task::1185::TaskManager.Task::(prepare) Task=`145ed5f6-93ba-411c-9bf4-862c7f24b862`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:44:43,218::task::595::TaskManager.Task::(_updateState) Task=`145ed5f6-93ba-411c-9bf4-862c7f24b862`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:44:43,218::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:44:43,218::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:44:43,218::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:44:43,218::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:44:43,218::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:44:43,219::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:44:43,219::task::990::TaskManager.Task::(_decref) Task=`145ed5f6-93ba-411c-9bf4-862c7f24b862`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:44:44,231::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:44:44,321::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0503784 s, 20.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:44:44,415::task::595::TaskManager.Task::(_updateState) Task=`a1db26d4-80b0-47c3-a8c9-55467d9868da`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:44:44,415::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:44:44,416::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000819611', 'lastCheck': '7.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:44:44,416::task::1185::TaskManager.Task::(prepare) Task=`a1db26d4-80b0-47c3-a8c9-55467d9868da`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000819611', 'lastCheck': '7.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:44:44,416::task::595::TaskManager.Task::(_updateState) Task=`a1db26d4-80b0-47c3-a8c9-55467d9868da`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:44:44,416::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:44:44,416::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:44:44,416::task::990::TaskManager.Task::(_decref) Task=`a1db26d4-80b0-47c3-a8c9-55467d9868da`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:44:46,333::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:44:46,409::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370045 s, 27.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:44:47,264::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:44:47,274::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000726971 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:44:48,422::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:44:48,497::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357635 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:44:50,509::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:44:50,583::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349587 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:44:52,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:44:52,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033807 s, 30.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:44:53,326::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:44:53,327::task::595::TaskManager.Task::(_updateState) Task=`7d024521-89cc-4c6a-8b30-55caa2af0f95`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:44:53,327::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:44:53,327::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:44:53,328::task::1185::TaskManager.Task::(prepare) Task=`7d024521-89cc-4c6a-8b30-55caa2af0f95`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:44:53,328::task::595::TaskManager.Task::(_updateState) Task=`7d024521-89cc-4c6a-8b30-55caa2af0f95`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:44:53,328::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:44:53,328::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:44:53,328::task::990::TaskManager.Task::(_decref) Task=`7d024521-89cc-4c6a-8b30-55caa2af0f95`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:44:53,362::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:44:53,362::task::595::TaskManager.Task::(_updateState) Task=`115a69b6-1a30-4990-b0ed-c4486fee3708`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:44:53,362::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:44:53,363::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f9975f00-540c-4110-a5bf-0f350757a3d1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:44:53,363::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:44:53,363::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:44:53,363::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f9975f00-540c-4110-a5bf-0f350757a3d1`::Granted request >Thread-34::DEBUG::2014-07-24 10:44:53,364::task::827::TaskManager.Task::(resourceAcquired) Task=`115a69b6-1a30-4990-b0ed-c4486fee3708`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:44:53,364::task::990::TaskManager.Task::(_decref) Task=`115a69b6-1a30-4990-b0ed-c4486fee3708`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:44:53,365::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:44:53,365::task::1185::TaskManager.Task::(prepare) Task=`115a69b6-1a30-4990-b0ed-c4486fee3708`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:44:53,365::task::595::TaskManager.Task::(_updateState) Task=`115a69b6-1a30-4990-b0ed-c4486fee3708`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:44:53,365::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:44:53,365::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:44:53,366::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:44:53,366::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:44:53,366::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:44:53,366::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:44:53,366::task::990::TaskManager.Task::(_decref) Task=`115a69b6-1a30-4990-b0ed-c4486fee3708`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:44:54,680::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:44:54,755::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342979 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:44:56,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:44:56,845::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0384181 s, 26.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:44:56,899::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-18::DEBUG::2014-07-24 10:44:57,279::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:44:57,288::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000731783 s, 5.6 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 10:44:58,012::task::595::TaskManager.Task::(_updateState) Task=`ec079df0-8251-4b47-aac7-1dc14ead4cce`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 10:44:58,012::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 10:44:58,013::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:44:58,013::task::1185::TaskManager.Task::(prepare) Task=`ec079df0-8251-4b47-aac7-1dc14ead4cce`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:44:58,013::task::595::TaskManager.Task::(_updateState) Task=`ec079df0-8251-4b47-aac7-1dc14ead4cce`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 10:44:58,013::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 10:44:58,013::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 10:44:58,013::task::990::TaskManager.Task::(_decref) Task=`ec079df0-8251-4b47-aac7-1dc14ead4cce`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:44:58,857::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:44:58,935::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379155 s, 27.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:44:59,788::task::595::TaskManager.Task::(_updateState) Task=`11b01dde-b6d2-4d9c-aa0d-bcbfd358419d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:44:59,789::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:44:59,789::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000731783', 'lastCheck': '2.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:44:59,789::task::1185::TaskManager.Task::(prepare) Task=`11b01dde-b6d2-4d9c-aa0d-bcbfd358419d`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000731783', 'lastCheck': '2.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:44:59,789::task::595::TaskManager.Task::(_updateState) Task=`11b01dde-b6d2-4d9c-aa0d-bcbfd358419d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:44:59,789::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:44:59,790::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:44:59,790::task::990::TaskManager.Task::(_decref) Task=`11b01dde-b6d2-4d9c-aa0d-bcbfd358419d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:45:00,947::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:45:01,021::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348725 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:45:03,033::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:45:03,107::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348438 s, 29.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:45:03,481::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:45:03,481::task::595::TaskManager.Task::(_updateState) Task=`e729a030-1697-4cb5-ac4b-590673367914`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:45:03,481::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:45:03,482::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:45:03,482::task::1185::TaskManager.Task::(prepare) Task=`e729a030-1697-4cb5-ac4b-590673367914`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:45:03,482::task::595::TaskManager.Task::(_updateState) Task=`e729a030-1697-4cb5-ac4b-590673367914`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:45:03,482::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:45:03,482::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:45:03,483::task::990::TaskManager.Task::(_decref) Task=`e729a030-1697-4cb5-ac4b-590673367914`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:45:03,520::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:45:03,520::task::595::TaskManager.Task::(_updateState) Task=`1d643c35-7a7c-4fac-8f5e-896be2e1db87`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:45:03,521::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:45:03,521::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ab7aebb8-895c-460d-a408-d80da196a4d3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:45:03,521::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:45:03,521::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:45:03,522::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ab7aebb8-895c-460d-a408-d80da196a4d3`::Granted request >Thread-34::DEBUG::2014-07-24 10:45:03,523::task::827::TaskManager.Task::(resourceAcquired) Task=`1d643c35-7a7c-4fac-8f5e-896be2e1db87`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:45:03,524::task::990::TaskManager.Task::(_decref) Task=`1d643c35-7a7c-4fac-8f5e-896be2e1db87`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:45:03,524::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:45:03,524::task::1185::TaskManager.Task::(prepare) Task=`1d643c35-7a7c-4fac-8f5e-896be2e1db87`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:45:03,525::task::595::TaskManager.Task::(_updateState) Task=`1d643c35-7a7c-4fac-8f5e-896be2e1db87`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:45:03,525::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:45:03,525::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:45:03,525::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:45:03,525::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:45:03,525::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:45:03,526::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:45:03,526::task::990::TaskManager.Task::(_decref) Task=`1d643c35-7a7c-4fac-8f5e-896be2e1db87`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:45:05,120::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:45:05,195::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362313 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:45:07,207::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:45:07,282::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356452 s, 28.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:45:07,293::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:45:07,303::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00070154 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:45:09,294::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:45:09,366::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336094 s, 30.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:45:11,379::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:45:11,453::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349976 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:45:13,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:45:13,539::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360499 s, 28.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:45:13,595::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:45:13,596::task::595::TaskManager.Task::(_updateState) Task=`7e4a02d7-b823-48e9-87dd-99e727b2b06d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:45:13,596::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:45:13,596::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:45:13,597::task::1185::TaskManager.Task::(prepare) Task=`7e4a02d7-b823-48e9-87dd-99e727b2b06d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:45:13,597::task::595::TaskManager.Task::(_updateState) Task=`7e4a02d7-b823-48e9-87dd-99e727b2b06d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:45:13,597::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:45:13,597::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:45:13,597::task::990::TaskManager.Task::(_decref) Task=`7e4a02d7-b823-48e9-87dd-99e727b2b06d`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:45:13,630::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:45:13,631::task::595::TaskManager.Task::(_updateState) Task=`b0121d19-0452-4355-b405-4b9d11dd42ec`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:45:13,631::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:45:13,631::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`8d41b32b-01a3-4b80-9444-d321a80fea5e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:45:13,631::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:45:13,632::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:45:13,632::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`8d41b32b-01a3-4b80-9444-d321a80fea5e`::Granted request >Thread-34::DEBUG::2014-07-24 10:45:13,632::task::827::TaskManager.Task::(resourceAcquired) Task=`b0121d19-0452-4355-b405-4b9d11dd42ec`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:45:13,632::task::990::TaskManager.Task::(_decref) Task=`b0121d19-0452-4355-b405-4b9d11dd42ec`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:45:13,633::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:45:13,633::task::1185::TaskManager.Task::(prepare) Task=`b0121d19-0452-4355-b405-4b9d11dd42ec`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:45:13,633::task::595::TaskManager.Task::(_updateState) Task=`b0121d19-0452-4355-b405-4b9d11dd42ec`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:45:13,634::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:45:13,634::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:45:13,634::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:45:13,634::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:45:13,634::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:45:13,634::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:45:13,635::task::990::TaskManager.Task::(_decref) Task=`b0121d19-0452-4355-b405-4b9d11dd42ec`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:45:15,184::task::595::TaskManager.Task::(_updateState) Task=`a9415f80-8fa0-4212-b741-cdb094c1fa4a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:45:15,184::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:45:15,184::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00070154', 'lastCheck': '7.9', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:45:15,184::task::1185::TaskManager.Task::(prepare) Task=`a9415f80-8fa0-4212-b741-cdb094c1fa4a`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00070154', 'lastCheck': '7.9', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:45:15,185::task::595::TaskManager.Task::(_updateState) Task=`a9415f80-8fa0-4212-b741-cdb094c1fa4a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:45:15,185::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:45:15,185::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:45:15,185::task::990::TaskManager.Task::(_decref) Task=`a9415f80-8fa0-4212-b741-cdb094c1fa4a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:45:15,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:45:15,626::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366969 s, 27.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:45:17,308::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:45:17,317::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000754918 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:45:17,639::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:45:17,713::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346776 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:45:19,725::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:45:19,799::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347592 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:45:21,811::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:45:21,883::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330744 s, 31.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:45:23,694::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:45:23,701::task::595::TaskManager.Task::(_updateState) Task=`e2b36a65-fd3b-4e81-a019-f483607f58ea`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:45:23,701::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:45:23,702::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:45:23,702::task::1185::TaskManager.Task::(prepare) Task=`e2b36a65-fd3b-4e81-a019-f483607f58ea`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:45:23,702::task::595::TaskManager.Task::(_updateState) Task=`e2b36a65-fd3b-4e81-a019-f483607f58ea`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:45:23,702::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:45:23,702::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:45:23,703::task::990::TaskManager.Task::(_decref) Task=`e2b36a65-fd3b-4e81-a019-f483607f58ea`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:45:23,737::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:45:23,738::task::595::TaskManager.Task::(_updateState) Task=`c11b9805-e021-4467-a215-4a2661aa526c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:45:23,738::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:45:23,738::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`23062df4-774b-43b5-a93a-24a3ff7501ba`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:45:23,738::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:45:23,739::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:45:23,739::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`23062df4-774b-43b5-a93a-24a3ff7501ba`::Granted request >Thread-34::DEBUG::2014-07-24 10:45:23,739::task::827::TaskManager.Task::(resourceAcquired) Task=`c11b9805-e021-4467-a215-4a2661aa526c`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:45:23,739::task::990::TaskManager.Task::(_decref) Task=`c11b9805-e021-4467-a215-4a2661aa526c`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:45:23,740::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:45:23,740::task::1185::TaskManager.Task::(prepare) Task=`c11b9805-e021-4467-a215-4a2661aa526c`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:45:23,740::task::595::TaskManager.Task::(_updateState) Task=`c11b9805-e021-4467-a215-4a2661aa526c`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:45:23,741::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:45:23,741::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:45:23,741::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:45:23,741::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:45:23,741::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:45:23,741::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:45:23,742::task::990::TaskManager.Task::(_decref) Task=`c11b9805-e021-4467-a215-4a2661aa526c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:45:23,895::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:45:23,970::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356704 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:45:25,982::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:45:26,055::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034664 s, 29.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:45:26,935::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-18::DEBUG::2014-07-24 10:45:27,322::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:45:27,341::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0100829 s, 406 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:45:28,068::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:45:28,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0387997 s, 26.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:45:30,159::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:45:30,234::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368833 s, 27.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:45:30,621::task::595::TaskManager.Task::(_updateState) Task=`c88ed96c-109f-463d-bc42-8188ec328a09`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:45:30,621::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:45:30,622::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0100829', 'lastCheck': '3.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:45:30,622::task::1185::TaskManager.Task::(prepare) Task=`c88ed96c-109f-463d-bc42-8188ec328a09`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0100829', 'lastCheck': '3.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:45:30,622::task::595::TaskManager.Task::(_updateState) Task=`c88ed96c-109f-463d-bc42-8188ec328a09`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:45:30,622::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:45:30,622::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:45:30,623::task::990::TaskManager.Task::(_decref) Task=`c88ed96c-109f-463d-bc42-8188ec328a09`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:45:32,246::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:45:32,322::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036443 s, 28.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:45:33,804::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:45:33,805::task::595::TaskManager.Task::(_updateState) Task=`23347ea4-5445-4b13-8a80-9f7bc4e78b7c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:45:33,805::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:45:33,805::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:45:33,806::task::1185::TaskManager.Task::(prepare) Task=`23347ea4-5445-4b13-8a80-9f7bc4e78b7c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:45:33,806::task::595::TaskManager.Task::(_updateState) Task=`23347ea4-5445-4b13-8a80-9f7bc4e78b7c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:45:33,806::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:45:33,806::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:45:33,806::task::990::TaskManager.Task::(_decref) Task=`23347ea4-5445-4b13-8a80-9f7bc4e78b7c`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:45:33,843::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:45:33,843::task::595::TaskManager.Task::(_updateState) Task=`99cad17c-8df8-48ee-b231-06ac08a468db`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:45:33,844::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:45:33,844::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`683b9b89-7334-4ecb-b8a0-a679d49752be`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:45:33,844::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:45:33,844::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:45:33,845::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`683b9b89-7334-4ecb-b8a0-a679d49752be`::Granted request >Thread-34::DEBUG::2014-07-24 10:45:33,845::task::827::TaskManager.Task::(resourceAcquired) Task=`99cad17c-8df8-48ee-b231-06ac08a468db`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:45:33,845::task::990::TaskManager.Task::(_decref) Task=`99cad17c-8df8-48ee-b231-06ac08a468db`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:45:33,846::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:45:33,846::task::1185::TaskManager.Task::(prepare) Task=`99cad17c-8df8-48ee-b231-06ac08a468db`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:45:33,846::task::595::TaskManager.Task::(_updateState) Task=`99cad17c-8df8-48ee-b231-06ac08a468db`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:45:33,846::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:45:33,846::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:45:33,847::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:45:33,847::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:45:33,847::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:45:33,847::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:45:33,847::task::990::TaskManager.Task::(_decref) Task=`99cad17c-8df8-48ee-b231-06ac08a468db`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:45:34,334::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:45:34,408::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348378 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:45:36,420::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:45:36,505::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0465034 s, 22.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:45:37,346::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:45:37,355::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000764917 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:45:38,516::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:45:38,589::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340335 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:45:40,602::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:45:40,675::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344922 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:45:42,687::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:45:42,763::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360059 s, 28.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:45:43,923::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:45:43,924::task::595::TaskManager.Task::(_updateState) Task=`09821e23-55c4-4bc4-a849-4076f2ab8681`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:45:43,924::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:45:43,925::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:45:43,925::task::1185::TaskManager.Task::(prepare) Task=`09821e23-55c4-4bc4-a849-4076f2ab8681`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:45:43,925::task::595::TaskManager.Task::(_updateState) Task=`09821e23-55c4-4bc4-a849-4076f2ab8681`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:45:43,925::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:45:43,925::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:45:43,925::task::990::TaskManager.Task::(_decref) Task=`09821e23-55c4-4bc4-a849-4076f2ab8681`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:45:43,967::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:45:43,967::task::595::TaskManager.Task::(_updateState) Task=`ba157789-6ae9-4490-a19b-9177c1ebe4fe`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:45:43,967::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:45:43,968::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`cb769ed2-8c86-4133-b67f-1ca8d5a44251`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:45:43,968::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:45:43,968::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:45:43,968::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`cb769ed2-8c86-4133-b67f-1ca8d5a44251`::Granted request >Thread-34::DEBUG::2014-07-24 10:45:43,969::task::827::TaskManager.Task::(resourceAcquired) Task=`ba157789-6ae9-4490-a19b-9177c1ebe4fe`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:45:43,969::task::990::TaskManager.Task::(_decref) Task=`ba157789-6ae9-4490-a19b-9177c1ebe4fe`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:45:43,970::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:45:43,970::task::1185::TaskManager.Task::(prepare) Task=`ba157789-6ae9-4490-a19b-9177c1ebe4fe`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:45:43,970::task::595::TaskManager.Task::(_updateState) Task=`ba157789-6ae9-4490-a19b-9177c1ebe4fe`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:45:43,970::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:45:43,970::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:45:43,971::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:45:43,971::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:45:43,971::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:45:43,971::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:45:43,971::task::990::TaskManager.Task::(_decref) Task=`ba157789-6ae9-4490-a19b-9177c1ebe4fe`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:45:44,776::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:45:44,848::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033619 s, 30.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:45:46,050::task::595::TaskManager.Task::(_updateState) Task=`749afa07-d05f-4045-b633-fc7243fbffcf`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:45:46,050::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:45:46,050::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000764917', 'lastCheck': '8.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:45:46,050::task::1185::TaskManager.Task::(prepare) Task=`749afa07-d05f-4045-b633-fc7243fbffcf`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000764917', 'lastCheck': '8.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:45:46,051::task::595::TaskManager.Task::(_updateState) Task=`749afa07-d05f-4045-b633-fc7243fbffcf`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:45:46,051::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:45:46,051::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:45:46,051::task::990::TaskManager.Task::(_decref) Task=`749afa07-d05f-4045-b633-fc7243fbffcf`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:45:46,860::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-24 10:45:47,364::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:45:47,430::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.047051 s, 87.1 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:45:47,516::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.323393 s, 3.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:45:49,529::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:45:49,609::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0387536 s, 26.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:45:51,621::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:45:51,695::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03483 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:45:53,708::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:45:53,783::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364389 s, 28.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:45:54,033::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:45:54,034::task::595::TaskManager.Task::(_updateState) Task=`0e39fd81-5522-4506-aef8-a430ab339fc5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:45:54,034::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:45:54,034::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:45:54,035::task::1185::TaskManager.Task::(prepare) Task=`0e39fd81-5522-4506-aef8-a430ab339fc5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:45:54,035::task::595::TaskManager.Task::(_updateState) Task=`0e39fd81-5522-4506-aef8-a430ab339fc5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:45:54,035::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:45:54,035::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:45:54,035::task::990::TaskManager.Task::(_decref) Task=`0e39fd81-5522-4506-aef8-a430ab339fc5`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:45:54,068::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:45:54,068::task::595::TaskManager.Task::(_updateState) Task=`378bf92d-3138-4ae8-8f01-2542c485338a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:45:54,068::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:45:54,069::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`37e9fabb-4fa0-4970-b069-0031821e8cd9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:45:54,069::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:45:54,069::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:45:54,069::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`37e9fabb-4fa0-4970-b069-0031821e8cd9`::Granted request >Thread-34::DEBUG::2014-07-24 10:45:54,070::task::827::TaskManager.Task::(resourceAcquired) Task=`378bf92d-3138-4ae8-8f01-2542c485338a`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:45:54,070::task::990::TaskManager.Task::(_decref) Task=`378bf92d-3138-4ae8-8f01-2542c485338a`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:45:54,071::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:45:54,071::task::1185::TaskManager.Task::(prepare) Task=`378bf92d-3138-4ae8-8f01-2542c485338a`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:45:54,071::task::595::TaskManager.Task::(_updateState) Task=`378bf92d-3138-4ae8-8f01-2542c485338a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:45:54,071::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:45:54,071::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:45:54,072::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:45:54,072::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:45:54,072::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:45:54,072::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:45:54,072::task::990::TaskManager.Task::(_decref) Task=`378bf92d-3138-4ae8-8f01-2542c485338a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:45:55,795::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:45:55,869::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350498 s, 29.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:45:56,970::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-18::DEBUG::2014-07-24 10:45:57,485::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:45:57,494::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000784568 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:45:57,881::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:45:57,957::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361784 s, 28.3 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 10:45:58,162::task::595::TaskManager.Task::(_updateState) Task=`d1123f4e-57b0-4944-b574-4695ae339d7f`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 10:45:58,162::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 10:45:58,162::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:45:58,162::task::1185::TaskManager.Task::(prepare) Task=`d1123f4e-57b0-4944-b574-4695ae339d7f`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:45:58,163::task::595::TaskManager.Task::(_updateState) Task=`d1123f4e-57b0-4944-b574-4695ae339d7f`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 10:45:58,163::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 10:45:58,163::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 10:45:58,163::task::990::TaskManager.Task::(_decref) Task=`d1123f4e-57b0-4944-b574-4695ae339d7f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:45:59,969::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:46:00,042::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339587 s, 30.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:46:01,876::task::595::TaskManager.Task::(_updateState) Task=`31ef231d-e16d-4b60-a08c-2b5cb4dfbfc3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:46:01,877::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:46:01,877::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000784568', 'lastCheck': '4.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:46:01,877::task::1185::TaskManager.Task::(prepare) Task=`31ef231d-e16d-4b60-a08c-2b5cb4dfbfc3`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000784568', 'lastCheck': '4.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:46:01,877::task::595::TaskManager.Task::(_updateState) Task=`31ef231d-e16d-4b60-a08c-2b5cb4dfbfc3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:46:01,877::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:46:01,878::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:46:01,878::task::990::TaskManager.Task::(_decref) Task=`31ef231d-e16d-4b60-a08c-2b5cb4dfbfc3`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:46:02,054::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:46:02,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365159 s, 28.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:46:04,137::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:46:04,138::task::595::TaskManager.Task::(_updateState) Task=`e373fea1-3f2b-429e-9f32-b14cc912ccb6`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:46:04,138::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:46:04,139::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:46:04,139::task::1185::TaskManager.Task::(prepare) Task=`e373fea1-3f2b-429e-9f32-b14cc912ccb6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:46:04,139::task::595::TaskManager.Task::(_updateState) Task=`e373fea1-3f2b-429e-9f32-b14cc912ccb6`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:46:04,139::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:46:04,139::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:46:04,139::task::990::TaskManager.Task::(_decref) Task=`e373fea1-3f2b-429e-9f32-b14cc912ccb6`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:46:04,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-34::DEBUG::2014-07-24 10:46:04,174::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:46:04,176::task::595::TaskManager.Task::(_updateState) Task=`416b2c25-522b-4966-920c-2de02474e4af`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:46:04,177::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:46:04,179::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`84f9256a-3d66-4254-94f9-7cbd2d8f8819`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:46:04,180::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:46:04,181::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:46:04,182::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`84f9256a-3d66-4254-94f9-7cbd2d8f8819`::Granted request >Thread-34::DEBUG::2014-07-24 10:46:04,184::task::827::TaskManager.Task::(resourceAcquired) Task=`416b2c25-522b-4966-920c-2de02474e4af`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:46:04,185::task::990::TaskManager.Task::(_decref) Task=`416b2c25-522b-4966-920c-2de02474e4af`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:46:04,189::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:46:04,190::task::1185::TaskManager.Task::(prepare) Task=`416b2c25-522b-4966-920c-2de02474e4af`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:46:04,191::task::595::TaskManager.Task::(_updateState) Task=`416b2c25-522b-4966-920c-2de02474e4af`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:46:04,192::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:46:04,193::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:46:04,195::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:46:04,196::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:46:04,197::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:46:04,198::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:46:04,199::task::990::TaskManager.Task::(_decref) Task=`416b2c25-522b-4966-920c-2de02474e4af`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:46:04,243::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0618035 s, 16.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:46:06,255::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:46:06,332::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370755 s, 27.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:46:07,499::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 23aa0606-edc3-4882-a4aa-18aa1983458f >Thread-18::DEBUG::2014-07-24 10:46:07,499::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-18::DEBUG::2014-07-24 10:46:07,499::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:46:07,516::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.00599981 s, 341 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:46:07,517::misc::264::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.00599981 s, 341 kB/s'], size: 2048 >Thread-18::DEBUG::2014-07-24 10:46:07,517::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-18::WARNING::2014-07-24 10:46:07,517::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-18::DEBUG::2014-07-24 10:46:07,517::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-18::DEBUG::2014-07-24 10:46:07,517::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 10:46:07,518::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 10:46:07,518::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 10:46:07,518::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 10:46:07,518::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 10:46:07,519::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-18::DEBUG::2014-07-24 10:46:07,746::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:46:07,747::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 10:46:07,747::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'LOCKPOLICY=', 'POOL_DOMAINS=23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'POOL_DESCRIPTION=DS1', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_UUID=637ea13c-81a8-4b44-8cab-961458b01883', 'POOL_SPM_ID=1', '_SHA_CKSUM=a749afdc7119a2d6aad840af5c63c9b28c0b612c', 'POOL_SPM_LVER=0'] >Thread-18::INFO::2014-07-24 10:46:07,748::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_imageNS already registered >Thread-18::INFO::2014-07-24 10:46:07,748::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_volumeNS already registered >Thread-18::INFO::2014-07-24 10:46:07,748::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_lvmActivationNS already registered >Thread-18::DEBUG::2014-07-24 10:46:07,749::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-18::DEBUG::2014-07-24 10:46:07,902::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:46:07,902::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:46:07,912::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000840397 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:46:08,344::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:46:08,420::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370088 s, 27.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:46:10,433::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:46:10,506::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344689 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:46:12,518::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:46:12,614::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0564651 s, 18.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:46:14,260::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:46:14,260::task::595::TaskManager.Task::(_updateState) Task=`95f5251f-8606-48ea-acf3-1f70cae11ed7`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:46:14,261::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:46:14,261::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:46:14,261::task::1185::TaskManager.Task::(prepare) Task=`95f5251f-8606-48ea-acf3-1f70cae11ed7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:46:14,261::task::595::TaskManager.Task::(_updateState) Task=`95f5251f-8606-48ea-acf3-1f70cae11ed7`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:46:14,261::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:46:14,262::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:46:14,262::task::990::TaskManager.Task::(_decref) Task=`95f5251f-8606-48ea-acf3-1f70cae11ed7`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:46:14,334::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:46:14,334::task::595::TaskManager.Task::(_updateState) Task=`ad06c5c2-2932-4d8e-b012-31efb7a11d2e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:46:14,335::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:46:14,335::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`0b220958-ec8a-474e-8b15-5a9fade4ddcb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:46:14,335::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:46:14,335::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:46:14,336::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`0b220958-ec8a-474e-8b15-5a9fade4ddcb`::Granted request >Thread-34::DEBUG::2014-07-24 10:46:14,336::task::827::TaskManager.Task::(resourceAcquired) Task=`ad06c5c2-2932-4d8e-b012-31efb7a11d2e`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:46:14,336::task::990::TaskManager.Task::(_decref) Task=`ad06c5c2-2932-4d8e-b012-31efb7a11d2e`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:46:14,337::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:46:14,337::task::1185::TaskManager.Task::(prepare) Task=`ad06c5c2-2932-4d8e-b012-31efb7a11d2e`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:46:14,337::task::595::TaskManager.Task::(_updateState) Task=`ad06c5c2-2932-4d8e-b012-31efb7a11d2e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:46:14,337::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:46:14,337::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:46:14,338::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:46:14,338::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:46:14,338::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:46:14,338::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:46:14,338::task::990::TaskManager.Task::(_decref) Task=`ad06c5c2-2932-4d8e-b012-31efb7a11d2e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:46:14,626::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:46:14,700::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348417 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:46:16,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:46:16,785::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344677 s, 29.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:46:17,292::task::595::TaskManager.Task::(_updateState) Task=`d7c7dca6-bfc1-4a58-9eac-c999b3fa44ae`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:46:17,292::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:46:17,292::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000840397', 'lastCheck': '9.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:46:17,293::task::1185::TaskManager.Task::(prepare) Task=`d7c7dca6-bfc1-4a58-9eac-c999b3fa44ae`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000840397', 'lastCheck': '9.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:46:17,293::task::595::TaskManager.Task::(_updateState) Task=`d7c7dca6-bfc1-4a58-9eac-c999b3fa44ae`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:46:17,293::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:46:17,293::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:46:17,293::task::990::TaskManager.Task::(_decref) Task=`d7c7dca6-bfc1-4a58-9eac-c999b3fa44ae`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 10:46:17,917::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:46:17,927::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000748691 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:46:18,797::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:46:18,872::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350307 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:46:20,884::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:46:20,956::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033997 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:46:22,969::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:46:23,043::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355836 s, 28.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:46:24,397::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:46:24,397::task::595::TaskManager.Task::(_updateState) Task=`4a40294a-e995-4dd7-be4f-04271f640dcc`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:46:24,398::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:46:24,398::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:46:24,398::task::1185::TaskManager.Task::(prepare) Task=`4a40294a-e995-4dd7-be4f-04271f640dcc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:46:24,398::task::595::TaskManager.Task::(_updateState) Task=`4a40294a-e995-4dd7-be4f-04271f640dcc`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:46:24,398::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:46:24,399::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:46:24,399::task::990::TaskManager.Task::(_decref) Task=`4a40294a-e995-4dd7-be4f-04271f640dcc`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:46:24,469::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:46:24,469::task::595::TaskManager.Task::(_updateState) Task=`3f445d88-8a5b-4f9a-aab5-a7d08b5b7e86`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:46:24,469::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:46:24,470::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`86e82f38-00ee-4f24-8b2b-dc3f5bf65dcf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:46:24,470::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:46:24,470::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:46:24,470::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`86e82f38-00ee-4f24-8b2b-dc3f5bf65dcf`::Granted request >Thread-34::DEBUG::2014-07-24 10:46:24,471::task::827::TaskManager.Task::(resourceAcquired) Task=`3f445d88-8a5b-4f9a-aab5-a7d08b5b7e86`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:46:24,471::task::990::TaskManager.Task::(_decref) Task=`3f445d88-8a5b-4f9a-aab5-a7d08b5b7e86`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:46:24,471::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:46:24,472::task::1185::TaskManager.Task::(prepare) Task=`3f445d88-8a5b-4f9a-aab5-a7d08b5b7e86`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:46:24,472::task::595::TaskManager.Task::(_updateState) Task=`3f445d88-8a5b-4f9a-aab5-a7d08b5b7e86`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:46:24,472::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:46:24,472::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:46:24,472::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:46:24,473::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:46:24,473::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:46:24,473::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:46:24,473::task::990::TaskManager.Task::(_decref) Task=`3f445d88-8a5b-4f9a-aab5-a7d08b5b7e86`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:46:25,056::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:46:25,131::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351278 s, 29.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:46:27,010::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:46:27,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:46:27,219::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362431 s, 28.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:46:27,931::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:46:27,950::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00966406 s, 424 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:46:29,231::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:46:29,310::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379554 s, 27.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:46:31,322::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:46:31,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337092 s, 30.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:46:32,668::task::595::TaskManager.Task::(_updateState) Task=`bf44bfa9-f464-476c-9474-ff963f12726c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:46:32,668::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:46:32,669::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00966406', 'lastCheck': '4.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:46:32,669::task::1185::TaskManager.Task::(prepare) Task=`bf44bfa9-f464-476c-9474-ff963f12726c`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00966406', 'lastCheck': '4.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:46:32,669::task::595::TaskManager.Task::(_updateState) Task=`bf44bfa9-f464-476c-9474-ff963f12726c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:46:32,669::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:46:32,669::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:46:32,669::task::990::TaskManager.Task::(_decref) Task=`bf44bfa9-f464-476c-9474-ff963f12726c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:46:33,408::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:46:33,481::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346367 s, 29.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:46:34,534::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:46:34,534::task::595::TaskManager.Task::(_updateState) Task=`ecf2c291-34f1-487a-a07a-42dd9f7a4d4e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:46:34,534::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:46:34,535::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:46:34,535::task::1185::TaskManager.Task::(prepare) Task=`ecf2c291-34f1-487a-a07a-42dd9f7a4d4e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:46:34,535::task::595::TaskManager.Task::(_updateState) Task=`ecf2c291-34f1-487a-a07a-42dd9f7a4d4e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:46:34,535::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:46:34,535::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:46:34,536::task::990::TaskManager.Task::(_decref) Task=`ecf2c291-34f1-487a-a07a-42dd9f7a4d4e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:46:34,568::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:46:34,568::task::595::TaskManager.Task::(_updateState) Task=`46624dc1-6fcb-4210-b0ef-07f2d29fbe56`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:46:34,569::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:46:34,569::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1e29c330-fd02-4761-abcb-a6f298538fbe`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:46:34,569::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:46:34,569::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:46:34,570::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1e29c330-fd02-4761-abcb-a6f298538fbe`::Granted request >Thread-34::DEBUG::2014-07-24 10:46:34,570::task::827::TaskManager.Task::(resourceAcquired) Task=`46624dc1-6fcb-4210-b0ef-07f2d29fbe56`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:46:34,570::task::990::TaskManager.Task::(_decref) Task=`46624dc1-6fcb-4210-b0ef-07f2d29fbe56`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:46:34,571::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:46:34,571::task::1185::TaskManager.Task::(prepare) Task=`46624dc1-6fcb-4210-b0ef-07f2d29fbe56`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:46:34,572::task::595::TaskManager.Task::(_updateState) Task=`46624dc1-6fcb-4210-b0ef-07f2d29fbe56`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:46:34,572::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:46:34,572::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:46:34,573::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:46:34,573::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:46:34,573::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:46:34,573::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:46:34,573::task::990::TaskManager.Task::(_decref) Task=`46624dc1-6fcb-4210-b0ef-07f2d29fbe56`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:46:35,493::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:46:35,576::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0435725 s, 23.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:46:37,589::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:46:37,873::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354402 s, 28.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:46:37,955::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:46:37,964::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000680662 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:46:39,885::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:46:39,959::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343333 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:46:41,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:46:42,048::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037732 s, 27.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:46:44,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:46:44,133::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03383 s, 30.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:46:44,631::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:46:44,631::task::595::TaskManager.Task::(_updateState) Task=`1db0dbe7-1d8b-4875-95c6-6a7ea7af6599`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:46:44,631::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:46:44,632::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:46:44,632::task::1185::TaskManager.Task::(prepare) Task=`1db0dbe7-1d8b-4875-95c6-6a7ea7af6599`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:46:44,632::task::595::TaskManager.Task::(_updateState) Task=`1db0dbe7-1d8b-4875-95c6-6a7ea7af6599`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:46:44,632::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:46:44,632::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:46:44,633::task::990::TaskManager.Task::(_decref) Task=`1db0dbe7-1d8b-4875-95c6-6a7ea7af6599`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:46:44,668::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:46:44,668::task::595::TaskManager.Task::(_updateState) Task=`7d792196-1e61-49c8-af54-6e40eb9ba194`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:46:44,669::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:46:44,669::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c9111ad1-a23b-4774-b5a1-8ec81e12bd0f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:46:44,669::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:46:44,669::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:46:44,670::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c9111ad1-a23b-4774-b5a1-8ec81e12bd0f`::Granted request >Thread-34::DEBUG::2014-07-24 10:46:44,670::task::827::TaskManager.Task::(resourceAcquired) Task=`7d792196-1e61-49c8-af54-6e40eb9ba194`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:46:44,670::task::990::TaskManager.Task::(_decref) Task=`7d792196-1e61-49c8-af54-6e40eb9ba194`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:46:44,671::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:46:44,671::task::1185::TaskManager.Task::(prepare) Task=`7d792196-1e61-49c8-af54-6e40eb9ba194`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:46:44,671::task::595::TaskManager.Task::(_updateState) Task=`7d792196-1e61-49c8-af54-6e40eb9ba194`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:46:44,671::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:46:44,672::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:46:44,672::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:46:44,672::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:46:44,672::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:46:44,672::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:46:44,672::task::990::TaskManager.Task::(_decref) Task=`7d792196-1e61-49c8-af54-6e40eb9ba194`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:46:46,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:46:46,223::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372873 s, 27.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:46:47,969::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:46:47,979::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000725216 s, 5.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:46:48,094::task::595::TaskManager.Task::(_updateState) Task=`7fc7694b-33ec-4b82-a0b0-1323bc96b2c7`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:46:48,094::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:46:48,094::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000725216', 'lastCheck': '0.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:46:48,094::task::1185::TaskManager.Task::(prepare) Task=`7fc7694b-33ec-4b82-a0b0-1323bc96b2c7`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000725216', 'lastCheck': '0.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:46:48,094::task::595::TaskManager.Task::(_updateState) Task=`7fc7694b-33ec-4b82-a0b0-1323bc96b2c7`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:46:48,095::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:46:48,095::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:46:48,095::task::990::TaskManager.Task::(_decref) Task=`7fc7694b-33ec-4b82-a0b0-1323bc96b2c7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:46:48,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:46:48,315::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363454 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:46:50,328::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:46:50,400::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338033 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:46:52,412::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:46:52,486::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03459 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:46:54,498::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:46:54,580::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0376 s, 27.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:46:54,729::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:46:54,729::task::595::TaskManager.Task::(_updateState) Task=`326116d9-e18c-4164-991b-0b8022b2388b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:46:54,729::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:46:54,730::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:46:54,730::task::1185::TaskManager.Task::(prepare) Task=`326116d9-e18c-4164-991b-0b8022b2388b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:46:54,730::task::595::TaskManager.Task::(_updateState) Task=`326116d9-e18c-4164-991b-0b8022b2388b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:46:54,730::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:46:54,730::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:46:54,730::task::990::TaskManager.Task::(_decref) Task=`326116d9-e18c-4164-991b-0b8022b2388b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:46:54,762::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:46:54,762::task::595::TaskManager.Task::(_updateState) Task=`1229b848-ef46-42ab-83c4-71959dc3768d`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:46:54,762::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:46:54,763::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ce083a03-fd8e-4371-b96a-980b5ad1a021`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:46:54,763::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:46:54,763::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:46:54,763::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ce083a03-fd8e-4371-b96a-980b5ad1a021`::Granted request >Thread-34::DEBUG::2014-07-24 10:46:54,763::task::827::TaskManager.Task::(resourceAcquired) Task=`1229b848-ef46-42ab-83c4-71959dc3768d`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:46:54,764::task::990::TaskManager.Task::(_decref) Task=`1229b848-ef46-42ab-83c4-71959dc3768d`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:46:54,764::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:46:54,764::task::1185::TaskManager.Task::(prepare) Task=`1229b848-ef46-42ab-83c4-71959dc3768d`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:46:54,765::task::595::TaskManager.Task::(_updateState) Task=`1229b848-ef46-42ab-83c4-71959dc3768d`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:46:54,765::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:46:54,765::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:46:54,765::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:46:54,765::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:46:54,766::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:46:54,766::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:46:54,766::task::990::TaskManager.Task::(_decref) Task=`1229b848-ef46-42ab-83c4-71959dc3768d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:46:56,592::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:46:56,666::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034987 s, 29.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:46:57,046::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-18::DEBUG::2014-07-24 10:46:57,984::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:46:57,993::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000683294 s, 6.0 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 10:46:58,319::task::595::TaskManager.Task::(_updateState) Task=`9f139bfd-e89b-4556-9d16-0970a7f65317`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 10:46:58,319::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 10:46:58,320::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:46:58,320::task::1185::TaskManager.Task::(prepare) Task=`9f139bfd-e89b-4556-9d16-0970a7f65317`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:46:58,320::task::595::TaskManager.Task::(_updateState) Task=`9f139bfd-e89b-4556-9d16-0970a7f65317`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 10:46:58,320::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 10:46:58,320::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 10:46:58,321::task::990::TaskManager.Task::(_decref) Task=`9f139bfd-e89b-4556-9d16-0970a7f65317`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:46:58,678::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:46:58,762::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0438742 s, 23.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:47:00,773::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:47:00,848::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344601 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:47:02,860::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:47:02,934::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352759 s, 29.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:47:03,506::task::595::TaskManager.Task::(_updateState) Task=`50b5013c-5f20-445c-b8f9-1b0fd93a7111`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:47:03,506::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:47:03,506::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000683294', 'lastCheck': '5.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:47:03,506::task::1185::TaskManager.Task::(prepare) Task=`50b5013c-5f20-445c-b8f9-1b0fd93a7111`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000683294', 'lastCheck': '5.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:47:03,507::task::595::TaskManager.Task::(_updateState) Task=`50b5013c-5f20-445c-b8f9-1b0fd93a7111`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:47:03,507::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:47:03,507::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:47:03,507::task::990::TaskManager.Task::(_decref) Task=`50b5013c-5f20-445c-b8f9-1b0fd93a7111`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:47:04,827::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:47:04,827::task::595::TaskManager.Task::(_updateState) Task=`7b4534c9-aa56-490f-a887-f0b42cf7871e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:47:04,827::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:47:04,828::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:47:04,828::task::1185::TaskManager.Task::(prepare) Task=`7b4534c9-aa56-490f-a887-f0b42cf7871e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:47:04,828::task::595::TaskManager.Task::(_updateState) Task=`7b4534c9-aa56-490f-a887-f0b42cf7871e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:47:04,828::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:47:04,828::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:47:04,829::task::990::TaskManager.Task::(_decref) Task=`7b4534c9-aa56-490f-a887-f0b42cf7871e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:47:04,869::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:47:04,869::task::595::TaskManager.Task::(_updateState) Task=`df9c7e8f-ee5e-4b53-911f-d47006296186`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:47:04,869::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:47:04,870::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7e0ecb53-d559-4788-83b1-038419653b78`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:47:04,870::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:47:04,870::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:47:04,870::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7e0ecb53-d559-4788-83b1-038419653b78`::Granted request >Thread-34::DEBUG::2014-07-24 10:47:04,871::task::827::TaskManager.Task::(resourceAcquired) Task=`df9c7e8f-ee5e-4b53-911f-d47006296186`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:47:04,871::task::990::TaskManager.Task::(_decref) Task=`df9c7e8f-ee5e-4b53-911f-d47006296186`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:47:04,871::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:47:04,872::task::1185::TaskManager.Task::(prepare) Task=`df9c7e8f-ee5e-4b53-911f-d47006296186`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:47:04,872::task::595::TaskManager.Task::(_updateState) Task=`df9c7e8f-ee5e-4b53-911f-d47006296186`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:47:04,872::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:47:04,872::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:47:04,872::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:47:04,872::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:47:04,873::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:47:04,873::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:47:04,873::task::990::TaskManager.Task::(_decref) Task=`df9c7e8f-ee5e-4b53-911f-d47006296186`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:47:04,946::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:47:05,021::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355744 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:47:07,033::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:47:07,109::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035671 s, 28.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:47:07,998::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:47:08,018::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0112355 s, 365 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:47:09,121::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:47:09,196::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349075 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:47:11,208::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:47:11,283::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353882 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:47:13,295::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:47:13,370::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348709 s, 29.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:47:14,944::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:47:14,945::task::595::TaskManager.Task::(_updateState) Task=`b0e58c7c-91e6-4d2e-bd10-42da00eae8e8`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:47:14,945::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:47:14,945::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:47:14,945::task::1185::TaskManager.Task::(prepare) Task=`b0e58c7c-91e6-4d2e-bd10-42da00eae8e8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:47:14,946::task::595::TaskManager.Task::(_updateState) Task=`b0e58c7c-91e6-4d2e-bd10-42da00eae8e8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:47:14,946::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:47:14,946::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:47:14,946::task::990::TaskManager.Task::(_decref) Task=`b0e58c7c-91e6-4d2e-bd10-42da00eae8e8`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:47:14,988::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:47:14,988::task::595::TaskManager.Task::(_updateState) Task=`28b27ef9-b66d-48aa-b890-c9e898baf308`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:47:14,988::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:47:14,989::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7752284d-1711-4e69-8dfa-6c3213fbaaea`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:47:14,989::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:47:14,989::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:47:14,989::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7752284d-1711-4e69-8dfa-6c3213fbaaea`::Granted request >Thread-34::DEBUG::2014-07-24 10:47:14,989::task::827::TaskManager.Task::(resourceAcquired) Task=`28b27ef9-b66d-48aa-b890-c9e898baf308`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:47:14,990::task::990::TaskManager.Task::(_decref) Task=`28b27ef9-b66d-48aa-b890-c9e898baf308`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:47:14,991::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:47:14,991::task::1185::TaskManager.Task::(prepare) Task=`28b27ef9-b66d-48aa-b890-c9e898baf308`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:47:14,991::task::595::TaskManager.Task::(_updateState) Task=`28b27ef9-b66d-48aa-b890-c9e898baf308`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:47:14,991::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:47:14,992::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:47:14,992::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:47:14,992::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:47:14,992::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:47:14,992::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:47:14,993::task::990::TaskManager.Task::(_decref) Task=`28b27ef9-b66d-48aa-b890-c9e898baf308`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:47:15,384::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:47:15,458::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350697 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:47:17,470::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:47:17,544::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346146 s, 29.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:47:18,023::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:47:18,032::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000749914 s, 5.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:47:18,904::task::595::TaskManager.Task::(_updateState) Task=`1d372ff3-496b-4cf5-a4af-67dbc4d5aded`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:47:18,904::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:47:18,904::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000749914', 'lastCheck': '0.9', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:47:18,905::task::1185::TaskManager.Task::(prepare) Task=`1d372ff3-496b-4cf5-a4af-67dbc4d5aded`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000749914', 'lastCheck': '0.9', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:47:18,905::task::595::TaskManager.Task::(_updateState) Task=`1d372ff3-496b-4cf5-a4af-67dbc4d5aded`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:47:18,905::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:47:18,905::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:47:18,905::task::990::TaskManager.Task::(_decref) Task=`1d372ff3-496b-4cf5-a4af-67dbc4d5aded`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:47:19,556::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:47:19,636::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0401985 s, 25.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:47:21,648::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:47:21,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363325 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:47:23,737::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:47:23,810::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034479 s, 29.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:47:25,055::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:47:25,056::task::595::TaskManager.Task::(_updateState) Task=`be3b2c03-8860-411c-83af-2d2ccf8f90da`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:47:25,056::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:47:25,056::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:47:25,057::task::1185::TaskManager.Task::(prepare) Task=`be3b2c03-8860-411c-83af-2d2ccf8f90da`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:47:25,057::task::595::TaskManager.Task::(_updateState) Task=`be3b2c03-8860-411c-83af-2d2ccf8f90da`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:47:25,057::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:47:25,057::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:47:25,057::task::990::TaskManager.Task::(_decref) Task=`be3b2c03-8860-411c-83af-2d2ccf8f90da`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:47:25,089::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:47:25,090::task::595::TaskManager.Task::(_updateState) Task=`fe77b240-db0b-4391-ad26-4237bb934fd2`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:47:25,090::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:47:25,090::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7b7e5843-2730-4f91-a091-3dbc5c6a162d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:47:25,091::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:47:25,091::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:47:25,091::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7b7e5843-2730-4f91-a091-3dbc5c6a162d`::Granted request >Thread-34::DEBUG::2014-07-24 10:47:25,091::task::827::TaskManager.Task::(resourceAcquired) Task=`fe77b240-db0b-4391-ad26-4237bb934fd2`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:47:25,091::task::990::TaskManager.Task::(_decref) Task=`fe77b240-db0b-4391-ad26-4237bb934fd2`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:47:25,092::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:47:25,092::task::1185::TaskManager.Task::(prepare) Task=`fe77b240-db0b-4391-ad26-4237bb934fd2`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:47:25,093::task::595::TaskManager.Task::(_updateState) Task=`fe77b240-db0b-4391-ad26-4237bb934fd2`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:47:25,093::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:47:25,093::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:47:25,093::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:47:25,093::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:47:25,093::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:47:25,094::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:47:25,094::task::990::TaskManager.Task::(_decref) Task=`fe77b240-db0b-4391-ad26-4237bb934fd2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:47:25,823::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:47:25,895::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337138 s, 30.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:47:27,082::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:47:27,908::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:47:27,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365122 s, 28.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:47:28,037::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:47:28,046::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000714358 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:47:29,995::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:47:30,069::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344352 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:47:32,081::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:47:32,153::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334368 s, 30.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:47:34,166::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:47:34,240::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346896 s, 29.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:47:34,329::task::595::TaskManager.Task::(_updateState) Task=`ec4a89ca-a327-48a3-9191-a68757bba875`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:47:34,329::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:47:34,330::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000714358', 'lastCheck': '6.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:47:34,330::task::1185::TaskManager.Task::(prepare) Task=`ec4a89ca-a327-48a3-9191-a68757bba875`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000714358', 'lastCheck': '6.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:47:34,330::task::595::TaskManager.Task::(_updateState) Task=`ec4a89ca-a327-48a3-9191-a68757bba875`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:47:34,330::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:47:34,330::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:47:34,330::task::990::TaskManager.Task::(_decref) Task=`ec4a89ca-a327-48a3-9191-a68757bba875`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:47:35,170::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:47:35,170::task::595::TaskManager.Task::(_updateState) Task=`0acbb285-f9dc-479f-9936-0dfc0c2ef6a4`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:47:35,171::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:47:35,171::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:47:35,171::task::1185::TaskManager.Task::(prepare) Task=`0acbb285-f9dc-479f-9936-0dfc0c2ef6a4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:47:35,171::task::595::TaskManager.Task::(_updateState) Task=`0acbb285-f9dc-479f-9936-0dfc0c2ef6a4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:47:35,171::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:47:35,171::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:47:35,172::task::990::TaskManager.Task::(_decref) Task=`0acbb285-f9dc-479f-9936-0dfc0c2ef6a4`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:47:35,206::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:47:35,206::task::595::TaskManager.Task::(_updateState) Task=`a34d7b0c-50b4-4e65-a583-78989b4160f4`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:47:35,206::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:47:35,207::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f0bcfd67-2636-4a3a-9037-144c3b56475b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:47:35,207::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:47:35,207::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:47:35,207::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f0bcfd67-2636-4a3a-9037-144c3b56475b`::Granted request >Thread-34::DEBUG::2014-07-24 10:47:35,208::task::827::TaskManager.Task::(resourceAcquired) Task=`a34d7b0c-50b4-4e65-a583-78989b4160f4`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:47:35,208::task::990::TaskManager.Task::(_decref) Task=`a34d7b0c-50b4-4e65-a583-78989b4160f4`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:47:35,209::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:47:35,209::task::1185::TaskManager.Task::(prepare) Task=`a34d7b0c-50b4-4e65-a583-78989b4160f4`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:47:35,209::task::595::TaskManager.Task::(_updateState) Task=`a34d7b0c-50b4-4e65-a583-78989b4160f4`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:47:35,209::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:47:35,209::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:47:35,210::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:47:35,210::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:47:35,210::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:47:35,210::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:47:35,210::task::990::TaskManager.Task::(_decref) Task=`a34d7b0c-50b4-4e65-a583-78989b4160f4`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:47:36,252::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:47:36,325::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343401 s, 29.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:47:38,051::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:47:38,060::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00065598 s, 6.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:47:38,338::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:47:38,414::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369364 s, 27.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:47:40,426::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:47:40,499::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341549 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:47:42,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:47:42,588::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0374394 s, 27.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:47:44,600::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:47:44,673::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339829 s, 30.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:47:45,270::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:47:45,271::task::595::TaskManager.Task::(_updateState) Task=`2a9565eb-2ae1-4505-83bf-78fb2b5b3018`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:47:45,271::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:47:45,271::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:47:45,271::task::1185::TaskManager.Task::(prepare) Task=`2a9565eb-2ae1-4505-83bf-78fb2b5b3018`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:47:45,272::task::595::TaskManager.Task::(_updateState) Task=`2a9565eb-2ae1-4505-83bf-78fb2b5b3018`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:47:45,272::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:47:45,272::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:47:45,272::task::990::TaskManager.Task::(_decref) Task=`2a9565eb-2ae1-4505-83bf-78fb2b5b3018`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:47:45,310::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:47:45,310::task::595::TaskManager.Task::(_updateState) Task=`d50962cf-2679-430f-afd0-72fe69fd42ba`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:47:45,311::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:47:45,312::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`2d2f219a-8b4e-4e1d-90ee-2797e05fc50e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:47:45,312::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:47:45,313::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:47:45,313::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`2d2f219a-8b4e-4e1d-90ee-2797e05fc50e`::Granted request >Thread-34::DEBUG::2014-07-24 10:47:45,313::task::827::TaskManager.Task::(resourceAcquired) Task=`d50962cf-2679-430f-afd0-72fe69fd42ba`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:47:45,313::task::990::TaskManager.Task::(_decref) Task=`d50962cf-2679-430f-afd0-72fe69fd42ba`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:47:45,314::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:47:45,314::task::1185::TaskManager.Task::(prepare) Task=`d50962cf-2679-430f-afd0-72fe69fd42ba`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:47:45,314::task::595::TaskManager.Task::(_updateState) Task=`d50962cf-2679-430f-afd0-72fe69fd42ba`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:47:45,314::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:47:45,315::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:47:45,315::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:47:45,315::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:47:45,315::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:47:45,315::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:47:45,315::task::990::TaskManager.Task::(_decref) Task=`d50962cf-2679-430f-afd0-72fe69fd42ba`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:47:46,685::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:47:46,760::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035188 s, 29.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:47:48,065::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:47:48,077::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000706624 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:47:48,772::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:47:48,845::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338242 s, 30.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:47:49,694::task::595::TaskManager.Task::(_updateState) Task=`e409b0e0-bd34-45d7-86a5-2ed45374f8c0`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:47:49,694::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:47:49,695::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000706624', 'lastCheck': '1.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:47:49,695::task::1185::TaskManager.Task::(prepare) Task=`e409b0e0-bd34-45d7-86a5-2ed45374f8c0`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000706624', 'lastCheck': '1.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:47:49,695::task::595::TaskManager.Task::(_updateState) Task=`e409b0e0-bd34-45d7-86a5-2ed45374f8c0`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:47:49,695::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:47:49,695::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:47:49,695::task::990::TaskManager.Task::(_decref) Task=`e409b0e0-bd34-45d7-86a5-2ed45374f8c0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:47:50,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:47:50,941::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359144 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:47:52,953::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:47:53,031::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0389388 s, 26.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:47:55,044::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:47:55,118::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346663 s, 29.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:47:55,373::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:47:55,373::task::595::TaskManager.Task::(_updateState) Task=`3d1b9da0-65fd-4dae-b46a-3174305f0505`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:47:55,374::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:47:55,374::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:47:55,374::task::1185::TaskManager.Task::(prepare) Task=`3d1b9da0-65fd-4dae-b46a-3174305f0505`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:47:55,374::task::595::TaskManager.Task::(_updateState) Task=`3d1b9da0-65fd-4dae-b46a-3174305f0505`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:47:55,374::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:47:55,375::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:47:55,375::task::990::TaskManager.Task::(_decref) Task=`3d1b9da0-65fd-4dae-b46a-3174305f0505`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:47:55,406::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:47:55,406::task::595::TaskManager.Task::(_updateState) Task=`68cf6bc5-157f-4d80-aed2-d3c397d4bc36`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:47:55,407::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:47:55,407::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`408c5fc9-c13d-4efb-8ad0-f89f4059beb9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:47:55,407::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:47:55,407::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:47:55,408::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`408c5fc9-c13d-4efb-8ad0-f89f4059beb9`::Granted request >Thread-34::DEBUG::2014-07-24 10:47:55,408::task::827::TaskManager.Task::(resourceAcquired) Task=`68cf6bc5-157f-4d80-aed2-d3c397d4bc36`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:47:55,408::task::990::TaskManager.Task::(_decref) Task=`68cf6bc5-157f-4d80-aed2-d3c397d4bc36`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:47:55,409::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:47:55,409::task::1185::TaskManager.Task::(prepare) Task=`68cf6bc5-157f-4d80-aed2-d3c397d4bc36`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:47:55,409::task::595::TaskManager.Task::(_updateState) Task=`68cf6bc5-157f-4d80-aed2-d3c397d4bc36`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:47:55,409::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:47:55,410::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:47:55,410::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:47:55,410::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:47:55,410::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:47:55,410::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:47:55,410::task::990::TaskManager.Task::(_decref) Task=`68cf6bc5-157f-4d80-aed2-d3c397d4bc36`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-07-24 10:47:57,119::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:47:57,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:47:57,204::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036187 s, 28.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:47:58,092::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:47:58,101::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000751191 s, 5.5 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 10:47:58,473::task::595::TaskManager.Task::(_updateState) Task=`cb119e7e-31f5-4b1d-9e7e-16286de7858f`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 10:47:58,474::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 10:47:58,474::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:47:58,474::task::1185::TaskManager.Task::(prepare) Task=`cb119e7e-31f5-4b1d-9e7e-16286de7858f`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:47:58,474::task::595::TaskManager.Task::(_updateState) Task=`cb119e7e-31f5-4b1d-9e7e-16286de7858f`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 10:47:58,474::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 10:47:58,475::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 10:47:58,475::task::990::TaskManager.Task::(_decref) Task=`cb119e7e-31f5-4b1d-9e7e-16286de7858f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:47:59,217::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:47:59,291::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034608 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:48:01,304::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:48:01,376::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338789 s, 30.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:48:03,388::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:48:03,464::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035863 s, 28.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:48:05,138::task::595::TaskManager.Task::(_updateState) Task=`89ff58ac-2cce-41f3-950b-dd7a29f2f21d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:48:05,138::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:48:05,138::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000751191', 'lastCheck': '7.0', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:48:05,139::task::1185::TaskManager.Task::(prepare) Task=`89ff58ac-2cce-41f3-950b-dd7a29f2f21d`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000751191', 'lastCheck': '7.0', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:48:05,139::task::595::TaskManager.Task::(_updateState) Task=`89ff58ac-2cce-41f3-950b-dd7a29f2f21d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:48:05,139::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:48:05,139::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:48:05,139::task::990::TaskManager.Task::(_decref) Task=`89ff58ac-2cce-41f3-950b-dd7a29f2f21d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:48:05,476::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-24 10:48:05,485::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:48:05,485::task::595::TaskManager.Task::(_updateState) Task=`a07aca69-93ca-4c36-80d0-42b7d23def93`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:48:05,486::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:48:05,486::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:48:05,487::task::1185::TaskManager.Task::(prepare) Task=`a07aca69-93ca-4c36-80d0-42b7d23def93`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:48:05,487::task::595::TaskManager.Task::(_updateState) Task=`a07aca69-93ca-4c36-80d0-42b7d23def93`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:48:05,487::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:48:05,487::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:48:05,488::task::990::TaskManager.Task::(_decref) Task=`a07aca69-93ca-4c36-80d0-42b7d23def93`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:48:05,524::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:48:05,525::task::595::TaskManager.Task::(_updateState) Task=`077ac605-d38d-40ae-bdd9-66567c289681`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:48:05,526::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:48:05,529::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`9da704ca-de0c-4b6c-8d0e-c27040fb8cdd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:48:05,530::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:48:05,531::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:48:05,532::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`9da704ca-de0c-4b6c-8d0e-c27040fb8cdd`::Granted request >Thread-34::DEBUG::2014-07-24 10:48:05,534::task::827::TaskManager.Task::(resourceAcquired) Task=`077ac605-d38d-40ae-bdd9-66567c289681`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:48:05,535::task::990::TaskManager.Task::(_decref) Task=`077ac605-d38d-40ae-bdd9-66567c289681`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:48:05,538::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:48:05,539::task::1185::TaskManager.Task::(prepare) Task=`077ac605-d38d-40ae-bdd9-66567c289681`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:48:05,539::task::595::TaskManager.Task::(_updateState) Task=`077ac605-d38d-40ae-bdd9-66567c289681`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:48:05,540::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:48:05,541::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:48:05,542::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:48:05,543::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:48:05,544::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:48:05,545::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:48:05,546::task::990::TaskManager.Task::(_decref) Task=`077ac605-d38d-40ae-bdd9-66567c289681`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:48:05,583::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359148 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:48:07,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:48:07,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367178 s, 27.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:48:08,106::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:48:08,115::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000680045 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:48:09,684::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:48:09,762::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037142 s, 27.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:48:11,773::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:48:11,849::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365171 s, 28.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:48:13,861::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:48:13,936::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352372 s, 29.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:48:15,610::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:48:15,611::task::595::TaskManager.Task::(_updateState) Task=`dd97446a-f059-43dc-b158-54ae77d27418`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:48:15,611::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:48:15,611::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:48:15,612::task::1185::TaskManager.Task::(prepare) Task=`dd97446a-f059-43dc-b158-54ae77d27418`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:48:15,612::task::595::TaskManager.Task::(_updateState) Task=`dd97446a-f059-43dc-b158-54ae77d27418`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:48:15,612::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:48:15,612::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:48:15,612::task::990::TaskManager.Task::(_decref) Task=`dd97446a-f059-43dc-b158-54ae77d27418`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:48:15,644::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:48:15,644::task::595::TaskManager.Task::(_updateState) Task=`d4a696ed-bd8a-4911-891a-534742eb36b8`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:48:15,644::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:48:15,645::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`faa11179-764f-4ed0-9284-4e653bbbe6e7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:48:15,645::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:48:15,645::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:48:15,645::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`faa11179-764f-4ed0-9284-4e653bbbe6e7`::Granted request >Thread-34::DEBUG::2014-07-24 10:48:15,645::task::827::TaskManager.Task::(resourceAcquired) Task=`d4a696ed-bd8a-4911-891a-534742eb36b8`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:48:15,646::task::990::TaskManager.Task::(_decref) Task=`d4a696ed-bd8a-4911-891a-534742eb36b8`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:48:15,646::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:48:15,646::task::1185::TaskManager.Task::(prepare) Task=`d4a696ed-bd8a-4911-891a-534742eb36b8`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:48:15,647::task::595::TaskManager.Task::(_updateState) Task=`d4a696ed-bd8a-4911-891a-534742eb36b8`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:48:15,647::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:48:15,647::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:48:15,647::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:48:15,647::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:48:15,648::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:48:15,648::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:48:15,648::task::990::TaskManager.Task::(_decref) Task=`d4a696ed-bd8a-4911-891a-534742eb36b8`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:48:15,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:48:16,022::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346813 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:48:18,034::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:48:18,109::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365717 s, 28.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:48:18,120::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:48:18,130::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000674281 s, 6.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:48:20,121::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:48:20,198::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373045 s, 27.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:48:20,504::task::595::TaskManager.Task::(_updateState) Task=`0e9183fd-0b7a-466b-b9ac-50a4c26a59f0`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:48:20,504::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:48:20,505::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000674281', 'lastCheck': '2.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:48:20,505::task::1185::TaskManager.Task::(prepare) Task=`0e9183fd-0b7a-466b-b9ac-50a4c26a59f0`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000674281', 'lastCheck': '2.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:48:20,505::task::595::TaskManager.Task::(_updateState) Task=`0e9183fd-0b7a-466b-b9ac-50a4c26a59f0`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:48:20,505::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:48:20,505::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:48:20,505::task::990::TaskManager.Task::(_decref) Task=`0e9183fd-0b7a-466b-b9ac-50a4c26a59f0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:48:22,210::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:48:22,285::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345726 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:48:24,297::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:48:24,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0371254 s, 27.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:48:25,702::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [3b38bf98] >Thread-14::DEBUG::2014-07-24 10:48:25,703::task::595::TaskManager.Task::(_updateState) Task=`a77cc9a4-0476-4f08-9eb8-4752ad390244`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:48:25,703::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:48:25,703::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:48:25,703::task::1185::TaskManager.Task::(prepare) Task=`a77cc9a4-0476-4f08-9eb8-4752ad390244`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:48:25,704::task::595::TaskManager.Task::(_updateState) Task=`a77cc9a4-0476-4f08-9eb8-4752ad390244`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:48:25,704::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:48:25,704::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:48:25,704::task::990::TaskManager.Task::(_decref) Task=`a77cc9a4-0476-4f08-9eb8-4752ad390244`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:48:25,735::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [3b38bf98] >Thread-34::DEBUG::2014-07-24 10:48:25,736::task::595::TaskManager.Task::(_updateState) Task=`b0e26080-0417-4dea-a503-04f48a3899c3`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:48:25,736::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:48:25,736::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`59954c9b-5292-4064-ac7d-7b95281b19f5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:48:25,737::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:48:25,737::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:48:25,737::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`59954c9b-5292-4064-ac7d-7b95281b19f5`::Granted request >Thread-34::DEBUG::2014-07-24 10:48:25,737::task::827::TaskManager.Task::(resourceAcquired) Task=`b0e26080-0417-4dea-a503-04f48a3899c3`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:48:25,738::task::990::TaskManager.Task::(_decref) Task=`b0e26080-0417-4dea-a503-04f48a3899c3`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:48:25,738::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:48:25,738::task::1185::TaskManager.Task::(prepare) Task=`b0e26080-0417-4dea-a503-04f48a3899c3`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:48:25,739::task::595::TaskManager.Task::(_updateState) Task=`b0e26080-0417-4dea-a503-04f48a3899c3`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:48:25,739::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:48:25,739::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:48:25,739::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:48:25,739::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:48:25,739::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:48:25,740::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:48:25,740::task::990::TaskManager.Task::(_decref) Task=`b0e26080-0417-4dea-a503-04f48a3899c3`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:48:26,385::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:48:26,459::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350085 s, 29.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:48:27,156::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-18::DEBUG::2014-07-24 10:48:28,135::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:48:28,144::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000790867 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:48:28,471::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:48:28,545::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342787 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:48:30,557::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:48:30,649::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0500302 s, 20.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:48:32,661::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:48:32,735::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033916 s, 30.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:48:34,747::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:48:34,820::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342763 s, 29.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:48:35,805::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:48:35,819::task::595::TaskManager.Task::(_updateState) Task=`0b351dc5-2e56-4b08-9162-9ae97c5646e3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:48:35,819::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:48:35,819::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:48:35,820::task::1185::TaskManager.Task::(prepare) Task=`0b351dc5-2e56-4b08-9162-9ae97c5646e3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:48:35,820::task::595::TaskManager.Task::(_updateState) Task=`0b351dc5-2e56-4b08-9162-9ae97c5646e3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:48:35,820::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:48:35,820::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:48:35,820::task::990::TaskManager.Task::(_decref) Task=`0b351dc5-2e56-4b08-9162-9ae97c5646e3`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:48:35,852::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:48:35,852::task::595::TaskManager.Task::(_updateState) Task=`c2ef8b4b-dda3-4b2c-bb6c-b449901c5414`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:48:35,852::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:48:35,853::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7f5eced1-eae3-4ee8-9651-28b3f09a0660`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:48:35,853::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:48:35,853::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:48:35,853::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7f5eced1-eae3-4ee8-9651-28b3f09a0660`::Granted request >Thread-34::DEBUG::2014-07-24 10:48:35,854::task::827::TaskManager.Task::(resourceAcquired) Task=`c2ef8b4b-dda3-4b2c-bb6c-b449901c5414`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:48:35,854::task::990::TaskManager.Task::(_decref) Task=`c2ef8b4b-dda3-4b2c-bb6c-b449901c5414`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:48:35,855::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:48:35,855::task::1185::TaskManager.Task::(prepare) Task=`c2ef8b4b-dda3-4b2c-bb6c-b449901c5414`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:48:35,855::task::595::TaskManager.Task::(_updateState) Task=`c2ef8b4b-dda3-4b2c-bb6c-b449901c5414`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:48:35,855::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:48:35,855::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:48:35,856::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:48:35,856::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:48:35,856::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:48:35,856::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:48:35,856::task::990::TaskManager.Task::(_decref) Task=`c2ef8b4b-dda3-4b2c-bb6c-b449901c5414`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:48:35,899::task::595::TaskManager.Task::(_updateState) Task=`9e7c56b9-1bd3-448c-a096-e2af96372d1b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:48:35,899::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:48:35,899::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000790867', 'lastCheck': '7.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:48:35,900::task::1185::TaskManager.Task::(prepare) Task=`9e7c56b9-1bd3-448c-a096-e2af96372d1b`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000790867', 'lastCheck': '7.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:48:35,900::task::595::TaskManager.Task::(_updateState) Task=`9e7c56b9-1bd3-448c-a096-e2af96372d1b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:48:35,900::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:48:35,900::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:48:35,900::task::990::TaskManager.Task::(_decref) Task=`9e7c56b9-1bd3-448c-a096-e2af96372d1b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:48:36,832::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:48:36,908::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035446 s, 28.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:48:38,149::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:48:38,158::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000678803 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:48:38,920::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:48:38,995::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352371 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:48:41,008::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:48:41,084::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036508 s, 28.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:48:43,096::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:48:43,172::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363926 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:48:45,184::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:48:45,260::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348169 s, 29.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:48:45,935::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:48:45,936::task::595::TaskManager.Task::(_updateState) Task=`929a0082-cfd4-492b-b240-17ecdf392beb`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:48:45,936::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:48:45,936::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:48:45,936::task::1185::TaskManager.Task::(prepare) Task=`929a0082-cfd4-492b-b240-17ecdf392beb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:48:45,937::task::595::TaskManager.Task::(_updateState) Task=`929a0082-cfd4-492b-b240-17ecdf392beb`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:48:45,937::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:48:45,937::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:48:45,937::task::990::TaskManager.Task::(_decref) Task=`929a0082-cfd4-492b-b240-17ecdf392beb`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:48:45,970::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:48:45,970::task::595::TaskManager.Task::(_updateState) Task=`ed3a3301-4f7e-4f8d-b9f3-3a1ec5f9602e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:48:45,970::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:48:45,971::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f9192e93-4cc8-4e05-a24e-1b202dd65c8e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:48:45,971::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:48:45,971::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:48:45,971::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f9192e93-4cc8-4e05-a24e-1b202dd65c8e`::Granted request >Thread-34::DEBUG::2014-07-24 10:48:45,972::task::827::TaskManager.Task::(resourceAcquired) Task=`ed3a3301-4f7e-4f8d-b9f3-3a1ec5f9602e`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:48:45,972::task::990::TaskManager.Task::(_decref) Task=`ed3a3301-4f7e-4f8d-b9f3-3a1ec5f9602e`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:48:45,973::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:48:45,973::task::1185::TaskManager.Task::(prepare) Task=`ed3a3301-4f7e-4f8d-b9f3-3a1ec5f9602e`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:48:45,973::task::595::TaskManager.Task::(_updateState) Task=`ed3a3301-4f7e-4f8d-b9f3-3a1ec5f9602e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:48:45,973::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:48:45,973::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:48:45,973::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:48:45,974::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:48:45,974::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:48:45,974::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:48:45,974::task::990::TaskManager.Task::(_decref) Task=`ed3a3301-4f7e-4f8d-b9f3-3a1ec5f9602e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:48:47,272::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:48:47,345::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341904 s, 29.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:48:48,163::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:48:48,172::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000698721 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:48:49,358::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:48:49,433::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362643 s, 28.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:48:51,269::task::595::TaskManager.Task::(_updateState) Task=`ffe657e1-f427-447c-9bfa-e3aba841cb4a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:48:51,270::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:48:51,270::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000698721', 'lastCheck': '3.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:48:51,270::task::1185::TaskManager.Task::(prepare) Task=`ffe657e1-f427-447c-9bfa-e3aba841cb4a`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000698721', 'lastCheck': '3.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:48:51,270::task::595::TaskManager.Task::(_updateState) Task=`ffe657e1-f427-447c-9bfa-e3aba841cb4a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:48:51,270::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:48:51,270::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:48:51,271::task::990::TaskManager.Task::(_decref) Task=`ffe657e1-f427-447c-9bfa-e3aba841cb4a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:48:51,446::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:48:51,520::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354906 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:48:53,533::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:48:53,608::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364454 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:48:55,621::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:48:55,696::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360664 s, 28.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:48:56,040::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:48:56,040::task::595::TaskManager.Task::(_updateState) Task=`a6efde16-d40c-4c7e-b167-4232cd2cd5c0`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:48:56,041::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:48:56,041::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:48:56,041::task::1185::TaskManager.Task::(prepare) Task=`a6efde16-d40c-4c7e-b167-4232cd2cd5c0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:48:56,041::task::595::TaskManager.Task::(_updateState) Task=`a6efde16-d40c-4c7e-b167-4232cd2cd5c0`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:48:56,041::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:48:56,042::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:48:56,042::task::990::TaskManager.Task::(_decref) Task=`a6efde16-d40c-4c7e-b167-4232cd2cd5c0`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:48:56,077::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:48:56,078::task::595::TaskManager.Task::(_updateState) Task=`c2a13617-fc7a-472e-b7d0-a465c048e53c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:48:56,078::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:48:56,078::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`9ad15338-894f-4362-a4c4-aea4fd36bf3d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:48:56,078::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:48:56,079::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:48:56,080::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`9ad15338-894f-4362-a4c4-aea4fd36bf3d`::Granted request >Thread-34::DEBUG::2014-07-24 10:48:56,080::task::827::TaskManager.Task::(resourceAcquired) Task=`c2a13617-fc7a-472e-b7d0-a465c048e53c`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:48:56,080::task::990::TaskManager.Task::(_decref) Task=`c2a13617-fc7a-472e-b7d0-a465c048e53c`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:48:56,081::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:48:56,081::task::1185::TaskManager.Task::(prepare) Task=`c2a13617-fc7a-472e-b7d0-a465c048e53c`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:48:56,081::task::595::TaskManager.Task::(_updateState) Task=`c2a13617-fc7a-472e-b7d0-a465c048e53c`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:48:56,082::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:48:56,082::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:48:56,082::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:48:56,082::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:48:56,082::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:48:56,082::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:48:56,083::task::990::TaskManager.Task::(_decref) Task=`c2a13617-fc7a-472e-b7d0-a465c048e53c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-07-24 10:48:57,192::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:48:57,708::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:48:57,785::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358156 s, 28.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:48:58,177::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:48:58,186::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000672985 s, 6.1 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 10:48:58,640::task::595::TaskManager.Task::(_updateState) Task=`9fe5a766-490d-4d0c-b025-50eacf7b227a`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 10:48:58,641::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 10:48:58,641::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:48:58,641::task::1185::TaskManager.Task::(prepare) Task=`9fe5a766-490d-4d0c-b025-50eacf7b227a`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:48:58,641::task::595::TaskManager.Task::(_updateState) Task=`9fe5a766-490d-4d0c-b025-50eacf7b227a`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 10:48:58,641::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 10:48:58,642::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 10:48:58,642::task::990::TaskManager.Task::(_decref) Task=`9fe5a766-490d-4d0c-b025-50eacf7b227a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:48:59,797::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:48:59,871::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348163 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:49:01,884::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:49:01,958::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355748 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:49:03,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:49:04,046::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367241 s, 27.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:49:06,059::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:49:06,132::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338708 s, 30.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:49:06,150::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:49:06,151::task::595::TaskManager.Task::(_updateState) Task=`3a090774-cdd0-44eb-9704-2dc38ebc2f03`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:49:06,151::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:49:06,151::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:49:06,152::task::1185::TaskManager.Task::(prepare) Task=`3a090774-cdd0-44eb-9704-2dc38ebc2f03`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:49:06,152::task::595::TaskManager.Task::(_updateState) Task=`3a090774-cdd0-44eb-9704-2dc38ebc2f03`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:49:06,152::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:49:06,152::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:49:06,152::task::990::TaskManager.Task::(_decref) Task=`3a090774-cdd0-44eb-9704-2dc38ebc2f03`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:49:06,196::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:49:06,197::task::595::TaskManager.Task::(_updateState) Task=`b9f1c98f-232a-45f0-8941-10e4a4786e70`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:49:06,197::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:49:06,197::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`96110996-0daa-4102-8fca-10251a7c26fe`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:49:06,197::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:49:06,198::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:49:06,198::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`96110996-0daa-4102-8fca-10251a7c26fe`::Granted request >Thread-34::DEBUG::2014-07-24 10:49:06,198::task::827::TaskManager.Task::(resourceAcquired) Task=`b9f1c98f-232a-45f0-8941-10e4a4786e70`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:49:06,198::task::990::TaskManager.Task::(_decref) Task=`b9f1c98f-232a-45f0-8941-10e4a4786e70`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:49:06,199::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:49:06,199::task::1185::TaskManager.Task::(prepare) Task=`b9f1c98f-232a-45f0-8941-10e4a4786e70`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:49:06,199::task::595::TaskManager.Task::(_updateState) Task=`b9f1c98f-232a-45f0-8941-10e4a4786e70`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:49:06,200::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:49:06,200::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:49:06,200::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:49:06,200::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:49:06,200::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:49:06,200::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:49:06,201::task::990::TaskManager.Task::(_decref) Task=`b9f1c98f-232a-45f0-8941-10e4a4786e70`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:49:06,692::task::595::TaskManager.Task::(_updateState) Task=`1a16a01b-4048-4e82-a8e8-1cbe021d551c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:49:06,692::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:49:06,692::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000672985', 'lastCheck': '8.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:49:06,693::task::1185::TaskManager.Task::(prepare) Task=`1a16a01b-4048-4e82-a8e8-1cbe021d551c`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000672985', 'lastCheck': '8.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:49:06,693::task::595::TaskManager.Task::(_updateState) Task=`1a16a01b-4048-4e82-a8e8-1cbe021d551c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:49:06,693::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:49:06,693::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:49:06,693::task::990::TaskManager.Task::(_decref) Task=`1a16a01b-4048-4e82-a8e8-1cbe021d551c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:49:08,144::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-24 10:49:08,194::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:49:08,213::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000650147 s, 6.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:49:08,274::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361336 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:49:10,285::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:49:10,361::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360546 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:49:12,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:49:12,447::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348498 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:49:14,459::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:49:14,535::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363483 s, 28.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:49:16,263::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:49:16,264::task::595::TaskManager.Task::(_updateState) Task=`3675d279-8c4f-4945-88fe-0724120d184b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:49:16,264::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:49:16,265::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:49:16,265::task::1185::TaskManager.Task::(prepare) Task=`3675d279-8c4f-4945-88fe-0724120d184b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:49:16,265::task::595::TaskManager.Task::(_updateState) Task=`3675d279-8c4f-4945-88fe-0724120d184b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:49:16,265::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:49:16,265::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:49:16,265::task::990::TaskManager.Task::(_decref) Task=`3675d279-8c4f-4945-88fe-0724120d184b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:49:16,327::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:49:16,328::task::595::TaskManager.Task::(_updateState) Task=`9c43c4a2-a7c8-4fa3-adf3-f4f6a1d5028d`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:49:16,328::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:49:16,328::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`0f8f04f6-9be5-4ef0-8628-3ae6acb5e5b5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:49:16,329::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:49:16,329::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:49:16,329::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`0f8f04f6-9be5-4ef0-8628-3ae6acb5e5b5`::Granted request >Thread-34::DEBUG::2014-07-24 10:49:16,329::task::827::TaskManager.Task::(resourceAcquired) Task=`9c43c4a2-a7c8-4fa3-adf3-f4f6a1d5028d`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:49:16,329::task::990::TaskManager.Task::(_decref) Task=`9c43c4a2-a7c8-4fa3-adf3-f4f6a1d5028d`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:49:16,330::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:49:16,330::task::1185::TaskManager.Task::(prepare) Task=`9c43c4a2-a7c8-4fa3-adf3-f4f6a1d5028d`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:49:16,331::task::595::TaskManager.Task::(_updateState) Task=`9c43c4a2-a7c8-4fa3-adf3-f4f6a1d5028d`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:49:16,331::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:49:16,331::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:49:16,331::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:49:16,331::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:49:16,331::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:49:16,332::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:49:16,332::task::990::TaskManager.Task::(_decref) Task=`9c43c4a2-a7c8-4fa3-adf3-f4f6a1d5028d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:49:16,547::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:49:16,626::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0388729 s, 26.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:49:18,246::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:49:18,256::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000722533 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:49:18,639::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:49:18,714::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359605 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:49:20,727::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:49:20,799::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338208 s, 30.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:49:22,070::task::595::TaskManager.Task::(_updateState) Task=`065a5315-2cb7-44c4-a948-3d9de3d6e004`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:49:22,070::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:49:22,071::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000722533', 'lastCheck': '3.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:49:22,071::task::1185::TaskManager.Task::(prepare) Task=`065a5315-2cb7-44c4-a948-3d9de3d6e004`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000722533', 'lastCheck': '3.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:49:22,071::task::595::TaskManager.Task::(_updateState) Task=`065a5315-2cb7-44c4-a948-3d9de3d6e004`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:49:22,071::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:49:22,071::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:49:22,071::task::990::TaskManager.Task::(_decref) Task=`065a5315-2cb7-44c4-a948-3d9de3d6e004`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:49:22,811::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:49:22,885::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346267 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:49:24,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:49:24,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345644 s, 29.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:49:26,397::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:49:26,397::task::595::TaskManager.Task::(_updateState) Task=`ba067c35-c56d-4b79-b69d-254c479cf1e6`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:49:26,397::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:49:26,398::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:49:26,398::task::1185::TaskManager.Task::(prepare) Task=`ba067c35-c56d-4b79-b69d-254c479cf1e6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:49:26,398::task::595::TaskManager.Task::(_updateState) Task=`ba067c35-c56d-4b79-b69d-254c479cf1e6`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:49:26,398::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:49:26,398::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:49:26,399::task::990::TaskManager.Task::(_decref) Task=`ba067c35-c56d-4b79-b69d-254c479cf1e6`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:49:26,430::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:49:26,430::task::595::TaskManager.Task::(_updateState) Task=`0d07ef35-175d-4bda-85e0-1bcfc18e5292`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:49:26,431::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:49:26,431::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ad162831-9742-4f48-9def-ff9d4550eaee`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:49:26,431::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:49:26,432::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:49:26,432::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ad162831-9742-4f48-9def-ff9d4550eaee`::Granted request >Thread-34::DEBUG::2014-07-24 10:49:26,432::task::827::TaskManager.Task::(resourceAcquired) Task=`0d07ef35-175d-4bda-85e0-1bcfc18e5292`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:49:26,432::task::990::TaskManager.Task::(_decref) Task=`0d07ef35-175d-4bda-85e0-1bcfc18e5292`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:49:26,433::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:49:26,433::task::1185::TaskManager.Task::(prepare) Task=`0d07ef35-175d-4bda-85e0-1bcfc18e5292`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:49:26,433::task::595::TaskManager.Task::(_updateState) Task=`0d07ef35-175d-4bda-85e0-1bcfc18e5292`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:49:26,433::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:49:26,434::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:49:26,434::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:49:26,434::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:49:26,434::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:49:26,434::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:49:26,435::task::990::TaskManager.Task::(_decref) Task=`0d07ef35-175d-4bda-85e0-1bcfc18e5292`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:49:26,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:49:27,057::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347512 s, 29.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:49:27,229::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-18::DEBUG::2014-07-24 10:49:28,260::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:49:28,270::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000953252 s, 4.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:49:29,070::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:49:29,145::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361805 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:49:31,157::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:49:31,238::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0400853 s, 25.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:49:33,257::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:49:33,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0395513 s, 25.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:49:35,348::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:49:35,421::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336988 s, 30.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:49:36,503::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:49:36,504::task::595::TaskManager.Task::(_updateState) Task=`dfb77c04-79fd-4c05-a76a-79d494033b55`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:49:36,504::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:49:36,504::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:49:36,505::task::1185::TaskManager.Task::(prepare) Task=`dfb77c04-79fd-4c05-a76a-79d494033b55`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:49:36,505::task::595::TaskManager.Task::(_updateState) Task=`dfb77c04-79fd-4c05-a76a-79d494033b55`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:49:36,505::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:49:36,505::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:49:36,505::task::990::TaskManager.Task::(_decref) Task=`dfb77c04-79fd-4c05-a76a-79d494033b55`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:49:36,537::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:49:36,538::task::595::TaskManager.Task::(_updateState) Task=`d0ff31bc-9515-4263-849e-5b0420b2382b`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:49:36,538::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:49:36,538::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`5d9a9539-4278-4449-9f2c-866913b7fcda`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:49:36,539::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:49:36,539::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:49:36,539::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`5d9a9539-4278-4449-9f2c-866913b7fcda`::Granted request >Thread-34::DEBUG::2014-07-24 10:49:36,539::task::827::TaskManager.Task::(resourceAcquired) Task=`d0ff31bc-9515-4263-849e-5b0420b2382b`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:49:36,540::task::990::TaskManager.Task::(_decref) Task=`d0ff31bc-9515-4263-849e-5b0420b2382b`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:49:36,540::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:49:36,540::task::1185::TaskManager.Task::(prepare) Task=`d0ff31bc-9515-4263-849e-5b0420b2382b`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:49:36,541::task::595::TaskManager.Task::(_updateState) Task=`d0ff31bc-9515-4263-849e-5b0420b2382b`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:49:36,541::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:49:36,541::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:49:36,541::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:49:36,541::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:49:36,541::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:49:36,542::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:49:36,542::task::990::TaskManager.Task::(_decref) Task=`d0ff31bc-9515-4263-849e-5b0420b2382b`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:49:37,419::task::595::TaskManager.Task::(_updateState) Task=`29c5a369-533d-4c37-8552-b569a7a8ce2b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:49:37,419::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:49:37,419::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000953252', 'lastCheck': '9.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:49:37,419::task::1185::TaskManager.Task::(prepare) Task=`29c5a369-533d-4c37-8552-b569a7a8ce2b`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000953252', 'lastCheck': '9.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:49:37,419::task::595::TaskManager.Task::(_updateState) Task=`29c5a369-533d-4c37-8552-b569a7a8ce2b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:49:37,420::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:49:37,420::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:49:37,420::task::990::TaskManager.Task::(_decref) Task=`29c5a369-533d-4c37-8552-b569a7a8ce2b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:49:37,434::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:49:37,506::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334012 s, 30.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:49:38,275::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:49:38,284::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000729525 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:49:39,518::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:49:39,592::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344872 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:49:41,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:49:41,678::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344386 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:49:43,691::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:49:43,766::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358107 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:49:45,778::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:49:45,851::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341758 s, 30.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:49:46,599::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:49:46,600::task::595::TaskManager.Task::(_updateState) Task=`e38b57c9-424c-4035-8457-deee1331363e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:49:46,600::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:49:46,601::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:49:46,601::task::1185::TaskManager.Task::(prepare) Task=`e38b57c9-424c-4035-8457-deee1331363e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:49:46,601::task::595::TaskManager.Task::(_updateState) Task=`e38b57c9-424c-4035-8457-deee1331363e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:49:46,601::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:49:46,601::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:49:46,602::task::990::TaskManager.Task::(_decref) Task=`e38b57c9-424c-4035-8457-deee1331363e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:49:46,635::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:49:46,636::task::595::TaskManager.Task::(_updateState) Task=`1b71dc6b-5e51-4f79-851f-f6678e9c5c07`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:49:46,636::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:49:46,636::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`523b8d83-4da3-44b5-aa0f-75d8ef3ad34d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:49:46,636::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:49:46,637::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:49:46,637::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`523b8d83-4da3-44b5-aa0f-75d8ef3ad34d`::Granted request >Thread-34::DEBUG::2014-07-24 10:49:46,637::task::827::TaskManager.Task::(resourceAcquired) Task=`1b71dc6b-5e51-4f79-851f-f6678e9c5c07`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:49:46,637::task::990::TaskManager.Task::(_decref) Task=`1b71dc6b-5e51-4f79-851f-f6678e9c5c07`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:49:46,638::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:49:46,638::task::1185::TaskManager.Task::(prepare) Task=`1b71dc6b-5e51-4f79-851f-f6678e9c5c07`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:49:46,638::task::595::TaskManager.Task::(_updateState) Task=`1b71dc6b-5e51-4f79-851f-f6678e9c5c07`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:49:46,638::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:49:46,639::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:49:46,639::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:49:46,639::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:49:46,639::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:49:46,639::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:49:46,640::task::990::TaskManager.Task::(_decref) Task=`1b71dc6b-5e51-4f79-851f-f6678e9c5c07`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:49:47,864::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:49:47,937::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338154 s, 30.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:49:48,289::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:49:48,298::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000698872 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:49:49,950::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:49:50,025::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356521 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:49:52,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:49:52,112::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035225 s, 29.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:49:52,785::task::595::TaskManager.Task::(_updateState) Task=`3fd012f1-b3cc-4c8d-9af8-14a5e5db6999`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:49:52,785::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:49:52,785::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000698872', 'lastCheck': '4.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:49:52,785::task::1185::TaskManager.Task::(prepare) Task=`3fd012f1-b3cc-4c8d-9af8-14a5e5db6999`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000698872', 'lastCheck': '4.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:49:52,785::task::595::TaskManager.Task::(_updateState) Task=`3fd012f1-b3cc-4c8d-9af8-14a5e5db6999`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:49:52,785::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:49:52,786::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:49:52,786::task::990::TaskManager.Task::(_decref) Task=`3fd012f1-b3cc-4c8d-9af8-14a5e5db6999`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:49:54,124::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:49:54,199::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360707 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:49:56,212::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:49:56,285::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335009 s, 30.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:49:56,704::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:49:56,705::task::595::TaskManager.Task::(_updateState) Task=`33282ef3-248d-4d6c-834b-741b90eba0de`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:49:56,705::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:49:56,706::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:49:56,706::task::1185::TaskManager.Task::(prepare) Task=`33282ef3-248d-4d6c-834b-741b90eba0de`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:49:56,706::task::595::TaskManager.Task::(_updateState) Task=`33282ef3-248d-4d6c-834b-741b90eba0de`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:49:56,706::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:49:56,706::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:49:56,706::task::990::TaskManager.Task::(_decref) Task=`33282ef3-248d-4d6c-834b-741b90eba0de`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:49:56,741::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:49:56,741::task::595::TaskManager.Task::(_updateState) Task=`4f7f5ef7-f55b-49f3-9f69-426cde59b77c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:49:56,741::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:49:56,742::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`14605092-1cf5-443c-a52e-d49880e195bd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:49:56,742::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:49:56,742::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:49:56,742::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`14605092-1cf5-443c-a52e-d49880e195bd`::Granted request >Thread-34::DEBUG::2014-07-24 10:49:56,743::task::827::TaskManager.Task::(resourceAcquired) Task=`4f7f5ef7-f55b-49f3-9f69-426cde59b77c`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:49:56,743::task::990::TaskManager.Task::(_decref) Task=`4f7f5ef7-f55b-49f3-9f69-426cde59b77c`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:49:56,744::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:49:56,744::task::1185::TaskManager.Task::(prepare) Task=`4f7f5ef7-f55b-49f3-9f69-426cde59b77c`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:49:56,744::task::595::TaskManager.Task::(_updateState) Task=`4f7f5ef7-f55b-49f3-9f69-426cde59b77c`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:49:56,744::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:49:56,744::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:49:56,744::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:49:56,745::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:49:56,745::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:49:56,745::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:49:56,745::task::990::TaskManager.Task::(_decref) Task=`4f7f5ef7-f55b-49f3-9f69-426cde59b77c`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-07-24 10:49:57,264::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:49:58,297::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-24 10:49:58,307::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:49:58,323::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00066787 s, 6.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:49:58,407::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0709293 s, 14.4 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 10:49:58,826::task::595::TaskManager.Task::(_updateState) Task=`556c78b3-2453-499a-a353-172ce86788a2`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 10:49:58,826::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 10:49:58,826::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:49:58,826::task::1185::TaskManager.Task::(prepare) Task=`556c78b3-2453-499a-a353-172ce86788a2`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:49:58,827::task::595::TaskManager.Task::(_updateState) Task=`556c78b3-2453-499a-a353-172ce86788a2`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 10:49:58,827::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 10:49:58,827::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 10:49:58,827::task::990::TaskManager.Task::(_decref) Task=`556c78b3-2453-499a-a353-172ce86788a2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:50:00,419::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:50:00,496::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363787 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:50:02,508::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:50:02,582::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341646 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:50:04,594::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:50:04,669::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350259 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:50:06,682::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:50:06,759::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365699 s, 28.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:50:06,806::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [1487b3f5] >Thread-14::DEBUG::2014-07-24 10:50:06,806::task::595::TaskManager.Task::(_updateState) Task=`c7d78a55-461f-4a90-9aaf-e426b16eb809`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:50:06,807::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:50:06,807::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:50:06,807::task::1185::TaskManager.Task::(prepare) Task=`c7d78a55-461f-4a90-9aaf-e426b16eb809`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:50:06,807::task::595::TaskManager.Task::(_updateState) Task=`c7d78a55-461f-4a90-9aaf-e426b16eb809`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:50:06,807::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:50:06,808::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:50:06,808::task::990::TaskManager.Task::(_decref) Task=`c7d78a55-461f-4a90-9aaf-e426b16eb809`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:50:06,839::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [1487b3f5] >Thread-34::DEBUG::2014-07-24 10:50:06,839::task::595::TaskManager.Task::(_updateState) Task=`ed9d9d4a-44df-45fd-a3ce-ce96fb2dae89`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:50:06,839::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:50:06,840::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7e3a7fb4-0e24-426d-bc09-7bdbde59de24`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:50:06,840::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:50:06,840::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:50:06,840::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7e3a7fb4-0e24-426d-bc09-7bdbde59de24`::Granted request >Thread-34::DEBUG::2014-07-24 10:50:06,842::task::827::TaskManager.Task::(resourceAcquired) Task=`ed9d9d4a-44df-45fd-a3ce-ce96fb2dae89`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:50:06,842::task::990::TaskManager.Task::(_decref) Task=`ed9d9d4a-44df-45fd-a3ce-ce96fb2dae89`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:50:06,843::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:50:06,843::task::1185::TaskManager.Task::(prepare) Task=`ed9d9d4a-44df-45fd-a3ce-ce96fb2dae89`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:50:06,843::task::595::TaskManager.Task::(_updateState) Task=`ed9d9d4a-44df-45fd-a3ce-ce96fb2dae89`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:50:06,843::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:50:06,843::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:50:06,843::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:50:06,844::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:50:06,844::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:50:06,844::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:50:06,844::task::990::TaskManager.Task::(_decref) Task=`ed9d9d4a-44df-45fd-a3ce-ce96fb2dae89`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:50:08,169::task::595::TaskManager.Task::(_updateState) Task=`0b29eb2c-54c1-4a65-b5f6-59489712fc01`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:50:08,169::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:50:08,169::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066787', 'lastCheck': '9.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:50:08,169::task::1185::TaskManager.Task::(prepare) Task=`0b29eb2c-54c1-4a65-b5f6-59489712fc01`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066787', 'lastCheck': '9.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:50:08,169::task::595::TaskManager.Task::(_updateState) Task=`0b29eb2c-54c1-4a65-b5f6-59489712fc01`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:50:08,170::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:50:08,170::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:50:08,170::task::990::TaskManager.Task::(_decref) Task=`0b29eb2c-54c1-4a65-b5f6-59489712fc01`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 10:50:08,355::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:50:08,381::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0173255 s, 236 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:50:08,772::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:50:08,845::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334772 s, 30.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:50:10,857::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:50:10,931::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351039 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:50:12,943::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:50:13,017::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345186 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:50:15,030::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:50:15,103::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336093 s, 30.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:50:16,903::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:50:16,903::task::595::TaskManager.Task::(_updateState) Task=`6389f96c-70d7-4eef-a773-39fbcc60b457`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:50:16,903::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:50:16,904::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:50:16,904::task::1185::TaskManager.Task::(prepare) Task=`6389f96c-70d7-4eef-a773-39fbcc60b457`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:50:16,904::task::595::TaskManager.Task::(_updateState) Task=`6389f96c-70d7-4eef-a773-39fbcc60b457`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:50:16,904::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:50:16,905::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:50:16,905::task::990::TaskManager.Task::(_decref) Task=`6389f96c-70d7-4eef-a773-39fbcc60b457`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:50:16,937::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:50:16,938::task::595::TaskManager.Task::(_updateState) Task=`3acf38ba-cc2d-446b-9c37-d8ecd767b988`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:50:16,938::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:50:16,938::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ad78734b-97e6-4a15-92ff-ff4b31798292`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:50:16,938::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:50:16,939::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:50:16,939::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ad78734b-97e6-4a15-92ff-ff4b31798292`::Granted request >Thread-34::DEBUG::2014-07-24 10:50:16,939::task::827::TaskManager.Task::(resourceAcquired) Task=`3acf38ba-cc2d-446b-9c37-d8ecd767b988`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:50:16,939::task::990::TaskManager.Task::(_decref) Task=`3acf38ba-cc2d-446b-9c37-d8ecd767b988`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:50:16,940::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:50:16,940::task::1185::TaskManager.Task::(prepare) Task=`3acf38ba-cc2d-446b-9c37-d8ecd767b988`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:50:16,940::task::595::TaskManager.Task::(_updateState) Task=`3acf38ba-cc2d-446b-9c37-d8ecd767b988`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:50:16,941::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:50:16,941::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:50:16,941::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:50:16,941::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:50:16,941::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:50:16,941::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:50:16,942::task::990::TaskManager.Task::(_decref) Task=`3acf38ba-cc2d-446b-9c37-d8ecd767b988`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:50:17,115::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:50:17,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369444 s, 27.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:50:18,386::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:50:18,395::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000706444 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:50:19,204::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:50:19,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343022 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:50:21,290::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:50:21,386::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0569213 s, 18.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:50:23,398::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:50:23,473::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360366 s, 28.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:50:23,594::task::595::TaskManager.Task::(_updateState) Task=`30215905-19d3-4566-8b56-660584ff5759`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:50:23,595::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:50:23,595::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000706444', 'lastCheck': '5.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:50:23,595::task::1185::TaskManager.Task::(prepare) Task=`30215905-19d3-4566-8b56-660584ff5759`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000706444', 'lastCheck': '5.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:50:23,595::task::595::TaskManager.Task::(_updateState) Task=`30215905-19d3-4566-8b56-660584ff5759`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:50:23,595::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:50:23,595::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:50:23,596::task::990::TaskManager.Task::(_decref) Task=`30215905-19d3-4566-8b56-660584ff5759`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:50:25,486::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:50:25,561::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352338 s, 29.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:50:27,004::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:50:27,005::task::595::TaskManager.Task::(_updateState) Task=`16170d1b-cd11-4403-a88d-f646bf3db642`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:50:27,005::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:50:27,005::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:50:27,005::task::1185::TaskManager.Task::(prepare) Task=`16170d1b-cd11-4403-a88d-f646bf3db642`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:50:27,006::task::595::TaskManager.Task::(_updateState) Task=`16170d1b-cd11-4403-a88d-f646bf3db642`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:50:27,006::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:50:27,006::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:50:27,006::task::990::TaskManager.Task::(_decref) Task=`16170d1b-cd11-4403-a88d-f646bf3db642`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:50:27,038::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:50:27,038::task::595::TaskManager.Task::(_updateState) Task=`e0c7804e-d8f5-41b6-a55f-6a25fa7ec39f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:50:27,038::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:50:27,039::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`5ada7b0d-a362-4d14-a9fd-79a494b0dbc3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:50:27,039::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:50:27,039::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:50:27,039::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`5ada7b0d-a362-4d14-a9fd-79a494b0dbc3`::Granted request >Thread-34::DEBUG::2014-07-24 10:50:27,040::task::827::TaskManager.Task::(resourceAcquired) Task=`e0c7804e-d8f5-41b6-a55f-6a25fa7ec39f`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:50:27,040::task::990::TaskManager.Task::(_decref) Task=`e0c7804e-d8f5-41b6-a55f-6a25fa7ec39f`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:50:27,040::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:50:27,041::task::1185::TaskManager.Task::(prepare) Task=`e0c7804e-d8f5-41b6-a55f-6a25fa7ec39f`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:50:27,041::task::595::TaskManager.Task::(_updateState) Task=`e0c7804e-d8f5-41b6-a55f-6a25fa7ec39f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:50:27,041::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:50:27,041::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:50:27,041::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:50:27,042::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:50:27,042::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:50:27,042::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:50:27,042::task::990::TaskManager.Task::(_decref) Task=`e0c7804e-d8f5-41b6-a55f-6a25fa7ec39f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-07-24 10:50:27,304::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:50:27,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:50:27,648::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352427 s, 29.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:50:28,400::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:50:28,423::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0146451 s, 280 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:50:29,660::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:50:29,736::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364492 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:50:31,748::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:50:31,824::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349531 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:50:33,836::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:50:33,910::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339569 s, 30.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:50:35,922::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:50:35,996::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341188 s, 30.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:50:37,098::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:50:37,098::task::595::TaskManager.Task::(_updateState) Task=`0b013d00-7fca-42e2-b678-61ce5fd086a1`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:50:37,099::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:50:37,099::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:50:37,099::task::1185::TaskManager.Task::(prepare) Task=`0b013d00-7fca-42e2-b678-61ce5fd086a1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:50:37,099::task::595::TaskManager.Task::(_updateState) Task=`0b013d00-7fca-42e2-b678-61ce5fd086a1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:50:37,100::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:50:37,100::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:50:37,100::task::990::TaskManager.Task::(_decref) Task=`0b013d00-7fca-42e2-b678-61ce5fd086a1`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:50:37,131::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:50:37,132::task::595::TaskManager.Task::(_updateState) Task=`6f9efdef-8610-4dc9-8889-8a722228fab2`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:50:37,132::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:50:37,132::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`5a96c7b1-00f1-4200-883c-32ec20d7be52`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:50:37,133::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:50:37,133::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:50:37,133::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`5a96c7b1-00f1-4200-883c-32ec20d7be52`::Granted request >Thread-34::DEBUG::2014-07-24 10:50:37,133::task::827::TaskManager.Task::(resourceAcquired) Task=`6f9efdef-8610-4dc9-8889-8a722228fab2`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:50:37,133::task::990::TaskManager.Task::(_decref) Task=`6f9efdef-8610-4dc9-8889-8a722228fab2`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:50:37,134::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:50:37,134::task::1185::TaskManager.Task::(prepare) Task=`6f9efdef-8610-4dc9-8889-8a722228fab2`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:50:37,135::task::595::TaskManager.Task::(_updateState) Task=`6f9efdef-8610-4dc9-8889-8a722228fab2`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:50:37,135::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:50:37,135::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:50:37,135::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:50:37,135::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:50:37,135::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:50:37,136::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:50:37,136::task::990::TaskManager.Task::(_decref) Task=`6f9efdef-8610-4dc9-8889-8a722228fab2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:50:38,009::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:50:38,084::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352813 s, 29.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:50:38,428::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:50:38,437::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000632875 s, 6.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:50:38,947::task::595::TaskManager.Task::(_updateState) Task=`d67f7a24-a173-44d0-bc94-623d2fc6828f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:50:38,947::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:50:38,948::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000632875', 'lastCheck': '0.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:50:38,948::task::1185::TaskManager.Task::(prepare) Task=`d67f7a24-a173-44d0-bc94-623d2fc6828f`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000632875', 'lastCheck': '0.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:50:38,948::task::595::TaskManager.Task::(_updateState) Task=`d67f7a24-a173-44d0-bc94-623d2fc6828f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:50:38,948::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:50:38,948::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:50:38,948::task::990::TaskManager.Task::(_decref) Task=`d67f7a24-a173-44d0-bc94-623d2fc6828f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:50:40,096::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:50:40,171::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356992 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:50:42,183::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:50:42,259::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350956 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:50:44,271::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:50:44,346::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361156 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:50:46,359::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:50:46,434::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361332 s, 28.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:50:47,195::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:50:47,195::task::595::TaskManager.Task::(_updateState) Task=`9acf5dda-18b5-4a75-a2e0-f53b232b9ef2`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:50:47,196::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:50:47,196::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:50:47,196::task::1185::TaskManager.Task::(prepare) Task=`9acf5dda-18b5-4a75-a2e0-f53b232b9ef2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:50:47,196::task::595::TaskManager.Task::(_updateState) Task=`9acf5dda-18b5-4a75-a2e0-f53b232b9ef2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:50:47,197::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:50:47,197::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:50:47,197::task::990::TaskManager.Task::(_decref) Task=`9acf5dda-18b5-4a75-a2e0-f53b232b9ef2`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:50:47,537::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:50:47,537::task::595::TaskManager.Task::(_updateState) Task=`94b259dc-c1be-4a0e-ad19-0ca468ba3fda`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:50:47,537::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:50:47,538::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b7ee51ce-629b-4092-9b60-65f5284ca81d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:50:47,538::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:50:47,538::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:50:47,538::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b7ee51ce-629b-4092-9b60-65f5284ca81d`::Granted request >Thread-34::DEBUG::2014-07-24 10:50:47,539::task::827::TaskManager.Task::(resourceAcquired) Task=`94b259dc-c1be-4a0e-ad19-0ca468ba3fda`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:50:47,539::task::990::TaskManager.Task::(_decref) Task=`94b259dc-c1be-4a0e-ad19-0ca468ba3fda`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:50:47,540::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:50:47,540::task::1185::TaskManager.Task::(prepare) Task=`94b259dc-c1be-4a0e-ad19-0ca468ba3fda`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:50:47,540::task::595::TaskManager.Task::(_updateState) Task=`94b259dc-c1be-4a0e-ad19-0ca468ba3fda`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:50:47,540::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:50:47,540::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:50:47,541::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:50:47,541::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:50:47,541::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:50:47,541::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:50:47,541::task::990::TaskManager.Task::(_decref) Task=`94b259dc-c1be-4a0e-ad19-0ca468ba3fda`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 10:50:48,441::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:50:48,453::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-24 10:50:48,465::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000579281 s, 7.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:50:48,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033534 s, 30.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:50:50,539::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:50:50,611::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333579 s, 30.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:50:52,624::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:50:52,700::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364501 s, 28.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:50:54,358::task::595::TaskManager.Task::(_updateState) Task=`bb64d771-9960-49dc-ba71-61a8793429b5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:50:54,358::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:50:54,358::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000579281', 'lastCheck': '5.9', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:50:54,358::task::1185::TaskManager.Task::(prepare) Task=`bb64d771-9960-49dc-ba71-61a8793429b5`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000579281', 'lastCheck': '5.9', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:50:54,358::task::595::TaskManager.Task::(_updateState) Task=`bb64d771-9960-49dc-ba71-61a8793429b5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:50:54,359::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:50:54,359::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:50:54,359::task::990::TaskManager.Task::(_decref) Task=`bb64d771-9960-49dc-ba71-61a8793429b5`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:50:54,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:50:54,788::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349845 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:50:56,800::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:50:56,874::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346151 s, 29.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:50:57,341::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-14::DEBUG::2014-07-24 10:50:57,616::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:50:57,616::task::595::TaskManager.Task::(_updateState) Task=`5d61baf6-e95c-4caa-94f4-c1679c914d79`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:50:57,617::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:50:57,617::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:50:57,617::task::1185::TaskManager.Task::(prepare) Task=`5d61baf6-e95c-4caa-94f4-c1679c914d79`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:50:57,617::task::595::TaskManager.Task::(_updateState) Task=`5d61baf6-e95c-4caa-94f4-c1679c914d79`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:50:57,617::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:50:57,618::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:50:57,618::task::990::TaskManager.Task::(_decref) Task=`5d61baf6-e95c-4caa-94f4-c1679c914d79`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:50:57,676::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:50:57,676::task::595::TaskManager.Task::(_updateState) Task=`7885b8f7-4c9a-4c6d-91de-769f0209790c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:50:57,677::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:50:57,677::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`5fd543e0-1b7e-4096-ae7e-f814f37faac2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:50:57,677::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:50:57,677::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:50:57,678::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`5fd543e0-1b7e-4096-ae7e-f814f37faac2`::Granted request >Thread-34::DEBUG::2014-07-24 10:50:57,678::task::827::TaskManager.Task::(resourceAcquired) Task=`7885b8f7-4c9a-4c6d-91de-769f0209790c`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:50:57,678::task::990::TaskManager.Task::(_decref) Task=`7885b8f7-4c9a-4c6d-91de-769f0209790c`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:50:57,679::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:50:57,679::task::1185::TaskManager.Task::(prepare) Task=`7885b8f7-4c9a-4c6d-91de-769f0209790c`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:50:57,679::task::595::TaskManager.Task::(_updateState) Task=`7885b8f7-4c9a-4c6d-91de-769f0209790c`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:50:57,679::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:50:57,680::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:50:57,680::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:50:57,680::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:50:57,680::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:50:57,680::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:50:57,681::task::990::TaskManager.Task::(_decref) Task=`7885b8f7-4c9a-4c6d-91de-769f0209790c`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 10:50:58,469::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:50:58,478::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000792174 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:50:58,886::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:50:58,960::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342811 s, 29.9 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 10:50:58,980::task::595::TaskManager.Task::(_updateState) Task=`4d1492d0-479c-4bb9-988c-df8edc8a25bd`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 10:50:58,980::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 10:50:58,980::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:50:58,980::task::1185::TaskManager.Task::(prepare) Task=`4d1492d0-479c-4bb9-988c-df8edc8a25bd`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:50:58,981::task::595::TaskManager.Task::(_updateState) Task=`4d1492d0-479c-4bb9-988c-df8edc8a25bd`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 10:50:58,981::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 10:50:58,981::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 10:50:58,981::task::990::TaskManager.Task::(_decref) Task=`4d1492d0-479c-4bb9-988c-df8edc8a25bd`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:51:00,972::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:51:01,048::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357839 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:51:03,060::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:51:03,418::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.318084 s, 3.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:51:05,430::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:51:05,528::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0575816 s, 17.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:51:07,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:51:07,619::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348685 s, 29.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:51:07,742::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:51:07,742::task::595::TaskManager.Task::(_updateState) Task=`08923346-bc10-48fe-996e-39e4c372c5e6`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:51:07,743::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:51:07,743::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:51:07,743::task::1185::TaskManager.Task::(prepare) Task=`08923346-bc10-48fe-996e-39e4c372c5e6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:51:07,743::task::595::TaskManager.Task::(_updateState) Task=`08923346-bc10-48fe-996e-39e4c372c5e6`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:51:07,743::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:51:07,744::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:51:07,744::task::990::TaskManager.Task::(_decref) Task=`08923346-bc10-48fe-996e-39e4c372c5e6`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:51:07,798::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:51:07,798::task::595::TaskManager.Task::(_updateState) Task=`850947c1-2e87-475f-a73b-82244af67def`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:51:07,799::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:51:07,799::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`539fad7a-ff13-42d0-8662-7d5a40015f74`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:51:07,799::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:51:07,799::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:51:07,800::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`539fad7a-ff13-42d0-8662-7d5a40015f74`::Granted request >Thread-34::DEBUG::2014-07-24 10:51:07,800::task::827::TaskManager.Task::(resourceAcquired) Task=`850947c1-2e87-475f-a73b-82244af67def`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:51:07,800::task::990::TaskManager.Task::(_decref) Task=`850947c1-2e87-475f-a73b-82244af67def`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:51:07,801::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:51:07,801::task::1185::TaskManager.Task::(prepare) Task=`850947c1-2e87-475f-a73b-82244af67def`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:51:07,801::task::595::TaskManager.Task::(_updateState) Task=`850947c1-2e87-475f-a73b-82244af67def`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:51:07,801::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:51:07,801::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:51:07,802::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:51:07,802::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:51:07,802::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:51:07,802::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:51:07,802::task::990::TaskManager.Task::(_decref) Task=`850947c1-2e87-475f-a73b-82244af67def`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 10:51:08,483::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 23aa0606-edc3-4882-a4aa-18aa1983458f >Thread-18::DEBUG::2014-07-24 10:51:08,483::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-18::DEBUG::2014-07-24 10:51:08,491::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:51:08,500::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000635358 s, 3.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:51:08,500::misc::264::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000635358 s, 3.2 MB/s'], size: 2048 >Thread-18::DEBUG::2014-07-24 10:51:08,501::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-18::WARNING::2014-07-24 10:51:08,501::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-18::DEBUG::2014-07-24 10:51:08,501::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-18::DEBUG::2014-07-24 10:51:08,501::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 10:51:08,502::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 10:51:08,502::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 10:51:08,502::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 10:51:08,502::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 10:51:08,503::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-18::DEBUG::2014-07-24 10:51:08,753::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:51:08,755::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 10:51:08,755::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'LOCKPOLICY=', 'POOL_DOMAINS=23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'POOL_DESCRIPTION=DS1', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_UUID=637ea13c-81a8-4b44-8cab-961458b01883', 'POOL_SPM_ID=1', '_SHA_CKSUM=a749afdc7119a2d6aad840af5c63c9b28c0b612c', 'POOL_SPM_LVER=0'] >Thread-18::INFO::2014-07-24 10:51:08,756::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_imageNS already registered >Thread-18::INFO::2014-07-24 10:51:08,757::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_volumeNS already registered >Thread-18::INFO::2014-07-24 10:51:08,757::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_lvmActivationNS already registered >Thread-18::DEBUG::2014-07-24 10:51:08,757::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-18::DEBUG::2014-07-24 10:51:08,912::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:51:08,912::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:51:08,922::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000656556 s, 6.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:51:09,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:51:09,707::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363657 s, 28.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:51:09,755::task::595::TaskManager.Task::(_updateState) Task=`306b43ff-185c-42c3-92ae-5998d743232d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:51:09,755::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:51:09,756::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000656556', 'lastCheck': '0.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:51:09,756::task::1185::TaskManager.Task::(prepare) Task=`306b43ff-185c-42c3-92ae-5998d743232d`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000656556', 'lastCheck': '0.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:51:09,756::task::595::TaskManager.Task::(_updateState) Task=`306b43ff-185c-42c3-92ae-5998d743232d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:51:09,756::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:51:09,756::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:51:09,756::task::990::TaskManager.Task::(_decref) Task=`306b43ff-185c-42c3-92ae-5998d743232d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:51:11,719::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:51:11,794::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351834 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:51:13,806::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:51:13,880::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348629 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:51:15,893::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:51:16,250::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.317767 s, 3.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:51:17,885::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:51:17,885::task::595::TaskManager.Task::(_updateState) Task=`43ee2cc3-cecc-4097-99dd-ca5b5625c1aa`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:51:17,885::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:51:17,886::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:51:17,886::task::1185::TaskManager.Task::(prepare) Task=`43ee2cc3-cecc-4097-99dd-ca5b5625c1aa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:51:17,886::task::595::TaskManager.Task::(_updateState) Task=`43ee2cc3-cecc-4097-99dd-ca5b5625c1aa`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:51:17,886::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:51:17,886::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:51:17,887::task::990::TaskManager.Task::(_decref) Task=`43ee2cc3-cecc-4097-99dd-ca5b5625c1aa`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:51:17,923::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:51:17,923::task::595::TaskManager.Task::(_updateState) Task=`d4d91a8f-dab1-4bea-be92-0546994a0846`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:51:17,924::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:51:17,924::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7cf52457-750f-4a7e-94f0-bb8ca198b0e1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:51:17,924::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:51:17,925::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:51:17,925::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7cf52457-750f-4a7e-94f0-bb8ca198b0e1`::Granted request >Thread-34::DEBUG::2014-07-24 10:51:17,925::task::827::TaskManager.Task::(resourceAcquired) Task=`d4d91a8f-dab1-4bea-be92-0546994a0846`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:51:17,925::task::990::TaskManager.Task::(_decref) Task=`d4d91a8f-dab1-4bea-be92-0546994a0846`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:51:17,926::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:51:17,926::task::1185::TaskManager.Task::(prepare) Task=`d4d91a8f-dab1-4bea-be92-0546994a0846`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:51:17,926::task::595::TaskManager.Task::(_updateState) Task=`d4d91a8f-dab1-4bea-be92-0546994a0846`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:51:17,927::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:51:17,927::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:51:17,927::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:51:17,927::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:51:17,927::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:51:17,927::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:51:17,928::task::990::TaskManager.Task::(_decref) Task=`d4d91a8f-dab1-4bea-be92-0546994a0846`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:51:18,262::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:51:18,337::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351256 s, 29.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:51:18,927::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:51:18,937::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00070607 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:51:20,349::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:51:20,427::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366939 s, 27.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:51:22,439::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:51:22,519::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343788 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:51:24,531::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:51:24,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343649 s, 29.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:51:25,151::task::595::TaskManager.Task::(_updateState) Task=`3c3b7db0-ed27-4c98-b735-c65404b04b98`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:51:25,152::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:51:25,152::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00070607', 'lastCheck': '6.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:51:25,152::task::1185::TaskManager.Task::(prepare) Task=`3c3b7db0-ed27-4c98-b735-c65404b04b98`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00070607', 'lastCheck': '6.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:51:25,152::task::595::TaskManager.Task::(_updateState) Task=`3c3b7db0-ed27-4c98-b735-c65404b04b98`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:51:25,152::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:51:25,153::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:51:25,153::task::990::TaskManager.Task::(_decref) Task=`3c3b7db0-ed27-4c98-b735-c65404b04b98`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:51:26,617::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:51:26,690::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335943 s, 30.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:51:27,377::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-14::DEBUG::2014-07-24 10:51:27,992::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:51:27,992::task::595::TaskManager.Task::(_updateState) Task=`b5c9e635-fcee-4d73-a4a5-5e22a97b6471`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:51:27,993::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:51:27,993::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:51:27,993::task::1185::TaskManager.Task::(prepare) Task=`b5c9e635-fcee-4d73-a4a5-5e22a97b6471`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:51:27,993::task::595::TaskManager.Task::(_updateState) Task=`b5c9e635-fcee-4d73-a4a5-5e22a97b6471`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:51:27,993::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:51:27,994::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:51:27,994::task::990::TaskManager.Task::(_decref) Task=`b5c9e635-fcee-4d73-a4a5-5e22a97b6471`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:51:28,031::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:51:28,031::task::595::TaskManager.Task::(_updateState) Task=`5f929174-651f-4241-a8e7-6842141633e5`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:51:28,031::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:51:28,032::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1881df39-1639-4aa2-8272-b2c1fa8920c9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:51:28,032::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:51:28,032::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:51:28,032::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1881df39-1639-4aa2-8272-b2c1fa8920c9`::Granted request >Thread-34::DEBUG::2014-07-24 10:51:28,033::task::827::TaskManager.Task::(resourceAcquired) Task=`5f929174-651f-4241-a8e7-6842141633e5`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:51:28,033::task::990::TaskManager.Task::(_decref) Task=`5f929174-651f-4241-a8e7-6842141633e5`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:51:28,034::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:51:28,034::task::1185::TaskManager.Task::(prepare) Task=`5f929174-651f-4241-a8e7-6842141633e5`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:51:28,034::task::595::TaskManager.Task::(_updateState) Task=`5f929174-651f-4241-a8e7-6842141633e5`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:51:28,034::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:51:28,034::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:51:28,034::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:51:28,035::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:51:28,035::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:51:28,035::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:51:28,035::task::990::TaskManager.Task::(_decref) Task=`5f929174-651f-4241-a8e7-6842141633e5`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:51:28,702::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-24 10:51:28,957::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:51:28,983::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00600723 s, 682 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:51:29,088::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0581037 s, 17.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:51:31,100::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:51:31,174::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346677 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:51:33,186::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:51:33,260::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339696 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:51:35,272::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:51:35,348::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036567 s, 28.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:51:37,360::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:51:37,434::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034208 s, 29.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:51:38,097::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:51:38,097::task::595::TaskManager.Task::(_updateState) Task=`0c712c9d-c986-429b-a1db-44fd59afa756`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:51:38,098::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:51:38,098::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:51:38,098::task::1185::TaskManager.Task::(prepare) Task=`0c712c9d-c986-429b-a1db-44fd59afa756`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:51:38,098::task::595::TaskManager.Task::(_updateState) Task=`0c712c9d-c986-429b-a1db-44fd59afa756`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:51:38,099::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:51:38,099::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:51:38,099::task::990::TaskManager.Task::(_decref) Task=`0c712c9d-c986-429b-a1db-44fd59afa756`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:51:38,136::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:51:38,136::task::595::TaskManager.Task::(_updateState) Task=`b845d1b6-6a26-4659-92e6-155caca1527f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:51:38,136::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:51:38,137::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`39a4c065-d2b6-48a2-8907-71f8f82a4378`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:51:38,137::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:51:38,137::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:51:38,137::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`39a4c065-d2b6-48a2-8907-71f8f82a4378`::Granted request >Thread-34::DEBUG::2014-07-24 10:51:38,137::task::827::TaskManager.Task::(resourceAcquired) Task=`b845d1b6-6a26-4659-92e6-155caca1527f`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:51:38,138::task::990::TaskManager.Task::(_decref) Task=`b845d1b6-6a26-4659-92e6-155caca1527f`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:51:38,138::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:51:38,138::task::1185::TaskManager.Task::(prepare) Task=`b845d1b6-6a26-4659-92e6-155caca1527f`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:51:38,139::task::595::TaskManager.Task::(_updateState) Task=`b845d1b6-6a26-4659-92e6-155caca1527f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:51:38,139::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:51:38,139::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:51:38,139::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:51:38,139::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:51:38,140::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:51:38,140::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:51:38,140::task::990::TaskManager.Task::(_decref) Task=`b845d1b6-6a26-4659-92e6-155caca1527f`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 10:51:39,032::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:51:39,041::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000697868 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:51:39,446::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:51:39,520::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343948 s, 29.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:51:40,517::task::595::TaskManager.Task::(_updateState) Task=`b16a97d3-2218-4815-9c53-c64fda761438`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:51:40,518::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:51:40,518::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000697868', 'lastCheck': '1.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:51:40,518::task::1185::TaskManager.Task::(prepare) Task=`b16a97d3-2218-4815-9c53-c64fda761438`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000697868', 'lastCheck': '1.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:51:40,518::task::595::TaskManager.Task::(_updateState) Task=`b16a97d3-2218-4815-9c53-c64fda761438`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:51:40,518::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:51:40,518::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:51:40,519::task::990::TaskManager.Task::(_decref) Task=`b16a97d3-2218-4815-9c53-c64fda761438`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:51:41,532::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:51:41,618::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337823 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:51:43,630::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:51:43,706::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036522 s, 28.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:51:45,718::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:51:45,795::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036635 s, 28.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:51:47,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:51:47,888::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0376681 s, 27.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:51:48,206::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:51:48,220::task::595::TaskManager.Task::(_updateState) Task=`6fd0e449-adce-4160-a643-b6cf0507bf2d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:51:48,220::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:51:48,220::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:51:48,220::task::1185::TaskManager.Task::(prepare) Task=`6fd0e449-adce-4160-a643-b6cf0507bf2d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:51:48,220::task::595::TaskManager.Task::(_updateState) Task=`6fd0e449-adce-4160-a643-b6cf0507bf2d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:51:48,221::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:51:48,221::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:51:48,221::task::990::TaskManager.Task::(_decref) Task=`6fd0e449-adce-4160-a643-b6cf0507bf2d`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:51:48,259::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:51:48,259::task::595::TaskManager.Task::(_updateState) Task=`a2f47c88-2602-437e-a6ba-7f464648ab24`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:51:48,259::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:51:48,259::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`a2e09633-31f7-4f2d-848c-4e5971026260`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:51:48,260::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:51:48,260::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:51:48,260::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`a2e09633-31f7-4f2d-848c-4e5971026260`::Granted request >Thread-34::DEBUG::2014-07-24 10:51:48,260::task::827::TaskManager.Task::(resourceAcquired) Task=`a2f47c88-2602-437e-a6ba-7f464648ab24`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:51:48,261::task::990::TaskManager.Task::(_decref) Task=`a2f47c88-2602-437e-a6ba-7f464648ab24`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:51:48,261::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:51:48,261::task::1185::TaskManager.Task::(prepare) Task=`a2f47c88-2602-437e-a6ba-7f464648ab24`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:51:48,262::task::595::TaskManager.Task::(_updateState) Task=`a2f47c88-2602-437e-a6ba-7f464648ab24`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:51:48,262::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:51:48,262::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:51:48,262::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:51:48,262::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:51:48,262::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:51:48,263::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:51:48,263::task::990::TaskManager.Task::(_decref) Task=`a2f47c88-2602-437e-a6ba-7f464648ab24`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 10:51:49,046::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:51:49,066::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0113297 s, 362 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:51:49,901::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:51:49,974::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339727 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:51:51,987::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:51:52,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350067 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:51:54,073::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:51:54,149::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366966 s, 27.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:51:55,903::task::595::TaskManager.Task::(_updateState) Task=`918dbe28-cf07-42e0-bebe-c82fafbb64d4`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:51:55,903::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:51:55,903::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0113297', 'lastCheck': '6.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:51:55,903::task::1185::TaskManager.Task::(prepare) Task=`918dbe28-cf07-42e0-bebe-c82fafbb64d4`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0113297', 'lastCheck': '6.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:51:55,903::task::595::TaskManager.Task::(_updateState) Task=`918dbe28-cf07-42e0-bebe-c82fafbb64d4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:51:55,903::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:51:55,904::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:51:55,904::task::990::TaskManager.Task::(_decref) Task=`918dbe28-cf07-42e0-bebe-c82fafbb64d4`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:51:56,162::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:51:56,236::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351535 s, 29.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:51:57,414::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:51:58,248::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-24 10:51:58,321::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:51:58,323::task::595::TaskManager.Task::(_updateState) Task=`f0af462f-fd16-41fa-b333-e75a5cb316ee`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:51:58,324::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:51:58,325::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:51:58,325::task::1185::TaskManager.Task::(prepare) Task=`f0af462f-fd16-41fa-b333-e75a5cb316ee`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:51:58,326::task::595::TaskManager.Task::(_updateState) Task=`f0af462f-fd16-41fa-b333-e75a5cb316ee`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:51:58,327::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:51:58,327::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:51:58,328::task::990::TaskManager.Task::(_decref) Task=`f0af462f-fd16-41fa-b333-e75a5cb316ee`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:51:58,333::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340701 s, 30.1 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-24 10:51:58,377::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:51:58,378::task::595::TaskManager.Task::(_updateState) Task=`49d99dce-b421-45d3-9d83-64c7caf29786`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:51:58,378::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:51:58,378::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`80c6068b-2348-4130-9cc9-a8784116528e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:51:58,379::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:51:58,379::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:51:58,379::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`80c6068b-2348-4130-9cc9-a8784116528e`::Granted request >Thread-34::DEBUG::2014-07-24 10:51:58,379::task::827::TaskManager.Task::(resourceAcquired) Task=`49d99dce-b421-45d3-9d83-64c7caf29786`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:51:58,379::task::990::TaskManager.Task::(_decref) Task=`49d99dce-b421-45d3-9d83-64c7caf29786`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:51:58,380::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:51:58,380::task::1185::TaskManager.Task::(prepare) Task=`49d99dce-b421-45d3-9d83-64c7caf29786`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:51:58,381::task::595::TaskManager.Task::(_updateState) Task=`49d99dce-b421-45d3-9d83-64c7caf29786`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:51:58,381::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:51:58,381::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:51:58,381::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:51:58,381::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:51:58,381::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:51:58,382::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:51:58,382::task::990::TaskManager.Task::(_decref) Task=`49d99dce-b421-45d3-9d83-64c7caf29786`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 10:51:59,071::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:51:59,080::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000726689 s, 5.6 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 10:51:59,132::task::595::TaskManager.Task::(_updateState) Task=`9c78aaec-20c9-4f0b-8f14-799b383081a9`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 10:51:59,132::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 10:51:59,133::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:51:59,133::task::1185::TaskManager.Task::(prepare) Task=`9c78aaec-20c9-4f0b-8f14-799b383081a9`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:51:59,133::task::595::TaskManager.Task::(_updateState) Task=`9c78aaec-20c9-4f0b-8f14-799b383081a9`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 10:51:59,133::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 10:51:59,133::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 10:51:59,134::task::990::TaskManager.Task::(_decref) Task=`9c78aaec-20c9-4f0b-8f14-799b383081a9`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:52:00,345::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:52:00,420::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035274 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:52:02,433::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:52:02,506::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338199 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:52:04,518::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:52:04,594::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036906 s, 27.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:52:06,607::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:52:06,682::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361242 s, 28.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:52:08,462::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:52:08,463::task::595::TaskManager.Task::(_updateState) Task=`259ed7fe-a0fe-444d-b5dd-95b057244c08`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:52:08,463::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:52:08,463::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:52:08,463::task::1185::TaskManager.Task::(prepare) Task=`259ed7fe-a0fe-444d-b5dd-95b057244c08`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:52:08,464::task::595::TaskManager.Task::(_updateState) Task=`259ed7fe-a0fe-444d-b5dd-95b057244c08`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:52:08,464::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:52:08,464::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:52:08,464::task::990::TaskManager.Task::(_decref) Task=`259ed7fe-a0fe-444d-b5dd-95b057244c08`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:52:08,562::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:52:08,563::task::595::TaskManager.Task::(_updateState) Task=`6d360f9a-452f-47fa-94e9-6632b24c6a3b`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:52:08,563::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:52:08,563::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`cfd46824-3cbc-4f3a-8f02-35ffebfe8996`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:52:08,563::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:52:08,564::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:52:08,564::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`cfd46824-3cbc-4f3a-8f02-35ffebfe8996`::Granted request >Thread-34::DEBUG::2014-07-24 10:52:08,564::task::827::TaskManager.Task::(resourceAcquired) Task=`6d360f9a-452f-47fa-94e9-6632b24c6a3b`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:52:08,564::task::990::TaskManager.Task::(_decref) Task=`6d360f9a-452f-47fa-94e9-6632b24c6a3b`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:52:08,565::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:52:08,565::task::1185::TaskManager.Task::(prepare) Task=`6d360f9a-452f-47fa-94e9-6632b24c6a3b`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:52:08,565::task::595::TaskManager.Task::(_updateState) Task=`6d360f9a-452f-47fa-94e9-6632b24c6a3b`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:52:08,566::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:52:08,566::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:52:08,566::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:52:08,566::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:52:08,566::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:52:08,566::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:52:08,567::task::990::TaskManager.Task::(_decref) Task=`6d360f9a-452f-47fa-94e9-6632b24c6a3b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:52:08,695::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:52:08,770::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362779 s, 28.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:52:09,085::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:52:09,094::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000750885 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:52:10,782::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:52:10,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366477 s, 27.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:52:11,360::task::595::TaskManager.Task::(_updateState) Task=`1fb20d2d-dfca-47e3-acf8-2b880dc383c4`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:52:11,361::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:52:11,361::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000750885', 'lastCheck': '2.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:52:11,361::task::1185::TaskManager.Task::(prepare) Task=`1fb20d2d-dfca-47e3-acf8-2b880dc383c4`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000750885', 'lastCheck': '2.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:52:11,361::task::595::TaskManager.Task::(_updateState) Task=`1fb20d2d-dfca-47e3-acf8-2b880dc383c4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:52:11,361::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:52:11,362::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:52:11,362::task::990::TaskManager.Task::(_decref) Task=`1fb20d2d-dfca-47e3-acf8-2b880dc383c4`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:52:12,875::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:52:12,951::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363577 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:52:14,963::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:52:15,038::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346136 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:52:17,050::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:52:17,123::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034066 s, 30.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:52:18,641::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:52:18,642::task::595::TaskManager.Task::(_updateState) Task=`9ca2c882-15cb-4313-8acf-90509bb308f4`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:52:18,642::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:52:18,642::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:52:18,643::task::1185::TaskManager.Task::(prepare) Task=`9ca2c882-15cb-4313-8acf-90509bb308f4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:52:18,643::task::595::TaskManager.Task::(_updateState) Task=`9ca2c882-15cb-4313-8acf-90509bb308f4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:52:18,643::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:52:18,643::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:52:18,643::task::990::TaskManager.Task::(_decref) Task=`9ca2c882-15cb-4313-8acf-90509bb308f4`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:52:18,695::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:52:18,696::task::595::TaskManager.Task::(_updateState) Task=`a384b2a5-ca37-41c1-a491-0174a0566d14`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:52:18,696::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:52:18,696::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`a62fc53d-04af-4ab6-ab82-5c40f5dc23a2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:52:18,696::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:52:18,697::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:52:18,697::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`a62fc53d-04af-4ab6-ab82-5c40f5dc23a2`::Granted request >Thread-34::DEBUG::2014-07-24 10:52:18,697::task::827::TaskManager.Task::(resourceAcquired) Task=`a384b2a5-ca37-41c1-a491-0174a0566d14`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:52:18,697::task::990::TaskManager.Task::(_decref) Task=`a384b2a5-ca37-41c1-a491-0174a0566d14`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:52:18,698::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:52:18,698::task::1185::TaskManager.Task::(prepare) Task=`a384b2a5-ca37-41c1-a491-0174a0566d14`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:52:18,698::task::595::TaskManager.Task::(_updateState) Task=`a384b2a5-ca37-41c1-a491-0174a0566d14`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:52:18,699::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:52:18,699::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:52:18,699::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:52:18,699::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:52:18,699::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:52:18,699::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:52:18,700::task::990::TaskManager.Task::(_decref) Task=`a384b2a5-ca37-41c1-a491-0174a0566d14`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 10:52:19,099::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:52:19,109::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000730536 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:52:19,136::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:52:19,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362374 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:52:21,402::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:52:21,477::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367646 s, 27.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:52:23,490::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:52:23,566::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036193 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:52:25,578::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:52:25,655::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362273 s, 28.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:52:26,922::task::595::TaskManager.Task::(_updateState) Task=`ba73bf5e-ad5b-44fe-a0dc-b15901c7857f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:52:26,923::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:52:26,923::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000730536', 'lastCheck': '7.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:52:26,923::task::1185::TaskManager.Task::(prepare) Task=`ba73bf5e-ad5b-44fe-a0dc-b15901c7857f`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000730536', 'lastCheck': '7.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:52:26,923::task::595::TaskManager.Task::(_updateState) Task=`ba73bf5e-ad5b-44fe-a0dc-b15901c7857f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:52:26,923::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:52:26,923::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:52:26,924::task::990::TaskManager.Task::(_decref) Task=`ba73bf5e-ad5b-44fe-a0dc-b15901c7857f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-07-24 10:52:27,450::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:52:27,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:52:27,756::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347093 s, 29.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:52:28,781::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [1487b3f5] >Thread-14::DEBUG::2014-07-24 10:52:28,797::task::595::TaskManager.Task::(_updateState) Task=`91b7be49-3bc6-4d82-86f4-afde6e0d4fe5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:52:28,798::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:52:28,798::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:52:28,798::task::1185::TaskManager.Task::(prepare) Task=`91b7be49-3bc6-4d82-86f4-afde6e0d4fe5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:52:28,798::task::595::TaskManager.Task::(_updateState) Task=`91b7be49-3bc6-4d82-86f4-afde6e0d4fe5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:52:28,798::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:52:28,799::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:52:28,799::task::990::TaskManager.Task::(_decref) Task=`91b7be49-3bc6-4d82-86f4-afde6e0d4fe5`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:52:28,857::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [1487b3f5] >Thread-34::DEBUG::2014-07-24 10:52:28,857::task::595::TaskManager.Task::(_updateState) Task=`85af0754-f418-47da-bf65-75807c576c62`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:52:28,857::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:52:28,858::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ab8c420c-9175-4578-a72e-f9622a2ce7f3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:52:28,858::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:52:28,858::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:52:28,858::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ab8c420c-9175-4578-a72e-f9622a2ce7f3`::Granted request >Thread-34::DEBUG::2014-07-24 10:52:28,859::task::827::TaskManager.Task::(resourceAcquired) Task=`85af0754-f418-47da-bf65-75807c576c62`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:52:28,859::task::990::TaskManager.Task::(_decref) Task=`85af0754-f418-47da-bf65-75807c576c62`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:52:28,859::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:52:28,860::task::1185::TaskManager.Task::(prepare) Task=`85af0754-f418-47da-bf65-75807c576c62`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:52:28,860::task::595::TaskManager.Task::(_updateState) Task=`85af0754-f418-47da-bf65-75807c576c62`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:52:28,860::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:52:28,860::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:52:28,860::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:52:28,861::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:52:28,861::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:52:28,861::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:52:28,861::task::990::TaskManager.Task::(_decref) Task=`85af0754-f418-47da-bf65-75807c576c62`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 10:52:29,113::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:52:29,134::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0127066 s, 322 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:52:29,768::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:52:29,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352545 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:52:31,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:52:31,951::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0426092 s, 24.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:52:33,968::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:52:34,042::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350463 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:52:36,054::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:52:36,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360238 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:52:38,142::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:52:38,217::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036545 s, 28.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:52:38,948::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:52:38,949::task::595::TaskManager.Task::(_updateState) Task=`9a86a057-86cd-4695-bf10-dfe89a4a2a92`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:52:38,949::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:52:38,950::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:52:38,950::task::1185::TaskManager.Task::(prepare) Task=`9a86a057-86cd-4695-bf10-dfe89a4a2a92`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:52:38,950::task::595::TaskManager.Task::(_updateState) Task=`9a86a057-86cd-4695-bf10-dfe89a4a2a92`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:52:38,950::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:52:38,950::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:52:38,950::task::990::TaskManager.Task::(_decref) Task=`9a86a057-86cd-4695-bf10-dfe89a4a2a92`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:52:39,008::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:52:39,008::task::595::TaskManager.Task::(_updateState) Task=`bad2a0d8-4efa-4c3a-bacf-6f4b4d5e46c7`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:52:39,008::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:52:39,009::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d51568dd-3d96-433d-9e30-18213c015431`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:52:39,009::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:52:39,009::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:52:39,009::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d51568dd-3d96-433d-9e30-18213c015431`::Granted request >Thread-34::DEBUG::2014-07-24 10:52:39,010::task::827::TaskManager.Task::(resourceAcquired) Task=`bad2a0d8-4efa-4c3a-bacf-6f4b4d5e46c7`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:52:39,010::task::990::TaskManager.Task::(_decref) Task=`bad2a0d8-4efa-4c3a-bacf-6f4b4d5e46c7`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:52:39,011::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:52:39,011::task::1185::TaskManager.Task::(prepare) Task=`bad2a0d8-4efa-4c3a-bacf-6f4b4d5e46c7`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:52:39,011::task::595::TaskManager.Task::(_updateState) Task=`bad2a0d8-4efa-4c3a-bacf-6f4b4d5e46c7`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:52:39,011::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:52:39,011::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:52:39,012::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:52:39,012::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:52:39,012::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:52:39,012::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:52:39,012::task::990::TaskManager.Task::(_decref) Task=`bad2a0d8-4efa-4c3a-bacf-6f4b4d5e46c7`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 10:52:39,138::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:52:39,159::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0126457 s, 324 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:52:40,229::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:52:40,305::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366509 s, 27.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:52:42,318::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:52:42,391::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343547 s, 29.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:52:42,487::task::595::TaskManager.Task::(_updateState) Task=`073d6f5e-d5b5-4266-a05d-99b5d6cbc162`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:52:42,487::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:52:42,488::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0126457', 'lastCheck': '3.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:52:42,488::task::1185::TaskManager.Task::(prepare) Task=`073d6f5e-d5b5-4266-a05d-99b5d6cbc162`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0126457', 'lastCheck': '3.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:52:42,488::task::595::TaskManager.Task::(_updateState) Task=`073d6f5e-d5b5-4266-a05d-99b5d6cbc162`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:52:42,488::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:52:42,488::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:52:42,489::task::990::TaskManager.Task::(_decref) Task=`073d6f5e-d5b5-4266-a05d-99b5d6cbc162`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:52:44,403::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:52:44,476::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335587 s, 30.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:52:46,489::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:52:46,564::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363742 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:52:48,576::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:52:48,651::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353113 s, 29.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:52:49,090::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:52:49,091::task::595::TaskManager.Task::(_updateState) Task=`70b4d6ee-90f0-4ae7-b776-7aea4fbf5eae`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:52:49,091::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:52:49,091::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:52:49,091::task::1185::TaskManager.Task::(prepare) Task=`70b4d6ee-90f0-4ae7-b776-7aea4fbf5eae`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:52:49,092::task::595::TaskManager.Task::(_updateState) Task=`70b4d6ee-90f0-4ae7-b776-7aea4fbf5eae`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:52:49,092::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:52:49,092::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:52:49,092::task::990::TaskManager.Task::(_decref) Task=`70b4d6ee-90f0-4ae7-b776-7aea4fbf5eae`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:52:49,146::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:52:49,147::task::595::TaskManager.Task::(_updateState) Task=`6133df19-ef29-48ae-8460-0fcdc9adbd9c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:52:49,147::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:52:49,147::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4bc5ad5d-69a9-4451-b283-bc218f73c801`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:52:49,147::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:52:49,148::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:52:49,148::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4bc5ad5d-69a9-4451-b283-bc218f73c801`::Granted request >Thread-34::DEBUG::2014-07-24 10:52:49,148::task::827::TaskManager.Task::(resourceAcquired) Task=`6133df19-ef29-48ae-8460-0fcdc9adbd9c`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:52:49,148::task::990::TaskManager.Task::(_decref) Task=`6133df19-ef29-48ae-8460-0fcdc9adbd9c`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:52:49,149::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:52:49,149::task::1185::TaskManager.Task::(prepare) Task=`6133df19-ef29-48ae-8460-0fcdc9adbd9c`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:52:49,149::task::595::TaskManager.Task::(_updateState) Task=`6133df19-ef29-48ae-8460-0fcdc9adbd9c`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:52:49,150::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:52:49,150::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:52:49,150::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:52:49,150::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:52:49,150::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:52:49,151::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:52:49,151::task::990::TaskManager.Task::(_decref) Task=`6133df19-ef29-48ae-8460-0fcdc9adbd9c`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 10:52:49,164::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:52:49,176::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00362958 s, 1.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:52:50,664::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:52:50,742::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0388395 s, 26.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:52:52,754::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:52:52,832::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0382763 s, 26.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:52:54,845::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:52:54,919::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347223 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:52:56,931::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:52:57,007::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036925 s, 27.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:52:57,488::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-14::DEBUG::2014-07-24 10:52:58,027::task::595::TaskManager.Task::(_updateState) Task=`3369bdb4-2edd-4872-83b4-495ffcefeb6a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:52:58,027::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:52:58,027::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00362958', 'lastCheck': '8.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:52:58,027::task::1185::TaskManager.Task::(prepare) Task=`3369bdb4-2edd-4872-83b4-495ffcefeb6a`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00362958', 'lastCheck': '8.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:52:58,027::task::595::TaskManager.Task::(_updateState) Task=`3369bdb4-2edd-4872-83b4-495ffcefeb6a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:52:58,028::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:52:58,028::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:52:58,028::task::990::TaskManager.Task::(_decref) Task=`3369bdb4-2edd-4872-83b4-495ffcefeb6a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:52:59,020::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:52:59,096::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035529 s, 28.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:52:59,181::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:52:59,190::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000716099 s, 5.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:52:59,231::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:52:59,232::task::595::TaskManager.Task::(_updateState) Task=`5d23a31e-6110-465f-911d-97286f843aac`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:52:59,232::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:52:59,232::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:52:59,232::task::1185::TaskManager.Task::(prepare) Task=`5d23a31e-6110-465f-911d-97286f843aac`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:52:59,233::task::595::TaskManager.Task::(_updateState) Task=`5d23a31e-6110-465f-911d-97286f843aac`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:52:59,233::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:52:59,233::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:52:59,233::task::990::TaskManager.Task::(_decref) Task=`5d23a31e-6110-465f-911d-97286f843aac`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:52:59,281::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:52:59,281::task::595::TaskManager.Task::(_updateState) Task=`7949d137-552a-4b63-860f-4c82794fb08d`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:52:59,282::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:52:59,282::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`9ce9710a-49d6-484b-a3ab-1a685ab651f3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:52:59,282::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:52:59,283::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:52:59,283::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`9ce9710a-49d6-484b-a3ab-1a685ab651f3`::Granted request >Thread-34::DEBUG::2014-07-24 10:52:59,283::task::827::TaskManager.Task::(resourceAcquired) Task=`7949d137-552a-4b63-860f-4c82794fb08d`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:52:59,283::task::990::TaskManager.Task::(_decref) Task=`7949d137-552a-4b63-860f-4c82794fb08d`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:52:59,284::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:52:59,284::task::1185::TaskManager.Task::(prepare) Task=`7949d137-552a-4b63-860f-4c82794fb08d`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:52:59,284::task::595::TaskManager.Task::(_updateState) Task=`7949d137-552a-4b63-860f-4c82794fb08d`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:52:59,285::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:52:59,285::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:52:59,285::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:52:59,285::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:52:59,285::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:52:59,286::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:52:59,286::task::990::TaskManager.Task::(_decref) Task=`7949d137-552a-4b63-860f-4c82794fb08d`::ref 0 aborting False >Thread-37::DEBUG::2014-07-24 10:52:59,296::task::595::TaskManager.Task::(_updateState) Task=`6e81d498-ed0c-41f0-8058-bb6055093ed6`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 10:52:59,296::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 10:52:59,297::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:52:59,297::task::1185::TaskManager.Task::(prepare) Task=`6e81d498-ed0c-41f0-8058-bb6055093ed6`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:52:59,297::task::595::TaskManager.Task::(_updateState) Task=`6e81d498-ed0c-41f0-8058-bb6055093ed6`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 10:52:59,297::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 10:52:59,297::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 10:52:59,298::task::990::TaskManager.Task::(_decref) Task=`6e81d498-ed0c-41f0-8058-bb6055093ed6`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:53:01,107::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:53:01,180::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338595 s, 30.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:53:03,193::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:53:03,268::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354221 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:53:05,280::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:53:05,356::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339632 s, 30.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:53:07,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:53:07,446::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352064 s, 29.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:53:09,195::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:53:09,204::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000639678 s, 6.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:53:09,356::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:53:09,356::task::595::TaskManager.Task::(_updateState) Task=`747251f9-438b-4ff6-b393-411ac7a355a0`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:53:09,357::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:53:09,357::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:53:09,357::task::1185::TaskManager.Task::(prepare) Task=`747251f9-438b-4ff6-b393-411ac7a355a0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:53:09,357::task::595::TaskManager.Task::(_updateState) Task=`747251f9-438b-4ff6-b393-411ac7a355a0`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:53:09,357::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:53:09,358::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:53:09,358::task::990::TaskManager.Task::(_decref) Task=`747251f9-438b-4ff6-b393-411ac7a355a0`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:53:09,398::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:53:09,398::task::595::TaskManager.Task::(_updateState) Task=`d182067f-363c-4c5d-b3fa-715b7b3ccc65`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:53:09,399::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:53:09,399::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4d1a62ba-8b93-47bb-a7f4-bc5479970589`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:53:09,399::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:53:09,399::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:53:09,400::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4d1a62ba-8b93-47bb-a7f4-bc5479970589`::Granted request >Thread-34::DEBUG::2014-07-24 10:53:09,400::task::827::TaskManager.Task::(resourceAcquired) Task=`d182067f-363c-4c5d-b3fa-715b7b3ccc65`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:53:09,400::task::990::TaskManager.Task::(_decref) Task=`d182067f-363c-4c5d-b3fa-715b7b3ccc65`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:53:09,401::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:53:09,401::task::1185::TaskManager.Task::(prepare) Task=`d182067f-363c-4c5d-b3fa-715b7b3ccc65`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:53:09,401::task::595::TaskManager.Task::(_updateState) Task=`d182067f-363c-4c5d-b3fa-715b7b3ccc65`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:53:09,401::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:53:09,402::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:53:09,402::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:53:09,402::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:53:09,402::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:53:09,402::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:53:09,403::task::990::TaskManager.Task::(_decref) Task=`d182067f-363c-4c5d-b3fa-715b7b3ccc65`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:53:09,459::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:53:09,559::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351293 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:53:11,710::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:53:11,784::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035275 s, 29.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:53:13,516::task::595::TaskManager.Task::(_updateState) Task=`3e6367d7-bdd0-4b29-9feb-30e85690d4c9`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:53:13,516::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:53:13,517::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000639678', 'lastCheck': '4.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:53:13,517::task::1185::TaskManager.Task::(prepare) Task=`3e6367d7-bdd0-4b29-9feb-30e85690d4c9`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000639678', 'lastCheck': '4.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:53:13,517::task::595::TaskManager.Task::(_updateState) Task=`3e6367d7-bdd0-4b29-9feb-30e85690d4c9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:53:13,517::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:53:13,517::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:53:13,518::task::990::TaskManager.Task::(_decref) Task=`3e6367d7-bdd0-4b29-9feb-30e85690d4c9`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:53:13,796::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:53:13,873::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349293 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:53:15,903::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:53:15,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0381032 s, 26.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:53:17,995::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:53:18,069::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345026 s, 29.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:53:19,209::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:53:19,235::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0175209 s, 234 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:53:19,467::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:53:19,468::task::595::TaskManager.Task::(_updateState) Task=`f63ed1bd-d7da-473b-ae96-2550193ef322`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:53:19,468::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:53:19,468::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:53:19,469::task::1185::TaskManager.Task::(prepare) Task=`f63ed1bd-d7da-473b-ae96-2550193ef322`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:53:19,469::task::595::TaskManager.Task::(_updateState) Task=`f63ed1bd-d7da-473b-ae96-2550193ef322`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:53:19,469::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:53:19,469::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:53:19,469::task::990::TaskManager.Task::(_decref) Task=`f63ed1bd-d7da-473b-ae96-2550193ef322`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:53:19,501::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:53:19,501::task::595::TaskManager.Task::(_updateState) Task=`afd43221-f63b-4fba-91a5-81b60d6ae7b6`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:53:19,501::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:53:19,502::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`26c593d1-18cc-4fc8-bb35-9ec5867a0a24`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:53:19,502::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:53:19,502::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:53:19,502::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`26c593d1-18cc-4fc8-bb35-9ec5867a0a24`::Granted request >Thread-34::DEBUG::2014-07-24 10:53:19,503::task::827::TaskManager.Task::(resourceAcquired) Task=`afd43221-f63b-4fba-91a5-81b60d6ae7b6`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:53:19,503::task::990::TaskManager.Task::(_decref) Task=`afd43221-f63b-4fba-91a5-81b60d6ae7b6`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:53:19,503::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:53:19,504::task::1185::TaskManager.Task::(prepare) Task=`afd43221-f63b-4fba-91a5-81b60d6ae7b6`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:53:19,504::task::595::TaskManager.Task::(_updateState) Task=`afd43221-f63b-4fba-91a5-81b60d6ae7b6`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:53:19,504::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:53:19,504::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:53:19,504::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:53:19,505::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:53:19,505::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:53:19,505::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:53:19,505::task::990::TaskManager.Task::(_decref) Task=`afd43221-f63b-4fba-91a5-81b60d6ae7b6`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:53:20,081::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:53:20,156::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355564 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:53:22,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:53:22,244::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353445 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:53:24,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:53:24,332::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354909 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:53:26,344::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:53:26,420::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365817 s, 28.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:53:27,524::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:53:28,432::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:53:28,508::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361367 s, 28.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:53:28,883::task::595::TaskManager.Task::(_updateState) Task=`c56edfbb-2a39-4470-b3ba-836f48ca60a5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:53:28,883::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:53:28,883::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0175209', 'lastCheck': '9.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:53:28,883::task::1185::TaskManager.Task::(prepare) Task=`c56edfbb-2a39-4470-b3ba-836f48ca60a5`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0175209', 'lastCheck': '9.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:53:28,884::task::595::TaskManager.Task::(_updateState) Task=`c56edfbb-2a39-4470-b3ba-836f48ca60a5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:53:28,884::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:53:28,884::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:53:28,884::task::990::TaskManager.Task::(_decref) Task=`c56edfbb-2a39-4470-b3ba-836f48ca60a5`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 10:53:29,240::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:53:29,260::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0120122 s, 341 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:53:29,846::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:53:29,846::task::595::TaskManager.Task::(_updateState) Task=`4daacb51-9e23-4f03-92f4-7e5f599a9329`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:53:29,846::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:53:29,847::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:53:29,847::task::1185::TaskManager.Task::(prepare) Task=`4daacb51-9e23-4f03-92f4-7e5f599a9329`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:53:29,847::task::595::TaskManager.Task::(_updateState) Task=`4daacb51-9e23-4f03-92f4-7e5f599a9329`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:53:29,847::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:53:29,847::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:53:29,847::task::990::TaskManager.Task::(_decref) Task=`4daacb51-9e23-4f03-92f4-7e5f599a9329`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:53:29,912::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:53:29,912::task::595::TaskManager.Task::(_updateState) Task=`faef16a3-46eb-485c-9f48-dc1d8a0c91e3`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:53:29,912::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:53:29,912::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`60a92b10-86a1-4fea-96ec-240efc33c8ba`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:53:29,913::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:53:29,914::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:53:29,914::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`60a92b10-86a1-4fea-96ec-240efc33c8ba`::Granted request >Thread-34::DEBUG::2014-07-24 10:53:29,914::task::827::TaskManager.Task::(resourceAcquired) Task=`faef16a3-46eb-485c-9f48-dc1d8a0c91e3`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:53:29,914::task::990::TaskManager.Task::(_decref) Task=`faef16a3-46eb-485c-9f48-dc1d8a0c91e3`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:53:29,915::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:53:29,915::task::1185::TaskManager.Task::(prepare) Task=`faef16a3-46eb-485c-9f48-dc1d8a0c91e3`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:53:29,915::task::595::TaskManager.Task::(_updateState) Task=`faef16a3-46eb-485c-9f48-dc1d8a0c91e3`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:53:29,916::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:53:29,916::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:53:29,916::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:53:29,916::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:53:29,916::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:53:29,916::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:53:29,917::task::990::TaskManager.Task::(_decref) Task=`faef16a3-46eb-485c-9f48-dc1d8a0c91e3`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:53:30,520::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:53:30,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035417 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:53:32,607::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:53:32,680::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347287 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:53:34,693::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:53:34,768::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354461 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:53:36,780::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:53:36,853::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344873 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:53:38,865::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:53:38,939::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034857 s, 29.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:53:39,265::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:53:39,286::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.012071 s, 339 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:53:40,026::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:53:40,038::task::595::TaskManager.Task::(_updateState) Task=`9dbd0305-1d71-48f1-82e4-0b4d960ab56d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:53:40,038::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:53:40,038::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:53:40,038::task::1185::TaskManager.Task::(prepare) Task=`9dbd0305-1d71-48f1-82e4-0b4d960ab56d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:53:40,039::task::595::TaskManager.Task::(_updateState) Task=`9dbd0305-1d71-48f1-82e4-0b4d960ab56d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:53:40,039::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:53:40,039::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:53:40,039::task::990::TaskManager.Task::(_decref) Task=`9dbd0305-1d71-48f1-82e4-0b4d960ab56d`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:53:40,070::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:53:40,071::task::595::TaskManager.Task::(_updateState) Task=`20b6430e-cbcc-426b-bb76-57ef830cd390`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:53:40,071::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:53:40,071::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`804d6c9d-60a3-4adb-a441-b9607670b654`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:53:40,071::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:53:40,072::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:53:40,072::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`804d6c9d-60a3-4adb-a441-b9607670b654`::Granted request >Thread-34::DEBUG::2014-07-24 10:53:40,072::task::827::TaskManager.Task::(resourceAcquired) Task=`20b6430e-cbcc-426b-bb76-57ef830cd390`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:53:40,072::task::990::TaskManager.Task::(_decref) Task=`20b6430e-cbcc-426b-bb76-57ef830cd390`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:53:40,073::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:53:40,073::task::1185::TaskManager.Task::(prepare) Task=`20b6430e-cbcc-426b-bb76-57ef830cd390`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:53:40,073::task::595::TaskManager.Task::(_updateState) Task=`20b6430e-cbcc-426b-bb76-57ef830cd390`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:53:40,073::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:53:40,074::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:53:40,074::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:53:40,074::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:53:40,074::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:53:40,074::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:53:40,074::task::990::TaskManager.Task::(_decref) Task=`20b6430e-cbcc-426b-bb76-57ef830cd390`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:53:40,951::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:53:41,025::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351554 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:53:43,038::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:53:43,112::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035301 s, 29.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:53:44,260::task::595::TaskManager.Task::(_updateState) Task=`4fc55c16-cc01-49ad-9126-63c009f0f074`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:53:44,261::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:53:44,261::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.012071', 'lastCheck': '5.0', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:53:44,261::task::1185::TaskManager.Task::(prepare) Task=`4fc55c16-cc01-49ad-9126-63c009f0f074`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.012071', 'lastCheck': '5.0', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:53:44,261::task::595::TaskManager.Task::(_updateState) Task=`4fc55c16-cc01-49ad-9126-63c009f0f074`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:53:44,261::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:53:44,262::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:53:44,262::task::990::TaskManager.Task::(_decref) Task=`4fc55c16-cc01-49ad-9126-63c009f0f074`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:53:45,124::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:53:45,198::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035459 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:53:47,211::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:53:47,285::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355587 s, 28.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:53:49,291::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:53:49,300::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-24 10:53:49,323::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0197353 s, 208 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:53:49,403::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0632808 s, 16.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:53:50,128::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:53:50,129::task::595::TaskManager.Task::(_updateState) Task=`404832ff-9afe-4339-86fc-5b8da87d3735`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:53:50,129::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:53:50,129::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:53:50,129::task::1185::TaskManager.Task::(prepare) Task=`404832ff-9afe-4339-86fc-5b8da87d3735`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:53:50,129::task::595::TaskManager.Task::(_updateState) Task=`404832ff-9afe-4339-86fc-5b8da87d3735`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:53:50,130::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:53:50,130::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:53:50,130::task::990::TaskManager.Task::(_decref) Task=`404832ff-9afe-4339-86fc-5b8da87d3735`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:53:50,164::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:53:50,165::task::595::TaskManager.Task::(_updateState) Task=`4b341f74-a6ac-4da0-a2ec-330d6e7e9599`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:53:50,165::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:53:50,165::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7ec4fe93-4226-4a6a-8eb1-3e65fbcb0af8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:53:50,165::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:53:50,166::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:53:50,166::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7ec4fe93-4226-4a6a-8eb1-3e65fbcb0af8`::Granted request >Thread-34::DEBUG::2014-07-24 10:53:50,166::task::827::TaskManager.Task::(resourceAcquired) Task=`4b341f74-a6ac-4da0-a2ec-330d6e7e9599`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:53:50,166::task::990::TaskManager.Task::(_decref) Task=`4b341f74-a6ac-4da0-a2ec-330d6e7e9599`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:53:50,167::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:53:50,167::task::1185::TaskManager.Task::(prepare) Task=`4b341f74-a6ac-4da0-a2ec-330d6e7e9599`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:53:50,167::task::595::TaskManager.Task::(_updateState) Task=`4b341f74-a6ac-4da0-a2ec-330d6e7e9599`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:53:50,168::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:53:50,168::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:53:50,168::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:53:50,168::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:53:50,168::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:53:50,168::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:53:50,169::task::990::TaskManager.Task::(_decref) Task=`4b341f74-a6ac-4da0-a2ec-330d6e7e9599`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:53:51,415::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:53:51,491::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364277 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:53:53,503::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:53:53,581::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373151 s, 27.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:53:55,594::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:53:55,671::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0378273 s, 27.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:53:57,560::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:53:57,684::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:53:57,758::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348463 s, 29.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:53:59,350::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:53:59,369::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0109413 s, 374 kB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 10:53:59,442::task::595::TaskManager.Task::(_updateState) Task=`59905294-c705-47e3-9645-3fcf108dc278`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 10:53:59,443::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 10:53:59,443::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:53:59,443::task::1185::TaskManager.Task::(prepare) Task=`59905294-c705-47e3-9645-3fcf108dc278`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:53:59,443::task::595::TaskManager.Task::(_updateState) Task=`59905294-c705-47e3-9645-3fcf108dc278`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 10:53:59,443::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 10:53:59,444::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 10:53:59,444::task::990::TaskManager.Task::(_decref) Task=`59905294-c705-47e3-9645-3fcf108dc278`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:53:59,611::task::595::TaskManager.Task::(_updateState) Task=`53c90de8-9b35-4ee1-baf0-b4d16eab9d4d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:53:59,611::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:53:59,611::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0109413', 'lastCheck': '0.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:53:59,612::task::1185::TaskManager.Task::(prepare) Task=`53c90de8-9b35-4ee1-baf0-b4d16eab9d4d`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0109413', 'lastCheck': '0.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:53:59,612::task::595::TaskManager.Task::(_updateState) Task=`53c90de8-9b35-4ee1-baf0-b4d16eab9d4d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:53:59,612::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:53:59,612::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:53:59,612::task::990::TaskManager.Task::(_decref) Task=`53c90de8-9b35-4ee1-baf0-b4d16eab9d4d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:53:59,770::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:53:59,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355743 s, 28.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:54:00,256::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:54:00,256::task::595::TaskManager.Task::(_updateState) Task=`7b70c85e-9af2-46b0-87f0-5daafef4c8f8`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:54:00,257::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:54:00,257::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:54:00,257::task::1185::TaskManager.Task::(prepare) Task=`7b70c85e-9af2-46b0-87f0-5daafef4c8f8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:54:00,257::task::595::TaskManager.Task::(_updateState) Task=`7b70c85e-9af2-46b0-87f0-5daafef4c8f8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:54:00,257::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:54:00,258::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:54:00,258::task::990::TaskManager.Task::(_decref) Task=`7b70c85e-9af2-46b0-87f0-5daafef4c8f8`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:54:00,289::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:54:00,289::task::595::TaskManager.Task::(_updateState) Task=`0e7d66b6-9a4a-4aa9-83bf-d8283617d953`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:54:00,290::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:54:00,290::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`33b1e7d3-a2d3-4a67-abd2-7dd6e737633e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:54:00,290::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:54:00,290::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:54:00,291::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`33b1e7d3-a2d3-4a67-abd2-7dd6e737633e`::Granted request >Thread-34::DEBUG::2014-07-24 10:54:00,291::task::827::TaskManager.Task::(resourceAcquired) Task=`0e7d66b6-9a4a-4aa9-83bf-d8283617d953`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:54:00,291::task::990::TaskManager.Task::(_decref) Task=`0e7d66b6-9a4a-4aa9-83bf-d8283617d953`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:54:00,292::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:54:00,292::task::1185::TaskManager.Task::(prepare) Task=`0e7d66b6-9a4a-4aa9-83bf-d8283617d953`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:54:00,292::task::595::TaskManager.Task::(_updateState) Task=`0e7d66b6-9a4a-4aa9-83bf-d8283617d953`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:54:00,292::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:54:00,292::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:54:00,293::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:54:00,293::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:54:00,293::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:54:00,293::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:54:00,293::task::990::TaskManager.Task::(_decref) Task=`0e7d66b6-9a4a-4aa9-83bf-d8283617d953`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:54:02,078::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:54:02,151::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033808 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:54:04,163::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:54:04,258::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0423751 s, 24.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:54:06,271::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:54:06,346::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357255 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:54:08,359::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:54:08,433::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035779 s, 28.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:54:09,374::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:54:09,383::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000694798 s, 5.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:54:10,361::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [6674a7d7] >Thread-14::DEBUG::2014-07-24 10:54:10,361::task::595::TaskManager.Task::(_updateState) Task=`ceba75b2-3576-4e0a-80d3-fbd721080859`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:54:10,362::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:54:10,362::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:54:10,362::task::1185::TaskManager.Task::(prepare) Task=`ceba75b2-3576-4e0a-80d3-fbd721080859`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:54:10,362::task::595::TaskManager.Task::(_updateState) Task=`ceba75b2-3576-4e0a-80d3-fbd721080859`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:54:10,362::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:54:10,362::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:54:10,363::task::990::TaskManager.Task::(_decref) Task=`ceba75b2-3576-4e0a-80d3-fbd721080859`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:54:10,439::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [6674a7d7] >Thread-34::DEBUG::2014-07-24 10:54:10,439::task::595::TaskManager.Task::(_updateState) Task=`1136f4f8-66df-44a5-b8a6-ae30e58bffa1`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:54:10,439::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:54:10,440::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d98c4a5a-7cb2-4326-9303-c9cfc492817e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:54:10,440::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:54:10,440::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:54:10,440::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d98c4a5a-7cb2-4326-9303-c9cfc492817e`::Granted request >Thread-34::DEBUG::2014-07-24 10:54:10,441::task::827::TaskManager.Task::(resourceAcquired) Task=`1136f4f8-66df-44a5-b8a6-ae30e58bffa1`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:54:10,441::task::990::TaskManager.Task::(_decref) Task=`1136f4f8-66df-44a5-b8a6-ae30e58bffa1`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:54:10,442::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:54:10,442::task::1185::TaskManager.Task::(prepare) Task=`1136f4f8-66df-44a5-b8a6-ae30e58bffa1`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:54:10,442::task::595::TaskManager.Task::(_updateState) Task=`1136f4f8-66df-44a5-b8a6-ae30e58bffa1`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:54:10,442::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:54:10,442::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:54:10,442::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:54:10,443::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:54:10,443::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:54:10,443::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:54:10,443::task::990::TaskManager.Task::(_decref) Task=`1136f4f8-66df-44a5-b8a6-ae30e58bffa1`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:54:10,446::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:54:10,521::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361713 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:54:12,533::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:54:12,609::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360613 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:54:14,621::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:54:14,696::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345019 s, 29.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:54:14,990::task::595::TaskManager.Task::(_updateState) Task=`6f9603a7-886e-4789-b700-7795e4f67302`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:54:14,991::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:54:14,991::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000694798', 'lastCheck': '5.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:54:14,991::task::1185::TaskManager.Task::(prepare) Task=`6f9603a7-886e-4789-b700-7795e4f67302`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000694798', 'lastCheck': '5.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:54:14,991::task::595::TaskManager.Task::(_updateState) Task=`6f9603a7-886e-4789-b700-7795e4f67302`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:54:14,991::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:54:14,992::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:54:14,992::task::990::TaskManager.Task::(_decref) Task=`6f9603a7-886e-4789-b700-7795e4f67302`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:54:16,708::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:54:16,781::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337705 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:54:18,793::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:54:18,867::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347373 s, 29.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:54:19,388::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:54:19,403::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00624169 s, 656 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:54:20,679::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:54:20,679::task::595::TaskManager.Task::(_updateState) Task=`dc3f634e-c79a-42cf-b8c1-c50241e723fd`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:54:20,680::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:54:20,680::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:54:20,680::task::1185::TaskManager.Task::(prepare) Task=`dc3f634e-c79a-42cf-b8c1-c50241e723fd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:54:20,680::task::595::TaskManager.Task::(_updateState) Task=`dc3f634e-c79a-42cf-b8c1-c50241e723fd`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:54:20,680::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:54:20,681::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:54:20,681::task::990::TaskManager.Task::(_decref) Task=`dc3f634e-c79a-42cf-b8c1-c50241e723fd`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:54:20,714::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:54:20,714::task::595::TaskManager.Task::(_updateState) Task=`0f157e22-7f1d-471a-9aca-031bb7fd300d`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:54:20,714::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:54:20,715::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`bdc969de-9636-4a83-975a-030ab2d2e356`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:54:20,715::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:54:20,715::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:54:20,715::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`bdc969de-9636-4a83-975a-030ab2d2e356`::Granted request >Thread-34::DEBUG::2014-07-24 10:54:20,716::task::827::TaskManager.Task::(resourceAcquired) Task=`0f157e22-7f1d-471a-9aca-031bb7fd300d`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:54:20,716::task::990::TaskManager.Task::(_decref) Task=`0f157e22-7f1d-471a-9aca-031bb7fd300d`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:54:20,717::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:54:20,717::task::1185::TaskManager.Task::(prepare) Task=`0f157e22-7f1d-471a-9aca-031bb7fd300d`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:54:20,717::task::595::TaskManager.Task::(_updateState) Task=`0f157e22-7f1d-471a-9aca-031bb7fd300d`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:54:20,717::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:54:20,717::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:54:20,717::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:54:20,718::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:54:20,718::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:54:20,718::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:54:20,718::task::990::TaskManager.Task::(_decref) Task=`0f157e22-7f1d-471a-9aca-031bb7fd300d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:54:20,879::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:54:20,955::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363656 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:54:22,967::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:54:23,041::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344707 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:54:25,053::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:54:25,128::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344573 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:54:27,140::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:54:27,215::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359857 s, 28.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:54:27,596::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:54:29,227::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:54:29,301::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339087 s, 30.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:54:29,408::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:54:29,428::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0122454 s, 334 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:54:30,603::task::595::TaskManager.Task::(_updateState) Task=`89d45e82-d42c-41fd-a939-831eee703481`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:54:30,620::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:54:30,620::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0122454', 'lastCheck': '1.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:54:30,621::task::1185::TaskManager.Task::(prepare) Task=`89d45e82-d42c-41fd-a939-831eee703481`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0122454', 'lastCheck': '1.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:54:30,621::task::595::TaskManager.Task::(_updateState) Task=`89d45e82-d42c-41fd-a939-831eee703481`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:54:30,621::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:54:30,621::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:54:30,621::task::990::TaskManager.Task::(_decref) Task=`89d45e82-d42c-41fd-a939-831eee703481`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:54:30,815::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:54:30,816::task::595::TaskManager.Task::(_updateState) Task=`2ce9cd04-9ced-4bdd-a3bc-ecf3a24c5a48`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:54:30,816::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:54:30,816::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:54:30,816::task::1185::TaskManager.Task::(prepare) Task=`2ce9cd04-9ced-4bdd-a3bc-ecf3a24c5a48`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:54:30,816::task::595::TaskManager.Task::(_updateState) Task=`2ce9cd04-9ced-4bdd-a3bc-ecf3a24c5a48`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:54:30,817::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:54:30,817::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:54:30,817::task::990::TaskManager.Task::(_decref) Task=`2ce9cd04-9ced-4bdd-a3bc-ecf3a24c5a48`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:54:30,854::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:54:30,855::task::595::TaskManager.Task::(_updateState) Task=`61e919cc-182e-4e16-ae2f-5b0b3af92aab`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:54:30,855::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:54:30,855::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7785ac45-c15c-4d05-be5f-c3f2c1100d9e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:54:30,855::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:54:30,856::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:54:30,856::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7785ac45-c15c-4d05-be5f-c3f2c1100d9e`::Granted request >Thread-34::DEBUG::2014-07-24 10:54:30,856::task::827::TaskManager.Task::(resourceAcquired) Task=`61e919cc-182e-4e16-ae2f-5b0b3af92aab`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:54:30,856::task::990::TaskManager.Task::(_decref) Task=`61e919cc-182e-4e16-ae2f-5b0b3af92aab`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:54:30,857::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:54:30,857::task::1185::TaskManager.Task::(prepare) Task=`61e919cc-182e-4e16-ae2f-5b0b3af92aab`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:54:30,857::task::595::TaskManager.Task::(_updateState) Task=`61e919cc-182e-4e16-ae2f-5b0b3af92aab`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:54:30,857::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:54:30,858::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:54:30,858::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:54:30,858::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:54:30,858::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:54:30,858::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:54:30,858::task::990::TaskManager.Task::(_decref) Task=`61e919cc-182e-4e16-ae2f-5b0b3af92aab`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:54:31,313::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:54:31,385::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336532 s, 30.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:54:33,398::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:54:33,472::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034992 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:54:35,484::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:54:35,562::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364598 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:54:37,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:54:37,651::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339251 s, 30.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:54:39,433::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:54:39,454::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.011632 s, 352 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:54:39,664::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:54:39,749::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0422416 s, 24.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:54:40,918::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [3b38bf98] >Thread-14::DEBUG::2014-07-24 10:54:40,918::task::595::TaskManager.Task::(_updateState) Task=`6cafdc37-98d3-412c-953a-61659ef6c1f9`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:54:40,919::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:54:40,919::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:54:40,919::task::1185::TaskManager.Task::(prepare) Task=`6cafdc37-98d3-412c-953a-61659ef6c1f9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:54:40,919::task::595::TaskManager.Task::(_updateState) Task=`6cafdc37-98d3-412c-953a-61659ef6c1f9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:54:40,919::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:54:40,920::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:54:40,920::task::990::TaskManager.Task::(_decref) Task=`6cafdc37-98d3-412c-953a-61659ef6c1f9`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:54:40,954::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [3b38bf98] >Thread-34::DEBUG::2014-07-24 10:54:40,955::task::595::TaskManager.Task::(_updateState) Task=`ea38a172-4ea9-4a62-8103-ae4467d83886`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:54:40,955::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:54:40,955::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b045d6de-7be1-43f9-be94-4b40a8a3008a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:54:40,955::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:54:40,956::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:54:40,956::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b045d6de-7be1-43f9-be94-4b40a8a3008a`::Granted request >Thread-34::DEBUG::2014-07-24 10:54:40,957::task::827::TaskManager.Task::(resourceAcquired) Task=`ea38a172-4ea9-4a62-8103-ae4467d83886`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:54:40,957::task::990::TaskManager.Task::(_decref) Task=`ea38a172-4ea9-4a62-8103-ae4467d83886`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:54:40,958::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:54:40,958::task::1185::TaskManager.Task::(prepare) Task=`ea38a172-4ea9-4a62-8103-ae4467d83886`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:54:40,958::task::595::TaskManager.Task::(_updateState) Task=`ea38a172-4ea9-4a62-8103-ae4467d83886`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:54:40,958::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:54:40,958::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:54:40,959::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:54:40,959::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:54:40,959::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:54:40,959::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:54:40,959::task::990::TaskManager.Task::(_decref) Task=`ea38a172-4ea9-4a62-8103-ae4467d83886`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:54:41,762::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:54:41,836::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345584 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:54:43,848::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:54:43,928::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0400285 s, 25.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:54:45,940::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:54:46,018::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0383306 s, 26.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:54:46,095::task::595::TaskManager.Task::(_updateState) Task=`e0563abe-7175-43b2-b80a-1683c7bb946c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:54:46,095::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:54:46,095::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.011632', 'lastCheck': '6.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:54:46,095::task::1185::TaskManager.Task::(prepare) Task=`e0563abe-7175-43b2-b80a-1683c7bb946c`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.011632', 'lastCheck': '6.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:54:46,095::task::595::TaskManager.Task::(_updateState) Task=`e0563abe-7175-43b2-b80a-1683c7bb946c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:54:46,096::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:54:46,096::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:54:46,096::task::990::TaskManager.Task::(_decref) Task=`e0563abe-7175-43b2-b80a-1683c7bb946c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:54:48,030::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:54:48,108::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0394355 s, 26.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:54:49,458::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:54:49,479::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0121838 s, 336 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:54:50,121::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:54:50,195::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034655 s, 29.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:54:51,030::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:54:51,030::task::595::TaskManager.Task::(_updateState) Task=`b6eae462-a0b8-4c96-bed5-ecdaa2d49bb9`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:54:51,031::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:54:51,031::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:54:51,031::task::1185::TaskManager.Task::(prepare) Task=`b6eae462-a0b8-4c96-bed5-ecdaa2d49bb9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:54:51,031::task::595::TaskManager.Task::(_updateState) Task=`b6eae462-a0b8-4c96-bed5-ecdaa2d49bb9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:54:51,032::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:54:51,032::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:54:51,032::task::990::TaskManager.Task::(_decref) Task=`b6eae462-a0b8-4c96-bed5-ecdaa2d49bb9`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:54:51,067::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:54:51,067::task::595::TaskManager.Task::(_updateState) Task=`c78dd82c-4ba9-47d6-b3e1-7faf89198e40`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:54:51,067::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:54:51,068::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d72fb3ff-7ad9-477a-989d-5ffc4ca1be47`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:54:51,068::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:54:51,068::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:54:51,068::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d72fb3ff-7ad9-477a-989d-5ffc4ca1be47`::Granted request >Thread-34::DEBUG::2014-07-24 10:54:51,069::task::827::TaskManager.Task::(resourceAcquired) Task=`c78dd82c-4ba9-47d6-b3e1-7faf89198e40`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:54:51,069::task::990::TaskManager.Task::(_decref) Task=`c78dd82c-4ba9-47d6-b3e1-7faf89198e40`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:54:51,069::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:54:51,070::task::1185::TaskManager.Task::(prepare) Task=`c78dd82c-4ba9-47d6-b3e1-7faf89198e40`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:54:51,070::task::595::TaskManager.Task::(_updateState) Task=`c78dd82c-4ba9-47d6-b3e1-7faf89198e40`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:54:51,070::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:54:51,070::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:54:51,070::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:54:51,070::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:54:51,071::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:54:51,071::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:54:51,071::task::990::TaskManager.Task::(_decref) Task=`c78dd82c-4ba9-47d6-b3e1-7faf89198e40`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:54:52,207::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:54:52,300::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368966 s, 27.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:54:54,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:54:54,388::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365969 s, 28.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:54:56,400::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:54:56,474::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353124 s, 29.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:54:57,633::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:54:58,487::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:54:58,559::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334247 s, 30.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:54:59,483::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:54:59,504::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0114468 s, 358 kB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 10:54:59,601::task::595::TaskManager.Task::(_updateState) Task=`247db9a8-beab-42a9-875b-9be9b5af32f4`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 10:54:59,602::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 10:54:59,602::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:54:59,602::task::1185::TaskManager.Task::(prepare) Task=`247db9a8-beab-42a9-875b-9be9b5af32f4`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:54:59,602::task::595::TaskManager.Task::(_updateState) Task=`247db9a8-beab-42a9-875b-9be9b5af32f4`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 10:54:59,602::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 10:54:59,603::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 10:54:59,603::task::990::TaskManager.Task::(_decref) Task=`247db9a8-beab-42a9-875b-9be9b5af32f4`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:55:00,571::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:55:00,645::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339181 s, 30.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:55:01,132::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:55:01,133::task::595::TaskManager.Task::(_updateState) Task=`ecf7e128-4330-4e55-9f2e-591fbf7bbaeb`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:55:01,133::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:55:01,133::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:55:01,134::task::1185::TaskManager.Task::(prepare) Task=`ecf7e128-4330-4e55-9f2e-591fbf7bbaeb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:55:01,134::task::595::TaskManager.Task::(_updateState) Task=`ecf7e128-4330-4e55-9f2e-591fbf7bbaeb`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:55:01,134::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:55:01,134::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:55:01,134::task::990::TaskManager.Task::(_decref) Task=`ecf7e128-4330-4e55-9f2e-591fbf7bbaeb`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:55:01,166::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:55:01,166::task::595::TaskManager.Task::(_updateState) Task=`41981d80-4c4c-442f-8cc3-a7f7bd9a4645`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:55:01,166::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:55:01,166::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`21a35e20-3e68-43eb-b008-905b3f6e75c6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:55:01,167::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:55:01,167::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:55:01,167::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`21a35e20-3e68-43eb-b008-905b3f6e75c6`::Granted request >Thread-34::DEBUG::2014-07-24 10:55:01,167::task::827::TaskManager.Task::(resourceAcquired) Task=`41981d80-4c4c-442f-8cc3-a7f7bd9a4645`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:55:01,167::task::990::TaskManager.Task::(_decref) Task=`41981d80-4c4c-442f-8cc3-a7f7bd9a4645`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:55:01,168::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:55:01,168::task::1185::TaskManager.Task::(prepare) Task=`41981d80-4c4c-442f-8cc3-a7f7bd9a4645`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:55:01,169::task::595::TaskManager.Task::(_updateState) Task=`41981d80-4c4c-442f-8cc3-a7f7bd9a4645`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:55:01,169::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:55:01,169::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:55:01,169::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:55:01,169::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:55:01,169::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:55:01,170::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:55:01,170::task::990::TaskManager.Task::(_decref) Task=`41981d80-4c4c-442f-8cc3-a7f7bd9a4645`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 10:55:01,714::task::595::TaskManager.Task::(_updateState) Task=`3d924c59-f0f4-495c-8ae4-b41ae6ac3d05`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:55:01,714::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:55:01,714::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0114468', 'lastCheck': '2.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:55:01,715::task::1185::TaskManager.Task::(prepare) Task=`3d924c59-f0f4-495c-8ae4-b41ae6ac3d05`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0114468', 'lastCheck': '2.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:55:01,715::task::595::TaskManager.Task::(_updateState) Task=`3d924c59-f0f4-495c-8ae4-b41ae6ac3d05`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:55:01,715::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:55:01,715::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:55:01,715::task::990::TaskManager.Task::(_decref) Task=`3d924c59-f0f4-495c-8ae4-b41ae6ac3d05`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:55:02,657::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:55:02,732::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355778 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:55:04,744::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:55:04,820::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359577 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:55:06,833::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:55:06,908::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359823 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:55:08,920::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:55:08,995::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360863 s, 28.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:55:09,509::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:55:09,518::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000812245 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:55:11,007::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:55:11,088::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343262 s, 29.8 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:55:11,270::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:55:11,270::task::595::TaskManager.Task::(_updateState) Task=`540ac971-f1e2-49a6-8a17-d026ac427144`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:55:11,271::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:55:11,271::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:55:11,271::task::1185::TaskManager.Task::(prepare) Task=`540ac971-f1e2-49a6-8a17-d026ac427144`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:55:11,271::task::595::TaskManager.Task::(_updateState) Task=`540ac971-f1e2-49a6-8a17-d026ac427144`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:55:11,271::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:55:11,272::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:55:11,272::task::990::TaskManager.Task::(_decref) Task=`540ac971-f1e2-49a6-8a17-d026ac427144`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:55:11,335::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:55:11,335::task::595::TaskManager.Task::(_updateState) Task=`60f174f2-236c-4f6f-bccc-6b968a99de3d`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:55:11,335::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:55:11,335::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e091be98-1252-426a-9f60-70bc8662771c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:55:11,336::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:55:11,336::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:55:11,336::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e091be98-1252-426a-9f60-70bc8662771c`::Granted request >Thread-34::DEBUG::2014-07-24 10:55:11,336::task::827::TaskManager.Task::(resourceAcquired) Task=`60f174f2-236c-4f6f-bccc-6b968a99de3d`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:55:11,337::task::990::TaskManager.Task::(_decref) Task=`60f174f2-236c-4f6f-bccc-6b968a99de3d`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:55:11,337::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:55:11,337::task::1185::TaskManager.Task::(prepare) Task=`60f174f2-236c-4f6f-bccc-6b968a99de3d`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:55:11,338::task::595::TaskManager.Task::(_updateState) Task=`60f174f2-236c-4f6f-bccc-6b968a99de3d`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:55:11,338::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:55:11,338::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:55:11,338::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:55:11,338::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:55:11,339::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:55:11,339::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:55:11,339::task::990::TaskManager.Task::(_decref) Task=`60f174f2-236c-4f6f-bccc-6b968a99de3d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:55:13,101::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:55:13,174::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341044 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:55:15,186::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:55:15,260::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337769 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:55:17,272::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-13::DEBUG::2014-07-24 10:55:17,346::task::595::TaskManager.Task::(_updateState) Task=`f4b50d26-f8c9-4f4e-b3a3-5337c34c6eb7`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:55:17,347::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:55:17,348::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000812245', 'lastCheck': '7.8', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:55:17,349::task::1185::TaskManager.Task::(prepare) Task=`f4b50d26-f8c9-4f4e-b3a3-5337c34c6eb7`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000812245', 'lastCheck': '7.8', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:55:17,349::task::595::TaskManager.Task::(_updateState) Task=`f4b50d26-f8c9-4f4e-b3a3-5337c34c6eb7`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:55:17,350::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:55:17,351::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:55:17,351::task::990::TaskManager.Task::(_decref) Task=`f4b50d26-f8c9-4f4e-b3a3-5337c34c6eb7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:55:17,366::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034635 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:55:19,378::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:55:19,452::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351704 s, 29.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:55:19,523::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:55:19,547::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0147324 s, 278 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:55:21,419::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:55:21,420::task::595::TaskManager.Task::(_updateState) Task=`a36e1a2f-18e9-498b-b845-a52f1149d2cb`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:55:21,420::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:55:21,420::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:55:21,421::task::1185::TaskManager.Task::(prepare) Task=`a36e1a2f-18e9-498b-b845-a52f1149d2cb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:55:21,421::task::595::TaskManager.Task::(_updateState) Task=`a36e1a2f-18e9-498b-b845-a52f1149d2cb`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:55:21,421::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:55:21,421::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:55:21,421::task::990::TaskManager.Task::(_decref) Task=`a36e1a2f-18e9-498b-b845-a52f1149d2cb`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:55:21,458::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:55:21,458::task::595::TaskManager.Task::(_updateState) Task=`1f38d2c3-14e9-4528-9e81-9b42db0f221f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:55:21,458::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:55:21,459::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b144304c-717d-4950-8925-207b49d62a6c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:55:21,459::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:55:21,459::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:55:21,459::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b144304c-717d-4950-8925-207b49d62a6c`::Granted request >Thread-34::DEBUG::2014-07-24 10:55:21,460::task::827::TaskManager.Task::(resourceAcquired) Task=`1f38d2c3-14e9-4528-9e81-9b42db0f221f`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:55:21,460::task::990::TaskManager.Task::(_decref) Task=`1f38d2c3-14e9-4528-9e81-9b42db0f221f`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:55:21,461::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:55:21,461::task::1185::TaskManager.Task::(prepare) Task=`1f38d2c3-14e9-4528-9e81-9b42db0f221f`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:55:21,461::task::595::TaskManager.Task::(_updateState) Task=`1f38d2c3-14e9-4528-9e81-9b42db0f221f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:55:21,461::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:55:21,461::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:55:21,462::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:55:21,462::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:55:21,462::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:55:21,462::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:55:21,462::task::990::TaskManager.Task::(_decref) Task=`1f38d2c3-14e9-4528-9e81-9b42db0f221f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:55:21,464::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:55:21,538::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342785 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:55:23,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:55:23,625::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346899 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:55:25,637::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:55:25,716::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0378481 s, 27.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:55:27,668::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:55:27,729::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:55:27,805::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355319 s, 28.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:55:29,551::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:55:29,561::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000753049 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:55:29,817::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:55:29,893::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03637 s, 28.2 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:55:31,529::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:55:31,529::task::595::TaskManager.Task::(_updateState) Task=`b388440c-623c-4d61-b47f-51f3add1836d`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:55:31,529::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:55:31,530::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:55:31,530::task::1185::TaskManager.Task::(prepare) Task=`b388440c-623c-4d61-b47f-51f3add1836d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:55:31,530::task::595::TaskManager.Task::(_updateState) Task=`b388440c-623c-4d61-b47f-51f3add1836d`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:55:31,530::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:55:31,530::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:55:31,530::task::990::TaskManager.Task::(_decref) Task=`b388440c-623c-4d61-b47f-51f3add1836d`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:55:31,573::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:55:31,573::task::595::TaskManager.Task::(_updateState) Task=`55618eef-98ab-4173-9356-f047df58134d`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:55:31,573::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:55:31,574::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`93f9d9a5-4d8a-48b8-9fbf-00e9de107789`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:55:31,574::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:55:31,574::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:55:31,574::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`93f9d9a5-4d8a-48b8-9fbf-00e9de107789`::Granted request >Thread-34::DEBUG::2014-07-24 10:55:31,575::task::827::TaskManager.Task::(resourceAcquired) Task=`55618eef-98ab-4173-9356-f047df58134d`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:55:31,575::task::990::TaskManager.Task::(_decref) Task=`55618eef-98ab-4173-9356-f047df58134d`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:55:31,576::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:55:31,576::task::1185::TaskManager.Task::(prepare) Task=`55618eef-98ab-4173-9356-f047df58134d`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:55:31,576::task::595::TaskManager.Task::(_updateState) Task=`55618eef-98ab-4173-9356-f047df58134d`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:55:31,576::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:55:31,576::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:55:31,576::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:55:31,577::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:55:31,577::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:55:31,577::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:55:31,577::task::990::TaskManager.Task::(_decref) Task=`55618eef-98ab-4173-9356-f047df58134d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:55:31,903::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:55:31,977::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339286 s, 30.2 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:55:32,763::task::595::TaskManager.Task::(_updateState) Task=`27db32a4-96a3-4ebd-a5f2-04bf1a8ccab2`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:55:32,764::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:55:32,764::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000753049', 'lastCheck': '3.2', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:55:32,764::task::1185::TaskManager.Task::(prepare) Task=`27db32a4-96a3-4ebd-a5f2-04bf1a8ccab2`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000753049', 'lastCheck': '3.2', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:55:32,764::task::595::TaskManager.Task::(_updateState) Task=`27db32a4-96a3-4ebd-a5f2-04bf1a8ccab2`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:55:32,764::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:55:32,764::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:55:32,765::task::990::TaskManager.Task::(_decref) Task=`27db32a4-96a3-4ebd-a5f2-04bf1a8ccab2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:55:33,989::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:55:34,064::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355759 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:55:36,076::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:55:36,151::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360498 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:55:38,163::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:55:38,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336552 s, 30.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:55:39,565::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:55:39,574::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00063468 s, 6.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:55:40,248::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:55:40,321::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341927 s, 29.9 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:55:41,642::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:55:41,642::task::595::TaskManager.Task::(_updateState) Task=`9cd32c51-bbb5-4205-93e2-e3e9c60f66a5`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:55:41,642::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:55:41,643::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:55:41,643::task::1185::TaskManager.Task::(prepare) Task=`9cd32c51-bbb5-4205-93e2-e3e9c60f66a5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:55:41,643::task::595::TaskManager.Task::(_updateState) Task=`9cd32c51-bbb5-4205-93e2-e3e9c60f66a5`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:55:41,643::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:55:41,643::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:55:41,643::task::990::TaskManager.Task::(_decref) Task=`9cd32c51-bbb5-4205-93e2-e3e9c60f66a5`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:55:41,675::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:55:41,675::task::595::TaskManager.Task::(_updateState) Task=`0595bbd7-526b-47f4-b731-6a7e3f8e3c5a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:55:41,675::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:55:41,676::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`8e945de9-a287-460c-8cf7-517982835be7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:55:41,676::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:55:41,676::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:55:41,676::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`8e945de9-a287-460c-8cf7-517982835be7`::Granted request >Thread-34::DEBUG::2014-07-24 10:55:41,676::task::827::TaskManager.Task::(resourceAcquired) Task=`0595bbd7-526b-47f4-b731-6a7e3f8e3c5a`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:55:41,677::task::990::TaskManager.Task::(_decref) Task=`0595bbd7-526b-47f4-b731-6a7e3f8e3c5a`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:55:41,677::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:55:41,678::task::1185::TaskManager.Task::(prepare) Task=`0595bbd7-526b-47f4-b731-6a7e3f8e3c5a`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:55:41,678::task::595::TaskManager.Task::(_updateState) Task=`0595bbd7-526b-47f4-b731-6a7e3f8e3c5a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:55:41,678::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:55:41,678::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:55:41,678::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:55:41,678::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:55:41,679::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:55:41,679::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:55:41,679::task::990::TaskManager.Task::(_decref) Task=`0595bbd7-526b-47f4-b731-6a7e3f8e3c5a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:55:42,333::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:55:42,407::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345775 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:55:44,419::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:55:44,496::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0384698 s, 26.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:55:46,509::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:55:46,582::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347405 s, 29.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:55:48,204::task::595::TaskManager.Task::(_updateState) Task=`f8c0484d-05ff-4472-bf0b-6f31f614e3b8`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:55:48,204::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:55:48,204::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00063468', 'lastCheck': '8.6', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:55:48,205::task::1185::TaskManager.Task::(prepare) Task=`f8c0484d-05ff-4472-bf0b-6f31f614e3b8`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00063468', 'lastCheck': '8.6', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:55:48,205::task::595::TaskManager.Task::(_updateState) Task=`f8c0484d-05ff-4472-bf0b-6f31f614e3b8`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:55:48,205::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:55:48,205::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:55:48,205::task::990::TaskManager.Task::(_decref) Task=`f8c0484d-05ff-4472-bf0b-6f31f614e3b8`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:55:48,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:55:48,676::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0423555 s, 24.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:55:49,579::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:55:49,588::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000693939 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:55:50,688::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:55:51,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.323638 s, 3.2 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:55:51,736::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [22918c4c] >Thread-13::DEBUG::2014-07-24 10:55:51,737::task::595::TaskManager.Task::(_updateState) Task=`e4edf6ba-14ac-43d0-aba4-b98a28b645a5`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:55:51,738::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:55:51,738::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:55:51,738::task::1185::TaskManager.Task::(prepare) Task=`e4edf6ba-14ac-43d0-aba4-b98a28b645a5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:55:51,739::task::595::TaskManager.Task::(_updateState) Task=`e4edf6ba-14ac-43d0-aba4-b98a28b645a5`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:55:51,739::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:55:51,739::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:55:51,739::task::990::TaskManager.Task::(_decref) Task=`e4edf6ba-14ac-43d0-aba4-b98a28b645a5`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:55:51,787::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [22918c4c] >Thread-34::DEBUG::2014-07-24 10:55:51,788::task::595::TaskManager.Task::(_updateState) Task=`0d53980a-e338-4541-994e-6dca5d8a9607`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:55:51,788::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:55:51,788::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`5cb32155-507a-4d5a-baea-15d69156df48`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:55:51,788::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:55:51,790::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:55:51,790::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`5cb32155-507a-4d5a-baea-15d69156df48`::Granted request >Thread-34::DEBUG::2014-07-24 10:55:51,790::task::827::TaskManager.Task::(resourceAcquired) Task=`0d53980a-e338-4541-994e-6dca5d8a9607`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:55:51,791::task::990::TaskManager.Task::(_decref) Task=`0d53980a-e338-4541-994e-6dca5d8a9607`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:55:51,791::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:55:51,792::task::1185::TaskManager.Task::(prepare) Task=`0d53980a-e338-4541-994e-6dca5d8a9607`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:55:51,792::task::595::TaskManager.Task::(_updateState) Task=`0d53980a-e338-4541-994e-6dca5d8a9607`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:55:51,792::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:55:51,792::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:55:51,792::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:55:51,792::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:55:51,793::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:55:51,793::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:55:51,793::task::990::TaskManager.Task::(_decref) Task=`0d53980a-e338-4541-994e-6dca5d8a9607`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:55:53,064::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:55:53,140::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361384 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:55:55,152::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:55:55,224::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334909 s, 30.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:55:57,237::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:55:57,310::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337413 s, 30.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:55:57,705::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:55:59,322::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:55:59,397::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358639 s, 28.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:55:59,593::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:55:59,605::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00296319 s, 1.4 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 10:55:59,751::task::595::TaskManager.Task::(_updateState) Task=`5ad87f0f-4bd4-48e8-aaaf-cc1838dc8129`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 10:55:59,751::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 10:55:59,752::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:55:59,753::task::1185::TaskManager.Task::(prepare) Task=`5ad87f0f-4bd4-48e8-aaaf-cc1838dc8129`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:55:59,753::task::595::TaskManager.Task::(_updateState) Task=`5ad87f0f-4bd4-48e8-aaaf-cc1838dc8129`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 10:55:59,753::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 10:55:59,753::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 10:55:59,753::task::990::TaskManager.Task::(_decref) Task=`5ad87f0f-4bd4-48e8-aaaf-cc1838dc8129`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:56:01,409::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:56:01,484::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348018 s, 29.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:56:01,847::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [4376fa5] >Thread-14::DEBUG::2014-07-24 10:56:01,847::task::595::TaskManager.Task::(_updateState) Task=`20fd6a5c-8d0c-40e7-8568-a17ac55bb049`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:56:01,848::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:56:01,848::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:56:01,848::task::1185::TaskManager.Task::(prepare) Task=`20fd6a5c-8d0c-40e7-8568-a17ac55bb049`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:56:01,848::task::595::TaskManager.Task::(_updateState) Task=`20fd6a5c-8d0c-40e7-8568-a17ac55bb049`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:56:01,848::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:56:01,849::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:56:01,849::task::990::TaskManager.Task::(_decref) Task=`20fd6a5c-8d0c-40e7-8568-a17ac55bb049`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:56:01,881::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [4376fa5] >Thread-34::DEBUG::2014-07-24 10:56:01,881::task::595::TaskManager.Task::(_updateState) Task=`2ebc695a-627d-43ab-a6c0-a3bd463f6bd7`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:56:01,881::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:56:01,882::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`181b225a-5407-44c9-91ed-edd3e83a1dd3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:56:01,882::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:56:01,882::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:56:01,882::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`181b225a-5407-44c9-91ed-edd3e83a1dd3`::Granted request >Thread-34::DEBUG::2014-07-24 10:56:01,883::task::827::TaskManager.Task::(resourceAcquired) Task=`2ebc695a-627d-43ab-a6c0-a3bd463f6bd7`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:56:01,883::task::990::TaskManager.Task::(_decref) Task=`2ebc695a-627d-43ab-a6c0-a3bd463f6bd7`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:56:01,884::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:56:01,884::task::1185::TaskManager.Task::(prepare) Task=`2ebc695a-627d-43ab-a6c0-a3bd463f6bd7`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:56:01,884::task::595::TaskManager.Task::(_updateState) Task=`2ebc695a-627d-43ab-a6c0-a3bd463f6bd7`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:56:01,884::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:56:01,884::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:56:01,884::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:56:01,885::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:56:01,885::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:56:01,885::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:56:01,885::task::990::TaskManager.Task::(_decref) Task=`2ebc695a-627d-43ab-a6c0-a3bd463f6bd7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:56:03,496::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:56:03,569::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340321 s, 30.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:56:04,021::task::595::TaskManager.Task::(_updateState) Task=`7724b4cf-6d20-4c65-9499-0d4a0f79062e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:56:04,021::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:56:04,021::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00296319', 'lastCheck': '4.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:56:04,022::task::1185::TaskManager.Task::(prepare) Task=`7724b4cf-6d20-4c65-9499-0d4a0f79062e`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00296319', 'lastCheck': '4.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:56:04,022::task::595::TaskManager.Task::(_updateState) Task=`7724b4cf-6d20-4c65-9499-0d4a0f79062e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:56:04,022::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:56:04,022::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:56:04,022::task::990::TaskManager.Task::(_decref) Task=`7724b4cf-6d20-4c65-9499-0d4a0f79062e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:56:05,581::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:56:05,670::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0433441 s, 23.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:56:07,682::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:56:07,756::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344992 s, 29.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:56:09,610::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 23aa0606-edc3-4882-a4aa-18aa1983458f >Thread-18::DEBUG::2014-07-24 10:56:09,610::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-18::DEBUG::2014-07-24 10:56:09,611::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:56:09,631::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.01183 s, 173 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:56:09,631::misc::264::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.01183 s, 173 kB/s'], size: 2048 >Thread-18::DEBUG::2014-07-24 10:56:09,631::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-18::WARNING::2014-07-24 10:56:09,631::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-18::DEBUG::2014-07-24 10:56:09,632::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-18::DEBUG::2014-07-24 10:56:09,632::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 10:56:09,632::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 10:56:09,632::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 10:56:09,633::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 10:56:09,633::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 10:56:09,633::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:56:09,769::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:56:09,846::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367537 s, 27.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:56:09,877::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:56:09,878::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 10:56:09,879::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'LOCKPOLICY=', 'POOL_DOMAINS=23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'POOL_DESCRIPTION=DS1', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_UUID=637ea13c-81a8-4b44-8cab-961458b01883', 'POOL_SPM_ID=1', '_SHA_CKSUM=a749afdc7119a2d6aad840af5c63c9b28c0b612c', 'POOL_SPM_LVER=0'] >Thread-18::INFO::2014-07-24 10:56:09,880::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_imageNS already registered >Thread-18::INFO::2014-07-24 10:56:09,880::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_volumeNS already registered >Thread-18::INFO::2014-07-24 10:56:09,880::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_lvmActivationNS already registered >Thread-18::DEBUG::2014-07-24 10:56:09,880::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-18::DEBUG::2014-07-24 10:56:10,037::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:56:10,038::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:56:10,047::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000836521 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:56:11,859::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:56:11,934::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353335 s, 29.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:56:11,945::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:56:11,946::task::595::TaskManager.Task::(_updateState) Task=`48504fa2-6f40-4463-bb43-0e1f65023145`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:56:11,946::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:56:11,946::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:56:11,946::task::1185::TaskManager.Task::(prepare) Task=`48504fa2-6f40-4463-bb43-0e1f65023145`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:56:11,947::task::595::TaskManager.Task::(_updateState) Task=`48504fa2-6f40-4463-bb43-0e1f65023145`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:56:11,947::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:56:11,947::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:56:11,947::task::990::TaskManager.Task::(_decref) Task=`48504fa2-6f40-4463-bb43-0e1f65023145`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:56:11,983::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:56:11,984::task::595::TaskManager.Task::(_updateState) Task=`31e8eab2-4f46-42bf-b53e-27c3b4badb6f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:56:11,984::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:56:11,984::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e6d55c72-fb82-44d2-a21d-aeee3171cef1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:56:11,984::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:56:11,985::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:56:11,985::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e6d55c72-fb82-44d2-a21d-aeee3171cef1`::Granted request >Thread-34::DEBUG::2014-07-24 10:56:11,985::task::827::TaskManager.Task::(resourceAcquired) Task=`31e8eab2-4f46-42bf-b53e-27c3b4badb6f`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:56:11,985::task::990::TaskManager.Task::(_decref) Task=`31e8eab2-4f46-42bf-b53e-27c3b4badb6f`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:56:11,986::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:56:11,986::task::1185::TaskManager.Task::(prepare) Task=`31e8eab2-4f46-42bf-b53e-27c3b4badb6f`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:56:11,986::task::595::TaskManager.Task::(_updateState) Task=`31e8eab2-4f46-42bf-b53e-27c3b4badb6f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:56:11,987::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:56:11,987::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:56:11,987::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:56:11,987::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:56:11,987::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:56:11,987::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:56:11,988::task::990::TaskManager.Task::(_decref) Task=`31e8eab2-4f46-42bf-b53e-27c3b4badb6f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:56:13,946::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:56:14,021::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357577 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:56:16,033::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:56:16,107::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340953 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:56:18,119::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:56:18,194::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363394 s, 28.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:56:19,403::task::595::TaskManager.Task::(_updateState) Task=`f51f4701-1a4f-4371-bf1f-f326717ba3df`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:56:19,403::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:56:19,403::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000836521', 'lastCheck': '9.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:56:19,403::task::1185::TaskManager.Task::(prepare) Task=`f51f4701-1a4f-4371-bf1f-f326717ba3df`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000836521', 'lastCheck': '9.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:56:19,404::task::595::TaskManager.Task::(_updateState) Task=`f51f4701-1a4f-4371-bf1f-f326717ba3df`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:56:19,404::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:56:19,404::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:56:19,404::task::990::TaskManager.Task::(_decref) Task=`f51f4701-1a4f-4371-bf1f-f326717ba3df`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 10:56:20,054::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:56:20,073::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0102522 s, 400 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:56:20,207::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:56:20,282::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366374 s, 27.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:56:22,046::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [1487b3f5] >Thread-14::DEBUG::2014-07-24 10:56:22,047::task::595::TaskManager.Task::(_updateState) Task=`623f55e2-c481-4ce6-9a38-79fa6a76ac97`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:56:22,047::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:56:22,047::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:56:22,048::task::1185::TaskManager.Task::(prepare) Task=`623f55e2-c481-4ce6-9a38-79fa6a76ac97`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:56:22,048::task::595::TaskManager.Task::(_updateState) Task=`623f55e2-c481-4ce6-9a38-79fa6a76ac97`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:56:22,048::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:56:22,048::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:56:22,048::task::990::TaskManager.Task::(_decref) Task=`623f55e2-c481-4ce6-9a38-79fa6a76ac97`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:56:22,079::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [1487b3f5] >Thread-34::DEBUG::2014-07-24 10:56:22,080::task::595::TaskManager.Task::(_updateState) Task=`5d2305c8-b717-4ac9-a631-2126fa1ce49c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:56:22,080::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:56:22,080::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`bb88cb20-750e-407a-8b2d-5c945860472f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:56:22,080::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:56:22,081::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:56:22,081::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`bb88cb20-750e-407a-8b2d-5c945860472f`::Granted request >Thread-34::DEBUG::2014-07-24 10:56:22,081::task::827::TaskManager.Task::(resourceAcquired) Task=`5d2305c8-b717-4ac9-a631-2126fa1ce49c`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:56:22,081::task::990::TaskManager.Task::(_decref) Task=`5d2305c8-b717-4ac9-a631-2126fa1ce49c`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:56:22,082::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:56:22,082::task::1185::TaskManager.Task::(prepare) Task=`5d2305c8-b717-4ac9-a631-2126fa1ce49c`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:56:22,082::task::595::TaskManager.Task::(_updateState) Task=`5d2305c8-b717-4ac9-a631-2126fa1ce49c`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:56:22,082::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:56:22,083::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:56:22,083::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:56:22,083::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:56:22,083::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:56:22,083::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:56:22,084::task::990::TaskManager.Task::(_decref) Task=`5d2305c8-b717-4ac9-a631-2126fa1ce49c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:56:22,295::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:56:22,370::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363917 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:56:24,383::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:56:24,455::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340281 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:56:26,468::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:56:26,543::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035516 s, 28.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:56:27,742::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:56:28,555::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:56:28,628::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344288 s, 29.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:56:30,078::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:56:30,098::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0117189 s, 350 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:56:30,640::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:56:30,714::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034002 s, 30.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:56:32,140::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:56:32,141::task::595::TaskManager.Task::(_updateState) Task=`d9ed1b0a-7e27-409b-b404-85f84ab2df3c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:56:32,141::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:56:32,142::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:56:32,142::task::1185::TaskManager.Task::(prepare) Task=`d9ed1b0a-7e27-409b-b404-85f84ab2df3c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:56:32,142::task::595::TaskManager.Task::(_updateState) Task=`d9ed1b0a-7e27-409b-b404-85f84ab2df3c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:56:32,142::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:56:32,142::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:56:32,142::task::990::TaskManager.Task::(_decref) Task=`d9ed1b0a-7e27-409b-b404-85f84ab2df3c`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:56:32,173::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:56:32,174::task::595::TaskManager.Task::(_updateState) Task=`d99fc691-951a-4d1c-9e57-13a4077f6b6e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:56:32,174::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:56:32,174::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`70faaf69-433c-46e2-bb37-595fc604095d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:56:32,174::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:56:32,175::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:56:32,175::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`70faaf69-433c-46e2-bb37-595fc604095d`::Granted request >Thread-34::DEBUG::2014-07-24 10:56:32,175::task::827::TaskManager.Task::(resourceAcquired) Task=`d99fc691-951a-4d1c-9e57-13a4077f6b6e`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:56:32,175::task::990::TaskManager.Task::(_decref) Task=`d99fc691-951a-4d1c-9e57-13a4077f6b6e`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:56:32,176::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:56:32,176::task::1185::TaskManager.Task::(prepare) Task=`d99fc691-951a-4d1c-9e57-13a4077f6b6e`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:56:32,176::task::595::TaskManager.Task::(_updateState) Task=`d99fc691-951a-4d1c-9e57-13a4077f6b6e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:56:32,176::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:56:32,177::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:56:32,177::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:56:32,177::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:56:32,177::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:56:32,177::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:56:32,177::task::990::TaskManager.Task::(_decref) Task=`d99fc691-951a-4d1c-9e57-13a4077f6b6e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:56:32,727::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:56:32,801::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354755 s, 28.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:56:34,782::task::595::TaskManager.Task::(_updateState) Task=`201f6789-4692-46a0-89e6-6531d311a938`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:56:34,782::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:56:34,782::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0117189', 'lastCheck': '4.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:56:34,783::task::1185::TaskManager.Task::(prepare) Task=`201f6789-4692-46a0-89e6-6531d311a938`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0117189', 'lastCheck': '4.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:56:34,783::task::595::TaskManager.Task::(_updateState) Task=`201f6789-4692-46a0-89e6-6531d311a938`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:56:34,783::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:56:34,783::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:56:34,783::task::990::TaskManager.Task::(_decref) Task=`201f6789-4692-46a0-89e6-6531d311a938`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:56:34,813::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:56:34,887::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339823 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:56:36,898::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:56:36,980::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0431726 s, 23.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:56:38,993::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:56:39,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0408147 s, 25.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:56:40,102::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:56:40,123::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.012374 s, 331 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:56:41,087::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:56:41,167::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0410392 s, 25.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:56:42,232::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:56:42,233::task::595::TaskManager.Task::(_updateState) Task=`976cbedc-7db7-4404-8d73-7c804d1d126c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:56:42,233::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:56:42,233::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:56:42,234::task::1185::TaskManager.Task::(prepare) Task=`976cbedc-7db7-4404-8d73-7c804d1d126c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:56:42,234::task::595::TaskManager.Task::(_updateState) Task=`976cbedc-7db7-4404-8d73-7c804d1d126c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:56:42,234::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:56:42,234::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:56:42,234::task::990::TaskManager.Task::(_decref) Task=`976cbedc-7db7-4404-8d73-7c804d1d126c`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:56:42,268::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:56:42,268::task::595::TaskManager.Task::(_updateState) Task=`7de9211e-3d61-481f-b212-aa73a1e05c0c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:56:42,268::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:56:42,269::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4a8cc75c-06b5-4f3b-9ace-5909990e369f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:56:42,269::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:56:42,269::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:56:42,269::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4a8cc75c-06b5-4f3b-9ace-5909990e369f`::Granted request >Thread-34::DEBUG::2014-07-24 10:56:42,270::task::827::TaskManager.Task::(resourceAcquired) Task=`7de9211e-3d61-481f-b212-aa73a1e05c0c`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:56:42,270::task::990::TaskManager.Task::(_decref) Task=`7de9211e-3d61-481f-b212-aa73a1e05c0c`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:56:42,271::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:56:42,271::task::1185::TaskManager.Task::(prepare) Task=`7de9211e-3d61-481f-b212-aa73a1e05c0c`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:56:42,271::task::595::TaskManager.Task::(_updateState) Task=`7de9211e-3d61-481f-b212-aa73a1e05c0c`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:56:42,271::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:56:42,271::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:56:42,272::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:56:42,272::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:56:42,272::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:56:42,272::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:56:42,272::task::990::TaskManager.Task::(_decref) Task=`7de9211e-3d61-481f-b212-aa73a1e05c0c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:56:43,183::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:56:43,263::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0406409 s, 25.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:56:45,276::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:56:45,357::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0400498 s, 25.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:56:47,370::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:56:47,447::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0378678 s, 27.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:56:49,459::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:56:49,535::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367592 s, 27.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:56:50,128::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:56:50,148::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0122078 s, 336 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:56:50,162::task::595::TaskManager.Task::(_updateState) Task=`b8bf406f-5a3c-45e5-8271-69bfe216b8a7`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:56:50,162::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 10:56:50,162::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0122078', 'lastCheck': '0.0', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:56:50,162::task::1185::TaskManager.Task::(prepare) Task=`b8bf406f-5a3c-45e5-8271-69bfe216b8a7`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0122078', 'lastCheck': '0.0', 'valid': True}} >Thread-14::DEBUG::2014-07-24 10:56:50,163::task::595::TaskManager.Task::(_updateState) Task=`b8bf406f-5a3c-45e5-8271-69bfe216b8a7`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:56:50,163::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:56:50,163::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:56:50,163::task::990::TaskManager.Task::(_decref) Task=`b8bf406f-5a3c-45e5-8271-69bfe216b8a7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:56:51,547::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:56:51,621::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339959 s, 30.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:56:52,326::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [12b68a95] >Thread-14::DEBUG::2014-07-24 10:56:52,327::task::595::TaskManager.Task::(_updateState) Task=`ab2a104b-d069-45a6-9a59-e148a9906ea9`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:56:52,327::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:56:52,327::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:56:52,327::task::1185::TaskManager.Task::(prepare) Task=`ab2a104b-d069-45a6-9a59-e148a9906ea9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:56:52,328::task::595::TaskManager.Task::(_updateState) Task=`ab2a104b-d069-45a6-9a59-e148a9906ea9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:56:52,328::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:56:52,328::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:56:52,328::task::990::TaskManager.Task::(_decref) Task=`ab2a104b-d069-45a6-9a59-e148a9906ea9`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:56:52,416::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [12b68a95] >Thread-34::DEBUG::2014-07-24 10:56:52,416::task::595::TaskManager.Task::(_updateState) Task=`abad3db6-8faa-47b0-ab4a-0286ce06ccd0`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:56:52,416::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:56:52,416::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`2ca4f382-2cd5-4a75-a165-ca1a4ce8fc84`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:56:52,417::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:56:52,417::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:56:52,417::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`2ca4f382-2cd5-4a75-a165-ca1a4ce8fc84`::Granted request >Thread-34::DEBUG::2014-07-24 10:56:52,417::task::827::TaskManager.Task::(resourceAcquired) Task=`abad3db6-8faa-47b0-ab4a-0286ce06ccd0`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:56:52,418::task::990::TaskManager.Task::(_decref) Task=`abad3db6-8faa-47b0-ab4a-0286ce06ccd0`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:56:52,418::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:56:52,418::task::1185::TaskManager.Task::(prepare) Task=`abad3db6-8faa-47b0-ab4a-0286ce06ccd0`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:56:52,419::task::595::TaskManager.Task::(_updateState) Task=`abad3db6-8faa-47b0-ab4a-0286ce06ccd0`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:56:52,419::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:56:52,419::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:56:52,419::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:56:52,419::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:56:52,419::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:56:52,420::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:56:52,420::task::990::TaskManager.Task::(_decref) Task=`abad3db6-8faa-47b0-ab4a-0286ce06ccd0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:56:53,633::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:56:53,709::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037272 s, 27.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:56:55,722::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:56:55,799::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353316 s, 29.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:56:57,777::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:56:57,811::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:56:57,887::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363872 s, 28.1 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 10:56:59,899::task::595::TaskManager.Task::(_updateState) Task=`454fae7e-8fd8-44ec-b963-0622dedc41b9`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 10:56:59,899::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 10:56:59,899::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:56:59,899::task::1185::TaskManager.Task::(prepare) Task=`454fae7e-8fd8-44ec-b963-0622dedc41b9`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:56:59,900::task::595::TaskManager.Task::(_updateState) Task=`454fae7e-8fd8-44ec-b963-0622dedc41b9`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 10:56:59,900::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 10:56:59,900::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 10:56:59,900::task::990::TaskManager.Task::(_decref) Task=`454fae7e-8fd8-44ec-b963-0622dedc41b9`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:56:59,901::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:56:59,978::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361268 s, 28.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:57:00,153::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:57:00,174::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.012043 s, 340 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:57:01,991::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:57:02,064::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342452 s, 29.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 10:57:02,476::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 10:57:02,477::task::595::TaskManager.Task::(_updateState) Task=`6ed70a2e-993f-45fe-99a7-98f0b1f58ae5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 10:57:02,477::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 10:57:02,477::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:57:02,477::task::1185::TaskManager.Task::(prepare) Task=`6ed70a2e-993f-45fe-99a7-98f0b1f58ae5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 10:57:02,477::task::595::TaskManager.Task::(_updateState) Task=`6ed70a2e-993f-45fe-99a7-98f0b1f58ae5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 10:57:02,478::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 10:57:02,478::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 10:57:02,478::task::990::TaskManager.Task::(_decref) Task=`6ed70a2e-993f-45fe-99a7-98f0b1f58ae5`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:57:02,534::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:57:02,534::task::595::TaskManager.Task::(_updateState) Task=`a9751a56-5dc3-481d-a50e-5b256a8366ba`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:57:02,534::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:57:02,536::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f06383ba-b53e-49d0-85ea-42ce3691e14f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:57:02,536::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:57:02,536::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:57:02,537::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f06383ba-b53e-49d0-85ea-42ce3691e14f`::Granted request >Thread-34::DEBUG::2014-07-24 10:57:02,537::task::827::TaskManager.Task::(resourceAcquired) Task=`a9751a56-5dc3-481d-a50e-5b256a8366ba`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:57:02,537::task::990::TaskManager.Task::(_decref) Task=`a9751a56-5dc3-481d-a50e-5b256a8366ba`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:57:02,538::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:57:02,538::task::1185::TaskManager.Task::(prepare) Task=`a9751a56-5dc3-481d-a50e-5b256a8366ba`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:57:02,538::task::595::TaskManager.Task::(_updateState) Task=`a9751a56-5dc3-481d-a50e-5b256a8366ba`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:57:02,538::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:57:02,538::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:57:02,539::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:57:02,539::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:57:02,539::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:57:02,539::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:57:02,539::task::990::TaskManager.Task::(_decref) Task=`a9751a56-5dc3-481d-a50e-5b256a8366ba`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:57:04,077::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:57:04,150::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346239 s, 29.6 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:57:05,562::task::595::TaskManager.Task::(_updateState) Task=`87978830-0c98-41ef-ae82-bf680a807c81`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:57:05,562::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:57:05,563::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.012043', 'lastCheck': '5.4', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:57:05,563::task::1185::TaskManager.Task::(prepare) Task=`87978830-0c98-41ef-ae82-bf680a807c81`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.012043', 'lastCheck': '5.4', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:57:05,563::task::595::TaskManager.Task::(_updateState) Task=`87978830-0c98-41ef-ae82-bf680a807c81`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:57:05,563::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:57:05,563::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:57:05,563::task::990::TaskManager.Task::(_decref) Task=`87978830-0c98-41ef-ae82-bf680a807c81`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:57:06,163::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:57:06,239::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338066 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:57:08,252::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:57:08,326::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336055 s, 30.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:57:10,179::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:57:10,188::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0006506 s, 6.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:57:10,338::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:57:10,411::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340086 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:57:12,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:57:12,499::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360526 s, 28.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:57:12,596::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:57:12,597::task::595::TaskManager.Task::(_updateState) Task=`ebfce325-e53b-4ebe-bb65-e092f0a1d980`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:57:12,597::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:57:12,598::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:57:12,598::task::1185::TaskManager.Task::(prepare) Task=`ebfce325-e53b-4ebe-bb65-e092f0a1d980`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:57:12,598::task::595::TaskManager.Task::(_updateState) Task=`ebfce325-e53b-4ebe-bb65-e092f0a1d980`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:57:12,598::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:57:12,598::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:57:12,598::task::990::TaskManager.Task::(_decref) Task=`ebfce325-e53b-4ebe-bb65-e092f0a1d980`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:57:12,631::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:57:12,632::task::595::TaskManager.Task::(_updateState) Task=`89ebe373-f17d-4ab5-bb0f-b93ccf3e4940`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:57:12,632::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:57:12,632::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`64a5e213-e018-4a77-8c28-08b80edd1d35`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:57:12,632::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:57:12,633::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:57:12,633::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`64a5e213-e018-4a77-8c28-08b80edd1d35`::Granted request >Thread-34::DEBUG::2014-07-24 10:57:12,633::task::827::TaskManager.Task::(resourceAcquired) Task=`89ebe373-f17d-4ab5-bb0f-b93ccf3e4940`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:57:12,633::task::990::TaskManager.Task::(_decref) Task=`89ebe373-f17d-4ab5-bb0f-b93ccf3e4940`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:57:12,634::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:57:12,634::task::1185::TaskManager.Task::(prepare) Task=`89ebe373-f17d-4ab5-bb0f-b93ccf3e4940`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:57:12,634::task::595::TaskManager.Task::(_updateState) Task=`89ebe373-f17d-4ab5-bb0f-b93ccf3e4940`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:57:12,634::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:57:12,635::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:57:12,635::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:57:12,635::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:57:12,635::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:57:12,635::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:57:12,636::task::990::TaskManager.Task::(_decref) Task=`89ebe373-f17d-4ab5-bb0f-b93ccf3e4940`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:57:14,512::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:57:14,585::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341377 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:57:16,597::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:57:16,674::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335591 s, 30.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:57:18,686::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:57:18,759::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335053 s, 30.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:57:20,192::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:57:20,216::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0154779 s, 265 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:57:20,789::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:57:20,898::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0654328 s, 15.6 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:57:20,935::task::595::TaskManager.Task::(_updateState) Task=`bee15c27-4640-49e7-b70f-9a6e0714716b`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:57:20,935::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:57:20,935::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0154779', 'lastCheck': '0.7', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:57:20,935::task::1185::TaskManager.Task::(prepare) Task=`bee15c27-4640-49e7-b70f-9a6e0714716b`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0154779', 'lastCheck': '0.7', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:57:20,935::task::595::TaskManager.Task::(_updateState) Task=`bee15c27-4640-49e7-b70f-9a6e0714716b`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:57:20,935::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:57:20,936::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:57:20,936::task::990::TaskManager.Task::(_decref) Task=`bee15c27-4640-49e7-b70f-9a6e0714716b`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:57:22,696::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:57:22,697::task::595::TaskManager.Task::(_updateState) Task=`6f05f68f-9866-449d-ba0c-8786a1586ef1`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:57:22,697::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:57:22,698::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:57:22,698::task::1185::TaskManager.Task::(prepare) Task=`6f05f68f-9866-449d-ba0c-8786a1586ef1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:57:22,698::task::595::TaskManager.Task::(_updateState) Task=`6f05f68f-9866-449d-ba0c-8786a1586ef1`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:57:22,698::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:57:22,698::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:57:22,698::task::990::TaskManager.Task::(_decref) Task=`6f05f68f-9866-449d-ba0c-8786a1586ef1`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:57:22,730::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:57:22,730::task::595::TaskManager.Task::(_updateState) Task=`0b3e7275-c0f4-463b-a119-60d2e0a4e824`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:57:22,730::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:57:22,731::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`0582890b-bba6-4ca5-93b7-c551dd84a0c7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:57:22,731::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:57:22,731::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:57:22,731::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`0582890b-bba6-4ca5-93b7-c551dd84a0c7`::Granted request >Thread-34::DEBUG::2014-07-24 10:57:22,732::task::827::TaskManager.Task::(resourceAcquired) Task=`0b3e7275-c0f4-463b-a119-60d2e0a4e824`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:57:22,732::task::990::TaskManager.Task::(_decref) Task=`0b3e7275-c0f4-463b-a119-60d2e0a4e824`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:57:22,733::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:57:22,733::task::1185::TaskManager.Task::(prepare) Task=`0b3e7275-c0f4-463b-a119-60d2e0a4e824`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:57:22,733::task::595::TaskManager.Task::(_updateState) Task=`0b3e7275-c0f4-463b-a119-60d2e0a4e824`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:57:22,733::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:57:22,733::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:57:22,733::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:57:22,734::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:57:22,734::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:57:22,734::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:57:22,734::task::990::TaskManager.Task::(_decref) Task=`0b3e7275-c0f4-463b-a119-60d2e0a4e824`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:57:22,911::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:57:22,985::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341789 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:57:24,997::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:57:25,073::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361877 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:57:27,085::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:57:27,159::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345589 s, 29.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:57:27,813::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:57:29,172::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:57:29,248::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365374 s, 28.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:57:30,221::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:57:30,245::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0118631 s, 345 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:57:31,260::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:57:31,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363779 s, 28.1 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:57:32,788::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:57:32,788::task::595::TaskManager.Task::(_updateState) Task=`16123278-6972-4960-9fd8-e21ef5842970`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:57:32,789::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:57:32,789::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:57:32,789::task::1185::TaskManager.Task::(prepare) Task=`16123278-6972-4960-9fd8-e21ef5842970`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:57:32,789::task::595::TaskManager.Task::(_updateState) Task=`16123278-6972-4960-9fd8-e21ef5842970`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:57:32,789::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:57:32,790::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:57:32,790::task::990::TaskManager.Task::(_decref) Task=`16123278-6972-4960-9fd8-e21ef5842970`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:57:32,825::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:57:32,826::task::595::TaskManager.Task::(_updateState) Task=`6ebc85ab-3865-4ea3-b1b8-3a163ea81bfd`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:57:32,826::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:57:32,826::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b4afb2fc-8166-4b01-be15-de8d68299735`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:57:32,826::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:57:32,827::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:57:32,827::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b4afb2fc-8166-4b01-be15-de8d68299735`::Granted request >Thread-34::DEBUG::2014-07-24 10:57:32,827::task::827::TaskManager.Task::(resourceAcquired) Task=`6ebc85ab-3865-4ea3-b1b8-3a163ea81bfd`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:57:32,827::task::990::TaskManager.Task::(_decref) Task=`6ebc85ab-3865-4ea3-b1b8-3a163ea81bfd`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:57:32,828::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:57:32,828::task::1185::TaskManager.Task::(prepare) Task=`6ebc85ab-3865-4ea3-b1b8-3a163ea81bfd`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:57:32,828::task::595::TaskManager.Task::(_updateState) Task=`6ebc85ab-3865-4ea3-b1b8-3a163ea81bfd`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:57:32,828::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:57:32,829::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:57:32,829::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:57:32,829::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:57:32,829::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:57:32,829::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:57:32,829::task::990::TaskManager.Task::(_decref) Task=`6ebc85ab-3865-4ea3-b1b8-3a163ea81bfd`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:57:33,348::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:57:33,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358095 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:57:35,436::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:57:35,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348906 s, 29.3 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:57:36,321::task::595::TaskManager.Task::(_updateState) Task=`85dface3-dfca-4287-96aa-9e3ec6a7160d`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:57:36,321::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:57:36,322::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0118631', 'lastCheck': '6.1', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:57:36,322::task::1185::TaskManager.Task::(prepare) Task=`85dface3-dfca-4287-96aa-9e3ec6a7160d`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0118631', 'lastCheck': '6.1', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:57:36,322::task::595::TaskManager.Task::(_updateState) Task=`85dface3-dfca-4287-96aa-9e3ec6a7160d`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:57:36,322::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:57:36,322::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:57:36,322::task::990::TaskManager.Task::(_decref) Task=`85dface3-dfca-4287-96aa-9e3ec6a7160d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:57:37,524::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:57:37,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.040403 s, 25.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:57:39,617::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:57:39,692::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362417 s, 28.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:57:40,252::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:57:40,266::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00617957 s, 663 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:57:41,705::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:57:41,780::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035598 s, 28.8 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:57:42,893::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:57:42,894::task::595::TaskManager.Task::(_updateState) Task=`b85786f0-4f00-4dd1-ab5e-addb4264dd01`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:57:42,894::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:57:42,894::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:57:42,894::task::1185::TaskManager.Task::(prepare) Task=`b85786f0-4f00-4dd1-ab5e-addb4264dd01`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:57:42,895::task::595::TaskManager.Task::(_updateState) Task=`b85786f0-4f00-4dd1-ab5e-addb4264dd01`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:57:42,895::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:57:42,895::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:57:42,895::task::990::TaskManager.Task::(_decref) Task=`b85786f0-4f00-4dd1-ab5e-addb4264dd01`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:57:42,926::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:57:42,926::task::595::TaskManager.Task::(_updateState) Task=`879706f4-71ad-4057-a0b2-d635d5ccd85b`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:57:42,927::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:57:42,927::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f4119a61-bbfe-4bb5-a95e-558f7a15f60b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:57:42,927::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:57:42,927::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:57:42,928::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f4119a61-bbfe-4bb5-a95e-558f7a15f60b`::Granted request >Thread-34::DEBUG::2014-07-24 10:57:42,928::task::827::TaskManager.Task::(resourceAcquired) Task=`879706f4-71ad-4057-a0b2-d635d5ccd85b`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:57:42,928::task::990::TaskManager.Task::(_decref) Task=`879706f4-71ad-4057-a0b2-d635d5ccd85b`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:57:42,929::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:57:42,929::task::1185::TaskManager.Task::(prepare) Task=`879706f4-71ad-4057-a0b2-d635d5ccd85b`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:57:42,929::task::595::TaskManager.Task::(_updateState) Task=`879706f4-71ad-4057-a0b2-d635d5ccd85b`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:57:42,929::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:57:42,929::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:57:42,930::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:57:42,930::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:57:42,930::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:57:42,930::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:57:42,930::task::990::TaskManager.Task::(_decref) Task=`879706f4-71ad-4057-a0b2-d635d5ccd85b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:57:43,792::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:57:43,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342523 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:57:45,879::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:57:45,955::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365124 s, 28.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:57:47,967::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:57:48,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.313065 s, 3.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:57:50,271::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:57:50,280::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000837912 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:57:50,332::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:57:50,408::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358493 s, 28.6 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:57:51,750::task::595::TaskManager.Task::(_updateState) Task=`3e4c87d4-ebfc-4dea-96fa-d66b6ea9c3e6`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:57:51,750::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:57:51,750::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000837912', 'lastCheck': '1.5', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:57:51,750::task::1185::TaskManager.Task::(prepare) Task=`3e4c87d4-ebfc-4dea-96fa-d66b6ea9c3e6`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000837912', 'lastCheck': '1.5', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:57:51,750::task::595::TaskManager.Task::(_updateState) Task=`3e4c87d4-ebfc-4dea-96fa-d66b6ea9c3e6`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:57:51,751::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:57:51,751::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:57:51,751::task::990::TaskManager.Task::(_decref) Task=`3e4c87d4-ebfc-4dea-96fa-d66b6ea9c3e6`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:57:52,420::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:57:52,495::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349781 s, 29.3 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:57:52,988::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:57:53,001::task::595::TaskManager.Task::(_updateState) Task=`bba16b1b-808e-47ce-aa90-3f8a033d547e`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:57:53,001::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:57:53,001::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:57:53,001::task::1185::TaskManager.Task::(prepare) Task=`bba16b1b-808e-47ce-aa90-3f8a033d547e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:57:53,001::task::595::TaskManager.Task::(_updateState) Task=`bba16b1b-808e-47ce-aa90-3f8a033d547e`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:57:53,002::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:57:53,002::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:57:53,002::task::990::TaskManager.Task::(_decref) Task=`bba16b1b-808e-47ce-aa90-3f8a033d547e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:57:53,035::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:57:53,035::task::595::TaskManager.Task::(_updateState) Task=`57d4bcfa-b3c6-422c-813f-33e28149ccac`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:57:53,036::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:57:53,036::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`454743d9-8ff7-484b-ba3e-2270275405da`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:57:53,036::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:57:53,037::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:57:53,037::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`454743d9-8ff7-484b-ba3e-2270275405da`::Granted request >Thread-34::DEBUG::2014-07-24 10:57:53,037::task::827::TaskManager.Task::(resourceAcquired) Task=`57d4bcfa-b3c6-422c-813f-33e28149ccac`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:57:53,037::task::990::TaskManager.Task::(_decref) Task=`57d4bcfa-b3c6-422c-813f-33e28149ccac`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:57:53,038::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:57:53,038::task::1185::TaskManager.Task::(prepare) Task=`57d4bcfa-b3c6-422c-813f-33e28149ccac`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:57:53,038::task::595::TaskManager.Task::(_updateState) Task=`57d4bcfa-b3c6-422c-813f-33e28149ccac`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:57:53,038::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:57:53,039::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:57:53,039::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:57:53,039::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:57:53,039::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:57:53,039::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:57:53,040::task::990::TaskManager.Task::(_decref) Task=`57d4bcfa-b3c6-422c-813f-33e28149ccac`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:57:54,507::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:57:54,582::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351356 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:57:56,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:57:56,670::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364643 s, 28.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:57:57,848::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:57:58,682::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:57:58,758::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361078 s, 28.4 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 10:58:00,053::task::595::TaskManager.Task::(_updateState) Task=`f91cc56e-e2de-416a-9a3b-5bead5ced04e`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 10:58:00,054::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 10:58:00,054::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:58:00,054::task::1185::TaskManager.Task::(prepare) Task=`f91cc56e-e2de-416a-9a3b-5bead5ced04e`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:58:00,054::task::595::TaskManager.Task::(_updateState) Task=`f91cc56e-e2de-416a-9a3b-5bead5ced04e`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 10:58:00,054::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 10:58:00,055::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 10:58:00,055::task::990::TaskManager.Task::(_decref) Task=`f91cc56e-e2de-416a-9a3b-5bead5ced04e`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 10:58:00,284::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:58:00,309::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0152224 s, 269 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:58:00,770::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:58:00,844::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342905 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:58:02,858::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:58:02,933::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350469 s, 29.2 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:58:03,102::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:58:03,120::task::595::TaskManager.Task::(_updateState) Task=`411bd30c-6d37-4955-9a26-6ab9dc7b2a47`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:58:03,120::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:58:03,120::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:58:03,120::task::1185::TaskManager.Task::(prepare) Task=`411bd30c-6d37-4955-9a26-6ab9dc7b2a47`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:58:03,120::task::595::TaskManager.Task::(_updateState) Task=`411bd30c-6d37-4955-9a26-6ab9dc7b2a47`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:58:03,121::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:58:03,121::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:58:03,121::task::990::TaskManager.Task::(_decref) Task=`411bd30c-6d37-4955-9a26-6ab9dc7b2a47`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:58:03,155::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:58:03,156::task::595::TaskManager.Task::(_updateState) Task=`fc14c9e3-f4ad-40d8-9812-a189af9679c2`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:58:03,156::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:58:03,156::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4c0de492-086b-4171-9eaa-6ef06984a8a2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:58:03,157::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:58:03,157::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:58:03,157::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4c0de492-086b-4171-9eaa-6ef06984a8a2`::Granted request >Thread-34::DEBUG::2014-07-24 10:58:03,157::task::827::TaskManager.Task::(resourceAcquired) Task=`fc14c9e3-f4ad-40d8-9812-a189af9679c2`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:58:03,158::task::990::TaskManager.Task::(_decref) Task=`fc14c9e3-f4ad-40d8-9812-a189af9679c2`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:58:03,158::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:58:03,158::task::1185::TaskManager.Task::(prepare) Task=`fc14c9e3-f4ad-40d8-9812-a189af9679c2`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:58:03,159::task::595::TaskManager.Task::(_updateState) Task=`fc14c9e3-f4ad-40d8-9812-a189af9679c2`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:58:03,159::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:58:03,159::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:58:03,159::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:58:03,159::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:58:03,160::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:58:03,160::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:58:03,160::task::990::TaskManager.Task::(_decref) Task=`fc14c9e3-f4ad-40d8-9812-a189af9679c2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:58:04,965::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:58:05,040::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353828 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:58:07,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:58:07,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366279 s, 28.0 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:58:07,167::task::595::TaskManager.Task::(_updateState) Task=`3f5fcd1a-c180-473a-8528-1804f9928ec0`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:58:07,167::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:58:07,167::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0152224', 'lastCheck': '6.9', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:58:07,168::task::1185::TaskManager.Task::(prepare) Task=`3f5fcd1a-c180-473a-8528-1804f9928ec0`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0152224', 'lastCheck': '6.9', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:58:07,168::task::595::TaskManager.Task::(_updateState) Task=`3f5fcd1a-c180-473a-8528-1804f9928ec0`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:58:07,168::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:58:07,168::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:58:07,168::task::990::TaskManager.Task::(_decref) Task=`3f5fcd1a-c180-473a-8528-1804f9928ec0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:58:09,142::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:58:09,217::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359964 s, 28.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:58:10,313::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:58:10,322::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000714511 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:58:11,229::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:58:11,306::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336431 s, 30.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:58:13,217::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:58:13,218::task::595::TaskManager.Task::(_updateState) Task=`e90a8725-45b4-4179-8519-d55b54ba0056`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:58:13,218::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:58:13,218::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:58:13,218::task::1185::TaskManager.Task::(prepare) Task=`e90a8725-45b4-4179-8519-d55b54ba0056`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:58:13,218::task::595::TaskManager.Task::(_updateState) Task=`e90a8725-45b4-4179-8519-d55b54ba0056`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:58:13,219::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:58:13,219::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:58:13,219::task::990::TaskManager.Task::(_decref) Task=`e90a8725-45b4-4179-8519-d55b54ba0056`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:58:13,251::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:58:13,251::task::595::TaskManager.Task::(_updateState) Task=`87a4e585-7efa-4e2b-9c3e-3fbbeee78a8b`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:58:13,251::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:58:13,252::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e53420a1-f090-47b4-bb17-fb2dc9592cc8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:58:13,252::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:58:13,253::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:58:13,253::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e53420a1-f090-47b4-bb17-fb2dc9592cc8`::Granted request >Thread-34::DEBUG::2014-07-24 10:58:13,254::task::827::TaskManager.Task::(resourceAcquired) Task=`87a4e585-7efa-4e2b-9c3e-3fbbeee78a8b`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:58:13,254::task::990::TaskManager.Task::(_decref) Task=`87a4e585-7efa-4e2b-9c3e-3fbbeee78a8b`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:58:13,254::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:58:13,255::task::1185::TaskManager.Task::(prepare) Task=`87a4e585-7efa-4e2b-9c3e-3fbbeee78a8b`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:58:13,255::task::595::TaskManager.Task::(_updateState) Task=`87a4e585-7efa-4e2b-9c3e-3fbbeee78a8b`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:58:13,255::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:58:13,255::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:58:13,255::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:58:13,256::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:58:13,256::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:58:13,256::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:58:13,256::task::990::TaskManager.Task::(_decref) Task=`87a4e585-7efa-4e2b-9c3e-3fbbeee78a8b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:58:13,318::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:58:13,394::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366174 s, 28.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:58:15,406::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:58:15,482::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353699 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:58:17,495::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:58:17,569::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349479 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:58:19,582::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:58:19,656::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346999 s, 29.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:58:20,327::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:58:20,342::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00691036 s, 593 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:58:21,671::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:58:21,745::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347283 s, 29.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:58:22,548::task::595::TaskManager.Task::(_updateState) Task=`c4610181-b5f7-45fd-ac83-ada447b2c50b`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:58:22,548::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:58:22,549::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00691036', 'lastCheck': '2.2', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:58:22,549::task::1185::TaskManager.Task::(prepare) Task=`c4610181-b5f7-45fd-ac83-ada447b2c50b`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00691036', 'lastCheck': '2.2', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:58:22,549::task::595::TaskManager.Task::(_updateState) Task=`c4610181-b5f7-45fd-ac83-ada447b2c50b`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:58:22,549::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:58:22,549::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:58:22,549::task::990::TaskManager.Task::(_decref) Task=`c4610181-b5f7-45fd-ac83-ada447b2c50b`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:58:23,313::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:58:23,314::task::595::TaskManager.Task::(_updateState) Task=`a6efd481-5d57-4869-8cb1-c67749c9fe11`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:58:23,314::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:58:23,314::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:58:23,314::task::1185::TaskManager.Task::(prepare) Task=`a6efd481-5d57-4869-8cb1-c67749c9fe11`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:58:23,315::task::595::TaskManager.Task::(_updateState) Task=`a6efd481-5d57-4869-8cb1-c67749c9fe11`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:58:23,315::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:58:23,315::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:58:23,315::task::990::TaskManager.Task::(_decref) Task=`a6efd481-5d57-4869-8cb1-c67749c9fe11`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:58:23,366::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:58:23,366::task::595::TaskManager.Task::(_updateState) Task=`0baa5085-b050-4a16-8302-3571b0bed3ad`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:58:23,366::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:58:23,367::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ae71513f-374e-48b4-9d57-1d3f827c201e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:58:23,367::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:58:23,367::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:58:23,368::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ae71513f-374e-48b4-9d57-1d3f827c201e`::Granted request >Thread-34::DEBUG::2014-07-24 10:58:23,368::task::827::TaskManager.Task::(resourceAcquired) Task=`0baa5085-b050-4a16-8302-3571b0bed3ad`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:58:23,368::task::990::TaskManager.Task::(_decref) Task=`0baa5085-b050-4a16-8302-3571b0bed3ad`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:58:23,369::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:58:23,369::task::1185::TaskManager.Task::(prepare) Task=`0baa5085-b050-4a16-8302-3571b0bed3ad`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:58:23,369::task::595::TaskManager.Task::(_updateState) Task=`0baa5085-b050-4a16-8302-3571b0bed3ad`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:58:23,369::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:58:23,370::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:58:23,370::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:58:23,370::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:58:23,370::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:58:23,370::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:58:23,370::task::990::TaskManager.Task::(_decref) Task=`0baa5085-b050-4a16-8302-3571b0bed3ad`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:58:23,757::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:58:23,832::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349803 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:58:25,844::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:58:25,920::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363224 s, 28.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:58:27,884::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:58:27,932::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:58:28,008::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351449 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:58:30,020::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:58:30,094::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035651 s, 28.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:58:30,347::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:58:30,367::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.011887 s, 345 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:58:32,107::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:58:32,184::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0381843 s, 26.8 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:58:33,462::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:58:33,462::task::595::TaskManager.Task::(_updateState) Task=`eec070be-ac3a-440e-8c57-87ebbdf5eebd`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:58:33,463::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:58:33,463::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:58:33,463::task::1185::TaskManager.Task::(prepare) Task=`eec070be-ac3a-440e-8c57-87ebbdf5eebd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:58:33,463::task::595::TaskManager.Task::(_updateState) Task=`eec070be-ac3a-440e-8c57-87ebbdf5eebd`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:58:33,464::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:58:33,464::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:58:33,464::task::990::TaskManager.Task::(_decref) Task=`eec070be-ac3a-440e-8c57-87ebbdf5eebd`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:58:33,499::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:58:33,499::task::595::TaskManager.Task::(_updateState) Task=`37a2a610-d177-46fa-952c-19fdb4e2b235`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:58:33,499::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:58:33,500::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`aab4770e-edca-480c-bb06-09b5cc0339cc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:58:33,500::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:58:33,500::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:58:33,500::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`aab4770e-edca-480c-bb06-09b5cc0339cc`::Granted request >Thread-34::DEBUG::2014-07-24 10:58:33,501::task::827::TaskManager.Task::(resourceAcquired) Task=`37a2a610-d177-46fa-952c-19fdb4e2b235`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:58:33,501::task::990::TaskManager.Task::(_decref) Task=`37a2a610-d177-46fa-952c-19fdb4e2b235`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:58:33,502::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:58:33,502::task::1185::TaskManager.Task::(prepare) Task=`37a2a610-d177-46fa-952c-19fdb4e2b235`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:58:33,502::task::595::TaskManager.Task::(_updateState) Task=`37a2a610-d177-46fa-952c-19fdb4e2b235`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:58:33,502::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:58:33,502::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:58:33,503::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:58:33,503::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:58:33,503::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:58:33,503::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:58:33,503::task::990::TaskManager.Task::(_decref) Task=`37a2a610-d177-46fa-952c-19fdb4e2b235`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:58:34,196::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:58:34,272::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357614 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:58:36,284::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:58:36,635::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.31233 s, 3.3 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:58:37,979::task::595::TaskManager.Task::(_updateState) Task=`8be41b40-03ab-445c-b91b-9e7f824831c8`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:58:37,979::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:58:37,980::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.011887', 'lastCheck': '7.6', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:58:37,980::task::1185::TaskManager.Task::(prepare) Task=`8be41b40-03ab-445c-b91b-9e7f824831c8`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.011887', 'lastCheck': '7.6', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:58:37,980::task::595::TaskManager.Task::(_updateState) Task=`8be41b40-03ab-445c-b91b-9e7f824831c8`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:58:37,980::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:58:37,980::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:58:37,980::task::990::TaskManager.Task::(_decref) Task=`8be41b40-03ab-445c-b91b-9e7f824831c8`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:58:38,648::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:58:38,720::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337502 s, 30.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:58:40,372::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:58:40,393::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0121219 s, 338 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:58:40,733::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:58:40,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036325 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:58:42,821::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:58:42,896::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353102 s, 29.0 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:58:43,559::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [1487b3f5] >Thread-13::DEBUG::2014-07-24 10:58:43,559::task::595::TaskManager.Task::(_updateState) Task=`9168b707-1937-4213-b770-6b23f7a792ec`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:58:43,560::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:58:43,560::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:58:43,560::task::1185::TaskManager.Task::(prepare) Task=`9168b707-1937-4213-b770-6b23f7a792ec`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:58:43,560::task::595::TaskManager.Task::(_updateState) Task=`9168b707-1937-4213-b770-6b23f7a792ec`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:58:43,560::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:58:43,561::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:58:43,561::task::990::TaskManager.Task::(_decref) Task=`9168b707-1937-4213-b770-6b23f7a792ec`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:58:43,599::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [1487b3f5] >Thread-34::DEBUG::2014-07-24 10:58:43,599::task::595::TaskManager.Task::(_updateState) Task=`39e4de99-63f1-4edf-8efb-99888374196b`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:58:43,600::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:58:43,600::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e6b5c0bf-6ff7-4b65-92e1-421a00c7eb61`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:58:43,600::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:58:43,600::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:58:43,601::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e6b5c0bf-6ff7-4b65-92e1-421a00c7eb61`::Granted request >Thread-34::DEBUG::2014-07-24 10:58:43,601::task::827::TaskManager.Task::(resourceAcquired) Task=`39e4de99-63f1-4edf-8efb-99888374196b`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:58:43,601::task::990::TaskManager.Task::(_decref) Task=`39e4de99-63f1-4edf-8efb-99888374196b`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:58:43,602::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:58:43,602::task::1185::TaskManager.Task::(prepare) Task=`39e4de99-63f1-4edf-8efb-99888374196b`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:58:43,602::task::595::TaskManager.Task::(_updateState) Task=`39e4de99-63f1-4edf-8efb-99888374196b`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:58:43,602::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:58:43,603::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:58:43,603::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:58:43,603::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:58:43,603::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:58:43,603::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:58:43,603::task::990::TaskManager.Task::(_decref) Task=`39e4de99-63f1-4edf-8efb-99888374196b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:58:44,908::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:58:44,982::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344971 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:58:46,994::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:58:47,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338613 s, 30.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:58:49,079::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:58:49,161::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.042779 s, 23.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:58:50,397::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:58:50,406::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000696507 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:58:51,174::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:58:51,499::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.284737 s, 3.6 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:58:53,422::task::595::TaskManager.Task::(_updateState) Task=`bf8e6a4e-f953-4f98-9dba-fd5e3c212606`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:58:53,422::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:58:53,423::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000696507', 'lastCheck': '3.0', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:58:53,423::task::1185::TaskManager.Task::(prepare) Task=`bf8e6a4e-f953-4f98-9dba-fd5e3c212606`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000696507', 'lastCheck': '3.0', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:58:53,423::task::595::TaskManager.Task::(_updateState) Task=`bf8e6a4e-f953-4f98-9dba-fd5e3c212606`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:58:53,423::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:58:53,423::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:58:53,424::task::990::TaskManager.Task::(_decref) Task=`bf8e6a4e-f953-4f98-9dba-fd5e3c212606`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:58:53,512::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:58:53,593::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0421548 s, 24.3 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:58:53,672::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:58:53,672::task::595::TaskManager.Task::(_updateState) Task=`941b1e27-a8be-4fc0-b86b-3e23d99020fd`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:58:53,672::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:58:53,673::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:58:53,673::task::1185::TaskManager.Task::(prepare) Task=`941b1e27-a8be-4fc0-b86b-3e23d99020fd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:58:53,673::task::595::TaskManager.Task::(_updateState) Task=`941b1e27-a8be-4fc0-b86b-3e23d99020fd`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:58:53,673::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:58:53,673::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:58:53,674::task::990::TaskManager.Task::(_decref) Task=`941b1e27-a8be-4fc0-b86b-3e23d99020fd`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:58:53,716::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:58:53,716::task::595::TaskManager.Task::(_updateState) Task=`7f41e14f-c90f-49e7-ae74-f735d9a98123`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:58:53,717::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:58:53,717::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`596568a6-45b3-4282-8c20-21ae3d351ec6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:58:53,717::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:58:53,718::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:58:53,718::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`596568a6-45b3-4282-8c20-21ae3d351ec6`::Granted request >Thread-34::DEBUG::2014-07-24 10:58:53,718::task::827::TaskManager.Task::(resourceAcquired) Task=`7f41e14f-c90f-49e7-ae74-f735d9a98123`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:58:53,718::task::990::TaskManager.Task::(_decref) Task=`7f41e14f-c90f-49e7-ae74-f735d9a98123`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:58:53,719::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:58:53,719::task::1185::TaskManager.Task::(prepare) Task=`7f41e14f-c90f-49e7-ae74-f735d9a98123`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:58:53,719::task::595::TaskManager.Task::(_updateState) Task=`7f41e14f-c90f-49e7-ae74-f735d9a98123`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:58:53,720::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:58:53,720::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:58:53,720::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:58:53,720::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:58:53,720::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:58:53,720::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:58:53,721::task::990::TaskManager.Task::(_decref) Task=`7f41e14f-c90f-49e7-ae74-f735d9a98123`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:58:55,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:58:55,682::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337334 s, 30.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:58:57,694::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >VM Channels Listener::DEBUG::2014-07-24 10:58:57,921::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:58:58,063::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.32917 s, 3.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:59:00,076::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:59:00,150::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346138 s, 29.6 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 10:59:00,205::task::595::TaskManager.Task::(_updateState) Task=`f649822f-5700-4616-9340-c681d0b5538c`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 10:59:00,205::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 10:59:00,206::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:59:00,206::task::1185::TaskManager.Task::(prepare) Task=`f649822f-5700-4616-9340-c681d0b5538c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 10:59:00,206::task::595::TaskManager.Task::(_updateState) Task=`f649822f-5700-4616-9340-c681d0b5538c`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 10:59:00,206::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 10:59:00,206::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 10:59:00,207::task::990::TaskManager.Task::(_decref) Task=`f649822f-5700-4616-9340-c681d0b5538c`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 10:59:00,411::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:59:00,426::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00700623 s, 585 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:59:02,163::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:59:02,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357291 s, 28.7 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:59:03,791::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:59:03,792::task::595::TaskManager.Task::(_updateState) Task=`7e86d502-7c08-4b01-91bc-f307dab163d5`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:59:03,792::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:59:03,792::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:59:03,792::task::1185::TaskManager.Task::(prepare) Task=`7e86d502-7c08-4b01-91bc-f307dab163d5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:59:03,793::task::595::TaskManager.Task::(_updateState) Task=`7e86d502-7c08-4b01-91bc-f307dab163d5`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:59:03,793::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:59:03,793::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:59:03,793::task::990::TaskManager.Task::(_decref) Task=`7e86d502-7c08-4b01-91bc-f307dab163d5`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:59:03,825::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:59:03,825::task::595::TaskManager.Task::(_updateState) Task=`41517b56-fbfe-48b1-b9ee-281b531222b0`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:59:03,825::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:59:03,826::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c9cad6df-a48b-4d2a-aee2-3ffa4a4598db`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:59:03,826::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:59:03,826::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:59:03,826::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c9cad6df-a48b-4d2a-aee2-3ffa4a4598db`::Granted request >Thread-34::DEBUG::2014-07-24 10:59:03,827::task::827::TaskManager.Task::(resourceAcquired) Task=`41517b56-fbfe-48b1-b9ee-281b531222b0`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:59:03,827::task::990::TaskManager.Task::(_decref) Task=`41517b56-fbfe-48b1-b9ee-281b531222b0`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:59:03,828::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:59:03,828::task::1185::TaskManager.Task::(prepare) Task=`41517b56-fbfe-48b1-b9ee-281b531222b0`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:59:03,828::task::595::TaskManager.Task::(_updateState) Task=`41517b56-fbfe-48b1-b9ee-281b531222b0`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:59:03,828::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:59:03,828::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:59:03,829::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:59:03,829::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:59:03,829::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:59:03,829::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:59:03,829::task::990::TaskManager.Task::(_decref) Task=`41517b56-fbfe-48b1-b9ee-281b531222b0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:59:04,257::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:59:04,331::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342458 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:59:06,343::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:59:06,424::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0424213 s, 24.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:59:08,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:59:08,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350929 s, 29.2 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:59:08,820::task::595::TaskManager.Task::(_updateState) Task=`32bcea0b-d5e2-4176-a219-71cd5d67426d`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:59:08,820::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:59:08,820::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00700623', 'lastCheck': '8.4', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:59:08,821::task::1185::TaskManager.Task::(prepare) Task=`32bcea0b-d5e2-4176-a219-71cd5d67426d`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00700623', 'lastCheck': '8.4', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:59:08,821::task::595::TaskManager.Task::(_updateState) Task=`32bcea0b-d5e2-4176-a219-71cd5d67426d`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:59:08,821::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:59:08,821::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:59:08,821::task::990::TaskManager.Task::(_decref) Task=`32bcea0b-d5e2-4176-a219-71cd5d67426d`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 10:59:10,431::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:59:10,440::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000711322 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:59:10,524::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:59:10,599::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359934 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:59:12,611::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:59:12,698::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0401913 s, 25.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:59:13,900::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [12b68a95] >Thread-13::DEBUG::2014-07-24 10:59:13,901::task::595::TaskManager.Task::(_updateState) Task=`d52d43ab-b206-4b57-b242-c554fa6dc3b8`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:59:13,901::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:59:13,901::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:59:13,901::task::1185::TaskManager.Task::(prepare) Task=`d52d43ab-b206-4b57-b242-c554fa6dc3b8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:59:13,902::task::595::TaskManager.Task::(_updateState) Task=`d52d43ab-b206-4b57-b242-c554fa6dc3b8`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:59:13,902::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:59:13,902::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:59:13,902::task::990::TaskManager.Task::(_decref) Task=`d52d43ab-b206-4b57-b242-c554fa6dc3b8`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:59:13,973::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [12b68a95] >Thread-34::DEBUG::2014-07-24 10:59:13,973::task::595::TaskManager.Task::(_updateState) Task=`0dda1c0a-8984-43d6-a6bd-4f89d71b8f58`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:59:13,973::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:59:13,973::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`70d82b9f-012f-4417-b216-bd0d5949c70e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:59:13,974::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:59:13,974::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:59:13,974::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`70d82b9f-012f-4417-b216-bd0d5949c70e`::Granted request >Thread-34::DEBUG::2014-07-24 10:59:13,974::task::827::TaskManager.Task::(resourceAcquired) Task=`0dda1c0a-8984-43d6-a6bd-4f89d71b8f58`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:59:13,975::task::990::TaskManager.Task::(_decref) Task=`0dda1c0a-8984-43d6-a6bd-4f89d71b8f58`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:59:13,975::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:59:13,975::task::1185::TaskManager.Task::(prepare) Task=`0dda1c0a-8984-43d6-a6bd-4f89d71b8f58`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:59:13,976::task::595::TaskManager.Task::(_updateState) Task=`0dda1c0a-8984-43d6-a6bd-4f89d71b8f58`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:59:13,976::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:59:13,976::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:59:13,976::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:59:13,976::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:59:13,976::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:59:13,977::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:59:13,977::task::990::TaskManager.Task::(_decref) Task=`0dda1c0a-8984-43d6-a6bd-4f89d71b8f58`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:59:14,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:59:14,785::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346855 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:59:16,798::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:59:16,873::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363039 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:59:18,885::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:59:18,966::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0418201 s, 24.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:59:20,445::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:59:20,460::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00709687 s, 577 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:59:20,978::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:59:21,054::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366616 s, 27.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:59:23,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:59:23,141::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343624 s, 29.8 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:59:24,038::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:59:24,038::task::595::TaskManager.Task::(_updateState) Task=`1a70e1c3-a0b9-410b-8026-daa19995b408`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:59:24,038::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:59:24,039::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:59:24,039::task::1185::TaskManager.Task::(prepare) Task=`1a70e1c3-a0b9-410b-8026-daa19995b408`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:59:24,039::task::595::TaskManager.Task::(_updateState) Task=`1a70e1c3-a0b9-410b-8026-daa19995b408`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:59:24,039::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:59:24,039::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:59:24,039::task::990::TaskManager.Task::(_decref) Task=`1a70e1c3-a0b9-410b-8026-daa19995b408`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:59:24,071::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:59:24,071::task::595::TaskManager.Task::(_updateState) Task=`602653af-e130-4ecd-af5e-2d0bdec6175b`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:59:24,072::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:59:24,072::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`dd8f1112-51ee-4f3c-8021-21535b65c545`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:59:24,072::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:59:24,072::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:59:24,073::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`dd8f1112-51ee-4f3c-8021-21535b65c545`::Granted request >Thread-34::DEBUG::2014-07-24 10:59:24,073::task::827::TaskManager.Task::(resourceAcquired) Task=`602653af-e130-4ecd-af5e-2d0bdec6175b`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:59:24,073::task::990::TaskManager.Task::(_decref) Task=`602653af-e130-4ecd-af5e-2d0bdec6175b`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:59:24,074::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:59:24,074::task::1185::TaskManager.Task::(prepare) Task=`602653af-e130-4ecd-af5e-2d0bdec6175b`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:59:24,074::task::595::TaskManager.Task::(_updateState) Task=`602653af-e130-4ecd-af5e-2d0bdec6175b`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:59:24,074::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:59:24,075::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:59:24,075::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:59:24,075::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:59:24,075::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:59:24,075::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:59:24,075::task::990::TaskManager.Task::(_decref) Task=`602653af-e130-4ecd-af5e-2d0bdec6175b`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 10:59:24,187::task::595::TaskManager.Task::(_updateState) Task=`5ef2e5ec-ee6f-4c19-b628-0e74540ceffa`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:59:24,187::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:59:24,188::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00709687', 'lastCheck': '3.7', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:59:24,188::task::1185::TaskManager.Task::(prepare) Task=`5ef2e5ec-ee6f-4c19-b628-0e74540ceffa`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00709687', 'lastCheck': '3.7', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:59:24,188::task::595::TaskManager.Task::(_updateState) Task=`5ef2e5ec-ee6f-4c19-b628-0e74540ceffa`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:59:24,188::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:59:24,188::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:59:24,188::task::990::TaskManager.Task::(_decref) Task=`5ef2e5ec-ee6f-4c19-b628-0e74540ceffa`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:59:25,154::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:59:25,227::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347206 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:59:27,239::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:59:27,315::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363795 s, 28.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:59:27,957::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:59:29,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:59:29,400::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339419 s, 30.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:59:30,465::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:59:30,494::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0203938 s, 201 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:59:31,412::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:59:31,485::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340244 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:59:33,498::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:59:33,572::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361812 s, 28.3 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:59:34,133::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:59:34,133::task::595::TaskManager.Task::(_updateState) Task=`ab1f00f2-5152-4b9b-b42d-56d3bf9cb05b`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:59:34,134::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:59:34,134::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:59:34,134::task::1185::TaskManager.Task::(prepare) Task=`ab1f00f2-5152-4b9b-b42d-56d3bf9cb05b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:59:34,134::task::595::TaskManager.Task::(_updateState) Task=`ab1f00f2-5152-4b9b-b42d-56d3bf9cb05b`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:59:34,135::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:59:34,135::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:59:34,135::task::990::TaskManager.Task::(_decref) Task=`ab1f00f2-5152-4b9b-b42d-56d3bf9cb05b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:59:34,165::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:59:34,165::task::595::TaskManager.Task::(_updateState) Task=`fefa0373-59f3-41ac-aec1-1046e622b1cb`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:59:34,165::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:59:34,166::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`a7ba8d3a-1108-4aca-b5b6-a17d31b7cfbe`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:59:34,166::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:59:34,166::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:59:34,166::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`a7ba8d3a-1108-4aca-b5b6-a17d31b7cfbe`::Granted request >Thread-34::DEBUG::2014-07-24 10:59:34,166::task::827::TaskManager.Task::(resourceAcquired) Task=`fefa0373-59f3-41ac-aec1-1046e622b1cb`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:59:34,167::task::990::TaskManager.Task::(_decref) Task=`fefa0373-59f3-41ac-aec1-1046e622b1cb`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:59:34,167::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:59:34,168::task::1185::TaskManager.Task::(prepare) Task=`fefa0373-59f3-41ac-aec1-1046e622b1cb`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:59:34,168::task::595::TaskManager.Task::(_updateState) Task=`fefa0373-59f3-41ac-aec1-1046e622b1cb`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:59:34,168::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:59:34,168::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:59:34,168::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:59:34,168::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:59:34,169::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:59:34,169::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:59:34,169::task::990::TaskManager.Task::(_decref) Task=`fefa0373-59f3-41ac-aec1-1046e622b1cb`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:59:35,585::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:59:35,658::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343739 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:59:37,670::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:59:37,744::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348197 s, 29.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:59:39,561::task::595::TaskManager.Task::(_updateState) Task=`ec2daa4b-ea65-4999-a759-503aa96370b7`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:59:39,561::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:59:39,561::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0203938', 'lastCheck': '9.1', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:59:39,562::task::1185::TaskManager.Task::(prepare) Task=`ec2daa4b-ea65-4999-a759-503aa96370b7`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0203938', 'lastCheck': '9.1', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:59:39,562::task::595::TaskManager.Task::(_updateState) Task=`ec2daa4b-ea65-4999-a759-503aa96370b7`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:59:39,562::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:59:39,562::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:59:39,562::task::990::TaskManager.Task::(_decref) Task=`ec2daa4b-ea65-4999-a759-503aa96370b7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:59:39,756::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:59:39,831::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350036 s, 29.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:59:40,499::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:59:40,519::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0114561 s, 358 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:59:41,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:59:41,925::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.042566 s, 24.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:59:43,937::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:59:44,012::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360423 s, 28.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:59:44,240::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:59:44,240::task::595::TaskManager.Task::(_updateState) Task=`99b93d55-d098-47eb-8fe8-59f8d3aae8cb`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:59:44,240::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:59:44,241::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:59:44,241::task::1185::TaskManager.Task::(prepare) Task=`99b93d55-d098-47eb-8fe8-59f8d3aae8cb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:59:44,241::task::595::TaskManager.Task::(_updateState) Task=`99b93d55-d098-47eb-8fe8-59f8d3aae8cb`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:59:44,241::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:59:44,241::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:59:44,242::task::990::TaskManager.Task::(_decref) Task=`99b93d55-d098-47eb-8fe8-59f8d3aae8cb`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:59:44,283::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:59:44,283::task::595::TaskManager.Task::(_updateState) Task=`94d7a5b2-6f76-4327-93dd-860757902fcc`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:59:44,283::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:59:44,283::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d0383946-bf9b-4598-bff1-bf2458f000ec`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:59:44,284::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:59:44,284::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:59:44,284::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d0383946-bf9b-4598-bff1-bf2458f000ec`::Granted request >Thread-34::DEBUG::2014-07-24 10:59:44,284::task::827::TaskManager.Task::(resourceAcquired) Task=`94d7a5b2-6f76-4327-93dd-860757902fcc`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:59:44,285::task::990::TaskManager.Task::(_decref) Task=`94d7a5b2-6f76-4327-93dd-860757902fcc`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:59:44,285::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:59:44,285::task::1185::TaskManager.Task::(prepare) Task=`94d7a5b2-6f76-4327-93dd-860757902fcc`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:59:44,286::task::595::TaskManager.Task::(_updateState) Task=`94d7a5b2-6f76-4327-93dd-860757902fcc`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:59:44,286::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:59:44,286::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:59:44,286::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:59:44,286::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:59:44,286::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:59:44,287::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:59:44,287::task::990::TaskManager.Task::(_decref) Task=`94d7a5b2-6f76-4327-93dd-860757902fcc`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:59:46,024::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:59:46,100::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364445 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:59:48,111::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:59:48,185::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352176 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:59:50,198::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:59:50,272::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352953 s, 29.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 10:59:50,524::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 10:59:50,545::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0121999 s, 336 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:59:52,284::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:59:52,359::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342462 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 10:59:54,371::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-13::DEBUG::2014-07-24 10:59:54,395::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 10:59:54,396::task::595::TaskManager.Task::(_updateState) Task=`ca34fa3b-52be-4bfb-a9f5-773efc444272`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:59:54,397::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 10:59:54,399::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:59:54,399::task::1185::TaskManager.Task::(prepare) Task=`ca34fa3b-52be-4bfb-a9f5-773efc444272`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 10:59:54,400::task::595::TaskManager.Task::(_updateState) Task=`ca34fa3b-52be-4bfb-a9f5-773efc444272`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:59:54,401::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:59:54,402::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:59:54,403::task::990::TaskManager.Task::(_decref) Task=`ca34fa3b-52be-4bfb-a9f5-773efc444272`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 10:59:54,438::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 10:59:54,439::task::595::TaskManager.Task::(_updateState) Task=`ad55257c-5e4f-4900-8a3d-612f50888449`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 10:59:54,440::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 10:59:54,443::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`fc168ed9-cd0e-40e2-b37f-9092d2877727`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 10:59:54,444::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 10:59:54,446::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 10:59:54,447::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`fc168ed9-cd0e-40e2-b37f-9092d2877727`::Granted request >Thread-34::DEBUG::2014-07-24 10:59:54,451::task::827::TaskManager.Task::(resourceAcquired) Task=`ad55257c-5e4f-4900-8a3d-612f50888449`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 10:59:54,452::task::990::TaskManager.Task::(_decref) Task=`ad55257c-5e4f-4900-8a3d-612f50888449`::ref 1 aborting False >Thread-34::INFO::2014-07-24 10:59:54,455::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:59:54,456::task::1185::TaskManager.Task::(prepare) Task=`ad55257c-5e4f-4900-8a3d-612f50888449`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 10:59:54,457::task::595::TaskManager.Task::(_updateState) Task=`ad55257c-5e4f-4900-8a3d-612f50888449`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 10:59:54,458::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 10:59:54,459::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 10:59:54,461::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 10:59:54,462::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 10:59:54,463::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 10:59:54,463::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 10:59:54,465::task::990::TaskManager.Task::(_decref) Task=`ad55257c-5e4f-4900-8a3d-612f50888449`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:59:54,487::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0479196 s, 21.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 10:59:54,948::task::595::TaskManager.Task::(_updateState) Task=`72026868-abc6-493c-a3d9-8c04a9a5fb31`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 10:59:54,948::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 10:59:54,949::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0121999', 'lastCheck': '4.4', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:59:54,949::task::1185::TaskManager.Task::(prepare) Task=`72026868-abc6-493c-a3d9-8c04a9a5fb31`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0121999', 'lastCheck': '4.4', 'valid': True}} >Thread-13::DEBUG::2014-07-24 10:59:54,949::task::595::TaskManager.Task::(_updateState) Task=`72026868-abc6-493c-a3d9-8c04a9a5fb31`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 10:59:54,949::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 10:59:54,949::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 10:59:54,949::task::990::TaskManager.Task::(_decref) Task=`72026868-abc6-493c-a3d9-8c04a9a5fb31`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 10:59:56,499::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:59:56,573::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349712 s, 29.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 10:59:57,994::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 10:59:58,585::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 10:59:58,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355141 s, 28.8 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:00:00,358::task::595::TaskManager.Task::(_updateState) Task=`5b2ef274-ee40-4e19-87d2-b2c85218bcfe`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:00:00,358::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:00:00,358::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:00:00,359::task::1185::TaskManager.Task::(prepare) Task=`5b2ef274-ee40-4e19-87d2-b2c85218bcfe`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:00:00,359::task::595::TaskManager.Task::(_updateState) Task=`5b2ef274-ee40-4e19-87d2-b2c85218bcfe`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:00:00,359::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:00:00,359::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:00:00,359::task::990::TaskManager.Task::(_decref) Task=`5b2ef274-ee40-4e19-87d2-b2c85218bcfe`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:00:00,549::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:00:00,561::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00385409 s, 1.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:00:00,673::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:00:00,747::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339384 s, 30.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:00:02,757::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:00:02,830::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337244 s, 30.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:00:04,524::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:00:04,524::task::595::TaskManager.Task::(_updateState) Task=`7d773f40-a5f6-4e7e-964f-85c01a023970`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:00:04,524::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:00:04,525::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:00:04,525::task::1185::TaskManager.Task::(prepare) Task=`7d773f40-a5f6-4e7e-964f-85c01a023970`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:00:04,525::task::595::TaskManager.Task::(_updateState) Task=`7d773f40-a5f6-4e7e-964f-85c01a023970`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:00:04,525::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:00:04,525::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:00:04,526::task::990::TaskManager.Task::(_decref) Task=`7d773f40-a5f6-4e7e-964f-85c01a023970`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:00:04,556::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:00:04,557::task::595::TaskManager.Task::(_updateState) Task=`1b27f5cd-ffb4-4171-b754-18864ef07e0a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:00:04,557::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:00:04,557::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1ce102ac-3754-4339-9367-b259e929477b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:00:04,558::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:00:04,558::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:00:04,558::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1ce102ac-3754-4339-9367-b259e929477b`::Granted request >Thread-34::DEBUG::2014-07-24 11:00:04,558::task::827::TaskManager.Task::(resourceAcquired) Task=`1b27f5cd-ffb4-4171-b754-18864ef07e0a`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:00:04,559::task::990::TaskManager.Task::(_decref) Task=`1b27f5cd-ffb4-4171-b754-18864ef07e0a`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:00:04,559::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:00:04,560::task::1185::TaskManager.Task::(prepare) Task=`1b27f5cd-ffb4-4171-b754-18864ef07e0a`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:00:04,560::task::595::TaskManager.Task::(_updateState) Task=`1b27f5cd-ffb4-4171-b754-18864ef07e0a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:00:04,560::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:00:04,560::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:00:04,560::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:00:04,561::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:00:04,561::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:00:04,561::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:00:04,561::task::990::TaskManager.Task::(_decref) Task=`1b27f5cd-ffb4-4171-b754-18864ef07e0a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:00:04,840::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:00:04,913::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033757 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:00:06,926::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:00:07,000::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353077 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:00:09,013::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:00:09,086::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341649 s, 30.0 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:00:10,346::task::595::TaskManager.Task::(_updateState) Task=`6c5fb640-3591-4b20-973b-811906c7af8d`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:00:10,346::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:00:10,346::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00385409', 'lastCheck': '9.8', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:00:10,346::task::1185::TaskManager.Task::(prepare) Task=`6c5fb640-3591-4b20-973b-811906c7af8d`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00385409', 'lastCheck': '9.8', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:00:10,347::task::595::TaskManager.Task::(_updateState) Task=`6c5fb640-3591-4b20-973b-811906c7af8d`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:00:10,347::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:00:10,347::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:00:10,347::task::990::TaskManager.Task::(_decref) Task=`6c5fb640-3591-4b20-973b-811906c7af8d`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:00:10,566::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:00:10,587::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0123246 s, 332 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:00:11,098::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:00:11,173::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357072 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:00:13,185::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:00:13,259::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034828 s, 29.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:00:14,617::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:00:14,617::task::595::TaskManager.Task::(_updateState) Task=`fdfe75cb-130a-4d18-a284-0cd75997d08d`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:00:14,618::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:00:14,618::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:00:14,618::task::1185::TaskManager.Task::(prepare) Task=`fdfe75cb-130a-4d18-a284-0cd75997d08d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:00:14,618::task::595::TaskManager.Task::(_updateState) Task=`fdfe75cb-130a-4d18-a284-0cd75997d08d`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:00:14,618::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:00:14,619::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:00:14,619::task::990::TaskManager.Task::(_decref) Task=`fdfe75cb-130a-4d18-a284-0cd75997d08d`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:00:14,657::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:00:14,657::task::595::TaskManager.Task::(_updateState) Task=`5872461e-a106-4662-9bc5-25f729d20584`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:00:14,658::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:00:14,658::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`de12c3d9-8546-4ced-9dee-17e658c3ae1a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:00:14,658::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:00:14,658::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:00:14,659::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`de12c3d9-8546-4ced-9dee-17e658c3ae1a`::Granted request >Thread-34::DEBUG::2014-07-24 11:00:14,659::task::827::TaskManager.Task::(resourceAcquired) Task=`5872461e-a106-4662-9bc5-25f729d20584`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:00:14,659::task::990::TaskManager.Task::(_decref) Task=`5872461e-a106-4662-9bc5-25f729d20584`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:00:14,660::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:00:14,660::task::1185::TaskManager.Task::(prepare) Task=`5872461e-a106-4662-9bc5-25f729d20584`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:00:14,660::task::595::TaskManager.Task::(_updateState) Task=`5872461e-a106-4662-9bc5-25f729d20584`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:00:14,660::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:00:14,660::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:00:14,661::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:00:14,661::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:00:14,661::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:00:14,661::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:00:14,661::task::990::TaskManager.Task::(_decref) Task=`5872461e-a106-4662-9bc5-25f729d20584`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:00:15,272::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:00:15,346::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352627 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:00:17,358::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:00:17,432::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345066 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:00:19,444::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:00:19,796::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.312587 s, 3.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:00:20,591::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:00:20,652::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0525382 s, 78.0 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:00:21,808::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:00:21,883::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355919 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:00:23,896::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:00:23,968::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342307 s, 29.9 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:00:24,718::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:00:24,719::task::595::TaskManager.Task::(_updateState) Task=`b764bb82-a406-4e48-947d-1ff8238c5231`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:00:24,719::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:00:24,720::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:00:24,720::task::1185::TaskManager.Task::(prepare) Task=`b764bb82-a406-4e48-947d-1ff8238c5231`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:00:24,720::task::595::TaskManager.Task::(_updateState) Task=`b764bb82-a406-4e48-947d-1ff8238c5231`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:00:24,720::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:00:24,720::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:00:24,720::task::990::TaskManager.Task::(_decref) Task=`b764bb82-a406-4e48-947d-1ff8238c5231`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:00:24,756::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:00:24,756::task::595::TaskManager.Task::(_updateState) Task=`0095e0da-d795-42f6-bb03-16a576216ff1`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:00:24,756::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:00:24,757::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7ae270b1-8315-48b3-8325-6d338e75e238`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:00:24,757::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:00:24,757::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:00:24,757::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7ae270b1-8315-48b3-8325-6d338e75e238`::Granted request >Thread-34::DEBUG::2014-07-24 11:00:24,758::task::827::TaskManager.Task::(resourceAcquired) Task=`0095e0da-d795-42f6-bb03-16a576216ff1`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:00:24,758::task::990::TaskManager.Task::(_decref) Task=`0095e0da-d795-42f6-bb03-16a576216ff1`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:00:24,758::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:00:24,759::task::1185::TaskManager.Task::(prepare) Task=`0095e0da-d795-42f6-bb03-16a576216ff1`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:00:24,759::task::595::TaskManager.Task::(_updateState) Task=`0095e0da-d795-42f6-bb03-16a576216ff1`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:00:24,759::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:00:24,759::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:00:24,759::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:00:24,759::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:00:24,760::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:00:24,760::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:00:24,760::task::990::TaskManager.Task::(_decref) Task=`0095e0da-d795-42f6-bb03-16a576216ff1`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 11:00:25,704::task::595::TaskManager.Task::(_updateState) Task=`a52eaea1-0f02-4c90-b8dd-cb9999c665ec`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:00:25,704::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:00:25,705::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0525382', 'lastCheck': '5.0', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:00:25,705::task::1185::TaskManager.Task::(prepare) Task=`a52eaea1-0f02-4c90-b8dd-cb9999c665ec`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0525382', 'lastCheck': '5.0', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:00:25,705::task::595::TaskManager.Task::(_updateState) Task=`a52eaea1-0f02-4c90-b8dd-cb9999c665ec`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:00:25,705::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:00:25,705::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:00:25,705::task::990::TaskManager.Task::(_decref) Task=`a52eaea1-0f02-4c90-b8dd-cb9999c665ec`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:00:25,981::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:00:26,056::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361653 s, 28.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:00:28,029::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:00:28,068::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:00:28,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352791 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:00:30,156::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:00:30,231::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357687 s, 28.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:00:30,657::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:00:30,670::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00531891 s, 770 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:00:32,243::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:00:32,316::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339612 s, 30.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:00:34,328::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:00:34,403::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352762 s, 29.0 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:00:34,820::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:00:34,820::task::595::TaskManager.Task::(_updateState) Task=`1346c83f-9816-4c0b-8145-94239e359588`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:00:34,821::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:00:34,821::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:00:34,821::task::1185::TaskManager.Task::(prepare) Task=`1346c83f-9816-4c0b-8145-94239e359588`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:00:34,821::task::595::TaskManager.Task::(_updateState) Task=`1346c83f-9816-4c0b-8145-94239e359588`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:00:34,822::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:00:34,822::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:00:34,822::task::990::TaskManager.Task::(_decref) Task=`1346c83f-9816-4c0b-8145-94239e359588`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:00:34,859::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:00:34,860::task::595::TaskManager.Task::(_updateState) Task=`383c1ceb-4d3f-4bf4-92a9-2dd5cef1f35e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:00:34,860::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:00:34,860::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`9b37773b-30b5-4df1-8cf3-0879264f2963`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:00:34,860::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:00:34,861::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:00:34,861::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`9b37773b-30b5-4df1-8cf3-0879264f2963`::Granted request >Thread-34::DEBUG::2014-07-24 11:00:34,861::task::827::TaskManager.Task::(resourceAcquired) Task=`383c1ceb-4d3f-4bf4-92a9-2dd5cef1f35e`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:00:34,861::task::990::TaskManager.Task::(_decref) Task=`383c1ceb-4d3f-4bf4-92a9-2dd5cef1f35e`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:00:34,862::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:00:34,862::task::1185::TaskManager.Task::(prepare) Task=`383c1ceb-4d3f-4bf4-92a9-2dd5cef1f35e`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:00:34,862::task::595::TaskManager.Task::(_updateState) Task=`383c1ceb-4d3f-4bf4-92a9-2dd5cef1f35e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:00:34,863::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:00:34,863::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:00:34,863::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:00:34,863::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:00:34,863::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:00:34,863::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:00:34,864::task::990::TaskManager.Task::(_decref) Task=`383c1ceb-4d3f-4bf4-92a9-2dd5cef1f35e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:00:36,415::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:00:36,496::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03507 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:00:38,509::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:00:38,583::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344532 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:00:40,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:00:40,669::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350538 s, 29.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:00:40,678::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:00:40,696::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00841493 s, 487 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:00:41,081::task::595::TaskManager.Task::(_updateState) Task=`3c38a596-9d35-4cdc-832e-fe84106a61c3`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:00:41,081::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:00:41,081::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00841493', 'lastCheck': '0.4', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:00:41,081::task::1185::TaskManager.Task::(prepare) Task=`3c38a596-9d35-4cdc-832e-fe84106a61c3`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00841493', 'lastCheck': '0.4', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:00:41,082::task::595::TaskManager.Task::(_updateState) Task=`3c38a596-9d35-4cdc-832e-fe84106a61c3`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:00:41,082::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:00:41,082::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:00:41,082::task::990::TaskManager.Task::(_decref) Task=`3c38a596-9d35-4cdc-832e-fe84106a61c3`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:00:42,696::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:00:42,770::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342808 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:00:44,783::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:00:44,858::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359321 s, 28.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:00:44,923::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:00:44,924::task::595::TaskManager.Task::(_updateState) Task=`a304fb66-2faa-4e74-bbc6-d279cfb54a44`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:00:44,924::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:00:44,924::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:00:44,924::task::1185::TaskManager.Task::(prepare) Task=`a304fb66-2faa-4e74-bbc6-d279cfb54a44`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:00:44,925::task::595::TaskManager.Task::(_updateState) Task=`a304fb66-2faa-4e74-bbc6-d279cfb54a44`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:00:44,925::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:00:44,925::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:00:44,925::task::990::TaskManager.Task::(_decref) Task=`a304fb66-2faa-4e74-bbc6-d279cfb54a44`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:00:44,956::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:00:44,957::task::595::TaskManager.Task::(_updateState) Task=`d146ddfe-0178-4d5b-8feb-03d684a0dbd1`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:00:44,957::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:00:44,957::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`9aa3d4ae-359c-4705-aec4-2939e92e9ee7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:00:44,957::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:00:44,958::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:00:44,958::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`9aa3d4ae-359c-4705-aec4-2939e92e9ee7`::Granted request >Thread-34::DEBUG::2014-07-24 11:00:44,958::task::827::TaskManager.Task::(resourceAcquired) Task=`d146ddfe-0178-4d5b-8feb-03d684a0dbd1`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:00:44,958::task::990::TaskManager.Task::(_decref) Task=`d146ddfe-0178-4d5b-8feb-03d684a0dbd1`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:00:44,959::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:00:44,959::task::1185::TaskManager.Task::(prepare) Task=`d146ddfe-0178-4d5b-8feb-03d684a0dbd1`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:00:44,959::task::595::TaskManager.Task::(_updateState) Task=`d146ddfe-0178-4d5b-8feb-03d684a0dbd1`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:00:44,960::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:00:44,960::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:00:44,960::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:00:44,960::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:00:44,960::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:00:44,960::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:00:44,961::task::990::TaskManager.Task::(_decref) Task=`d146ddfe-0178-4d5b-8feb-03d684a0dbd1`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:00:46,870::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:00:46,947::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372849 s, 27.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:00:48,957::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:00:49,031::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349337 s, 29.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:00:50,700::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:00:50,721::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0123008 s, 333 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:00:51,043::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:00:51,118::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351023 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:00:53,131::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:00:53,203::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337051 s, 30.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:00:55,020::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:00:55,020::task::595::TaskManager.Task::(_updateState) Task=`bb2141d9-f707-4e75-83a3-7062bef0768c`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:00:55,021::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:00:55,021::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:00:55,021::task::1185::TaskManager.Task::(prepare) Task=`bb2141d9-f707-4e75-83a3-7062bef0768c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:00:55,021::task::595::TaskManager.Task::(_updateState) Task=`bb2141d9-f707-4e75-83a3-7062bef0768c`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:00:55,022::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:00:55,022::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:00:55,022::task::990::TaskManager.Task::(_decref) Task=`bb2141d9-f707-4e75-83a3-7062bef0768c`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:00:55,059::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:00:55,059::task::595::TaskManager.Task::(_updateState) Task=`a55fa086-4a2a-4306-86ba-452f06a3f10c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:00:55,060::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:00:55,060::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`2f70959c-7531-45e2-800f-157f42100eb7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:00:55,060::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:00:55,061::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:00:55,061::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`2f70959c-7531-45e2-800f-157f42100eb7`::Granted request >Thread-34::DEBUG::2014-07-24 11:00:55,061::task::827::TaskManager.Task::(resourceAcquired) Task=`a55fa086-4a2a-4306-86ba-452f06a3f10c`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:00:55,061::task::990::TaskManager.Task::(_decref) Task=`a55fa086-4a2a-4306-86ba-452f06a3f10c`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:00:55,062::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:00:55,062::task::1185::TaskManager.Task::(prepare) Task=`a55fa086-4a2a-4306-86ba-452f06a3f10c`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:00:55,063::task::595::TaskManager.Task::(_updateState) Task=`a55fa086-4a2a-4306-86ba-452f06a3f10c`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:00:55,063::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:00:55,063::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:00:55,063::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:00:55,063::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:00:55,063::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:00:55,064::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:00:55,064::task::990::TaskManager.Task::(_decref) Task=`a55fa086-4a2a-4306-86ba-452f06a3f10c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:00:55,216::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:00:55,292::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036565 s, 28.0 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:00:56,780::task::595::TaskManager.Task::(_updateState) Task=`71611d96-a423-4024-aa95-79b81bef35b5`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:00:56,780::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:00:56,781::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0123008', 'lastCheck': '6.1', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:00:56,781::task::1185::TaskManager.Task::(prepare) Task=`71611d96-a423-4024-aa95-79b81bef35b5`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0123008', 'lastCheck': '6.1', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:00:56,781::task::595::TaskManager.Task::(_updateState) Task=`71611d96-a423-4024-aa95-79b81bef35b5`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:00:56,781::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:00:56,781::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:00:56,781::task::990::TaskManager.Task::(_decref) Task=`71611d96-a423-4024-aa95-79b81bef35b5`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:00:57,305::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:00:57,379::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352325 s, 29.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:00:58,065::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:00:59,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:00:59,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372242 s, 27.5 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:01:00,518::task::595::TaskManager.Task::(_updateState) Task=`68f05b1b-706c-4ebe-a173-9baea1ee6801`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:01:00,518::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:01:00,518::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:01:00,518::task::1185::TaskManager.Task::(prepare) Task=`68f05b1b-706c-4ebe-a173-9baea1ee6801`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:01:00,518::task::595::TaskManager.Task::(_updateState) Task=`68f05b1b-706c-4ebe-a173-9baea1ee6801`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:01:00,519::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:01:00,519::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:01:00,519::task::990::TaskManager.Task::(_decref) Task=`68f05b1b-706c-4ebe-a173-9baea1ee6801`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:01:00,725::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:01:00,746::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0123514 s, 332 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:01:01,481::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:01:01,563::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0414058 s, 24.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:01:03,576::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:01:03,665::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035193 s, 29.1 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:01:05,120::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:01:05,121::task::595::TaskManager.Task::(_updateState) Task=`bfa582b4-487d-4dee-8898-cacb5821bd6d`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:01:05,121::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:01:05,122::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:01:05,122::task::1185::TaskManager.Task::(prepare) Task=`bfa582b4-487d-4dee-8898-cacb5821bd6d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:01:05,122::task::595::TaskManager.Task::(_updateState) Task=`bfa582b4-487d-4dee-8898-cacb5821bd6d`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:01:05,122::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:01:05,122::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:01:05,123::task::990::TaskManager.Task::(_decref) Task=`bfa582b4-487d-4dee-8898-cacb5821bd6d`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:01:05,156::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:01:05,157::task::595::TaskManager.Task::(_updateState) Task=`fe650bc7-9184-4aff-9f52-13bc44279f01`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:01:05,157::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:01:05,157::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1c7746c0-b90f-4b91-a10b-cb8dcf5c2293`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:01:05,157::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:01:05,158::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:01:05,158::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1c7746c0-b90f-4b91-a10b-cb8dcf5c2293`::Granted request >Thread-34::DEBUG::2014-07-24 11:01:05,159::task::827::TaskManager.Task::(resourceAcquired) Task=`fe650bc7-9184-4aff-9f52-13bc44279f01`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:01:05,159::task::990::TaskManager.Task::(_decref) Task=`fe650bc7-9184-4aff-9f52-13bc44279f01`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:01:05,160::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:01:05,160::task::1185::TaskManager.Task::(prepare) Task=`fe650bc7-9184-4aff-9f52-13bc44279f01`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:01:05,161::task::595::TaskManager.Task::(_updateState) Task=`fe650bc7-9184-4aff-9f52-13bc44279f01`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:01:05,161::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:01:05,161::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:01:05,161::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:01:05,161::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:01:05,161::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:01:05,162::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:01:05,162::task::990::TaskManager.Task::(_decref) Task=`fe650bc7-9184-4aff-9f52-13bc44279f01`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:01:05,677::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:01:05,753::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035378 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:01:07,765::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:01:07,839::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347164 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:01:09,852::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:01:09,928::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364315 s, 28.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:01:10,750::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 23aa0606-edc3-4882-a4aa-18aa1983458f >Thread-18::DEBUG::2014-07-24 11:01:10,751::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-18::DEBUG::2014-07-24 11:01:10,751::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:01:10,771::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.0109645 s, 187 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:01:10,772::misc::264::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.0109645 s, 187 kB/s'], size: 2048 >Thread-18::DEBUG::2014-07-24 11:01:10,776::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-18::WARNING::2014-07-24 11:01:10,776::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-18::DEBUG::2014-07-24 11:01:10,776::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-18::DEBUG::2014-07-24 11:01:10,776::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 11:01:10,776::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 11:01:10,777::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 11:01:10,777::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 11:01:10,777::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 11:01:10,778::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-18::DEBUG::2014-07-24 11:01:10,992::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:01:10,994::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 11:01:10,994::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'LOCKPOLICY=', 'POOL_DOMAINS=23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'POOL_DESCRIPTION=DS1', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_UUID=637ea13c-81a8-4b44-8cab-961458b01883', 'POOL_SPM_ID=1', '_SHA_CKSUM=a749afdc7119a2d6aad840af5c63c9b28c0b612c', 'POOL_SPM_LVER=0'] >Thread-18::INFO::2014-07-24 11:01:10,995::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_imageNS already registered >Thread-18::INFO::2014-07-24 11:01:10,995::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_volumeNS already registered >Thread-18::INFO::2014-07-24 11:01:10,995::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_lvmActivationNS already registered >Thread-18::DEBUG::2014-07-24 11:01:10,996::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-18::DEBUG::2014-07-24 11:01:11,149::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:01:11,150::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:01:11,160::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000872684 s, 4.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:01:11,940::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:01:12,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365269 s, 28.0 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:01:12,169::task::595::TaskManager.Task::(_updateState) Task=`f104f37f-b882-439b-b524-6504fb590edc`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:01:12,169::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:01:12,170::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000872684', 'lastCheck': '1.0', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:01:12,170::task::1185::TaskManager.Task::(prepare) Task=`f104f37f-b882-439b-b524-6504fb590edc`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000872684', 'lastCheck': '1.0', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:01:12,170::task::595::TaskManager.Task::(_updateState) Task=`f104f37f-b882-439b-b524-6504fb590edc`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:01:12,170::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:01:12,170::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:01:12,170::task::990::TaskManager.Task::(_decref) Task=`f104f37f-b882-439b-b524-6504fb590edc`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:01:14,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:01:14,104::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036583 s, 28.0 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:01:15,272::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:01:15,273::task::595::TaskManager.Task::(_updateState) Task=`722f78e4-faac-4de8-898f-668924b54c56`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:01:15,273::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:01:15,273::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:01:15,273::task::1185::TaskManager.Task::(prepare) Task=`722f78e4-faac-4de8-898f-668924b54c56`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:01:15,274::task::595::TaskManager.Task::(_updateState) Task=`722f78e4-faac-4de8-898f-668924b54c56`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:01:15,274::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:01:15,274::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:01:15,274::task::990::TaskManager.Task::(_decref) Task=`722f78e4-faac-4de8-898f-668924b54c56`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:01:15,310::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:01:15,311::task::595::TaskManager.Task::(_updateState) Task=`96e57036-e440-47a9-807c-841cfbff6c86`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:01:15,311::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:01:15,311::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`042094f5-1a2e-480b-86d8-cf60f990cae3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:01:15,311::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:01:15,312::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:01:15,312::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`042094f5-1a2e-480b-86d8-cf60f990cae3`::Granted request >Thread-34::DEBUG::2014-07-24 11:01:15,312::task::827::TaskManager.Task::(resourceAcquired) Task=`96e57036-e440-47a9-807c-841cfbff6c86`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:01:15,312::task::990::TaskManager.Task::(_decref) Task=`96e57036-e440-47a9-807c-841cfbff6c86`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:01:15,313::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:01:15,313::task::1185::TaskManager.Task::(prepare) Task=`96e57036-e440-47a9-807c-841cfbff6c86`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:01:15,313::task::595::TaskManager.Task::(_updateState) Task=`96e57036-e440-47a9-807c-841cfbff6c86`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:01:15,314::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:01:15,314::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:01:15,314::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:01:15,314::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:01:15,314::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:01:15,314::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:01:15,315::task::990::TaskManager.Task::(_decref) Task=`96e57036-e440-47a9-807c-841cfbff6c86`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:01:16,116::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:01:16,189::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337778 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:01:18,201::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:01:18,276::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359228 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:01:20,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:01:20,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366629 s, 27.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:01:21,165::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:01:21,180::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00637633 s, 642 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:01:22,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:01:22,453::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367387 s, 27.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:01:24,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:01:24,542::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0383186 s, 26.7 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:01:25,372::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:01:25,373::task::595::TaskManager.Task::(_updateState) Task=`e18b32b2-8a37-4dec-91a9-1e4fe695f4f4`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:01:25,373::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:01:25,374::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:01:25,374::task::1185::TaskManager.Task::(prepare) Task=`e18b32b2-8a37-4dec-91a9-1e4fe695f4f4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:01:25,374::task::595::TaskManager.Task::(_updateState) Task=`e18b32b2-8a37-4dec-91a9-1e4fe695f4f4`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:01:25,374::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:01:25,374::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:01:25,374::task::990::TaskManager.Task::(_decref) Task=`e18b32b2-8a37-4dec-91a9-1e4fe695f4f4`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:01:25,410::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:01:25,410::task::595::TaskManager.Task::(_updateState) Task=`b35d6e11-0ef3-4fe4-8a13-07735a7f8e9f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:01:25,411::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:01:25,411::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b198d236-8e78-4151-9212-5e9815e9786e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:01:25,411::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:01:25,411::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:01:25,412::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b198d236-8e78-4151-9212-5e9815e9786e`::Granted request >Thread-34::DEBUG::2014-07-24 11:01:25,412::task::827::TaskManager.Task::(resourceAcquired) Task=`b35d6e11-0ef3-4fe4-8a13-07735a7f8e9f`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:01:25,412::task::990::TaskManager.Task::(_decref) Task=`b35d6e11-0ef3-4fe4-8a13-07735a7f8e9f`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:01:25,413::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:01:25,413::task::1185::TaskManager.Task::(prepare) Task=`b35d6e11-0ef3-4fe4-8a13-07735a7f8e9f`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:01:25,413::task::595::TaskManager.Task::(_updateState) Task=`b35d6e11-0ef3-4fe4-8a13-07735a7f8e9f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:01:25,413::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:01:25,413::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:01:25,414::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:01:25,414::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:01:25,414::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:01:25,414::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:01:25,414::task::990::TaskManager.Task::(_decref) Task=`b35d6e11-0ef3-4fe4-8a13-07735a7f8e9f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:01:26,554::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:01:26,631::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364265 s, 28.1 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:01:27,523::task::595::TaskManager.Task::(_updateState) Task=`0f335478-8f58-4f58-bba3-d6f47bb85eb3`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:01:27,524::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:01:27,524::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00637633', 'lastCheck': '6.3', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:01:27,524::task::1185::TaskManager.Task::(prepare) Task=`0f335478-8f58-4f58-bba3-d6f47bb85eb3`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00637633', 'lastCheck': '6.3', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:01:27,524::task::595::TaskManager.Task::(_updateState) Task=`0f335478-8f58-4f58-bba3-d6f47bb85eb3`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:01:27,524::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:01:27,524::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:01:27,525::task::990::TaskManager.Task::(_decref) Task=`0f335478-8f58-4f58-bba3-d6f47bb85eb3`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-07-24 11:01:28,102::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:01:28,643::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:01:28,719::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368406 s, 27.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:01:30,732::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:01:30,808::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361994 s, 28.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:01:31,185::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:01:31,205::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0109602 s, 374 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:01:32,820::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:01:32,894::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351385 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:01:34,907::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:01:34,979::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337442 s, 30.3 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:01:35,475::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:01:35,476::task::595::TaskManager.Task::(_updateState) Task=`f10ca9ba-d56a-450f-9ac0-923f0c062784`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:01:35,476::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:01:35,476::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:01:35,476::task::1185::TaskManager.Task::(prepare) Task=`f10ca9ba-d56a-450f-9ac0-923f0c062784`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:01:35,477::task::595::TaskManager.Task::(_updateState) Task=`f10ca9ba-d56a-450f-9ac0-923f0c062784`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:01:35,477::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:01:35,477::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:01:35,477::task::990::TaskManager.Task::(_decref) Task=`f10ca9ba-d56a-450f-9ac0-923f0c062784`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:01:35,508::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:01:35,508::task::595::TaskManager.Task::(_updateState) Task=`e164bd7e-3c2f-4fdc-ba0c-4af2118a0a91`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:01:35,509::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:01:35,509::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e93aafbf-c12a-4488-b74f-37aceb0736f2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:01:35,509::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:01:35,509::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:01:35,510::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e93aafbf-c12a-4488-b74f-37aceb0736f2`::Granted request >Thread-34::DEBUG::2014-07-24 11:01:35,510::task::827::TaskManager.Task::(resourceAcquired) Task=`e164bd7e-3c2f-4fdc-ba0c-4af2118a0a91`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:01:35,510::task::990::TaskManager.Task::(_decref) Task=`e164bd7e-3c2f-4fdc-ba0c-4af2118a0a91`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:01:35,511::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:01:35,511::task::1185::TaskManager.Task::(prepare) Task=`e164bd7e-3c2f-4fdc-ba0c-4af2118a0a91`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:01:35,511::task::595::TaskManager.Task::(_updateState) Task=`e164bd7e-3c2f-4fdc-ba0c-4af2118a0a91`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:01:35,511::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:01:35,512::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:01:35,512::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:01:35,512::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:01:35,512::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:01:35,512::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:01:35,513::task::990::TaskManager.Task::(_decref) Task=`e164bd7e-3c2f-4fdc-ba0c-4af2118a0a91`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:01:36,991::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:01:37,065::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344886 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:01:39,077::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:01:39,151::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034529 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:01:41,163::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-24 11:01:41,213::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:01:41,229::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000598931 s, 6.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:01:41,287::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358281 s, 28.6 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:01:42,896::task::595::TaskManager.Task::(_updateState) Task=`049d2e7f-26a7-4135-bd30-858e4811d0c1`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:01:42,897::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:01:42,897::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000598931', 'lastCheck': '1.6', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:01:42,897::task::1185::TaskManager.Task::(prepare) Task=`049d2e7f-26a7-4135-bd30-858e4811d0c1`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000598931', 'lastCheck': '1.6', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:01:42,897::task::595::TaskManager.Task::(_updateState) Task=`049d2e7f-26a7-4135-bd30-858e4811d0c1`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:01:42,897::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:01:42,898::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:01:42,898::task::990::TaskManager.Task::(_decref) Task=`049d2e7f-26a7-4135-bd30-858e4811d0c1`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:01:43,299::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:01:43,375::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358926 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:01:45,387::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:01:45,461::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350859 s, 29.2 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:01:45,570::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:01:45,570::task::595::TaskManager.Task::(_updateState) Task=`6fbcecf1-fd06-41f7-86c5-5b128f538bec`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:01:45,570::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:01:45,571::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:01:45,571::task::1185::TaskManager.Task::(prepare) Task=`6fbcecf1-fd06-41f7-86c5-5b128f538bec`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:01:45,571::task::595::TaskManager.Task::(_updateState) Task=`6fbcecf1-fd06-41f7-86c5-5b128f538bec`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:01:45,571::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:01:45,571::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:01:45,572::task::990::TaskManager.Task::(_decref) Task=`6fbcecf1-fd06-41f7-86c5-5b128f538bec`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:01:45,604::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:01:45,605::task::595::TaskManager.Task::(_updateState) Task=`6360c293-c324-4fe1-b22d-d4c52895b373`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:01:45,605::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:01:45,605::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`8f7df765-3faf-4b56-8860-4aab6ce317d2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:01:45,606::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:01:45,606::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:01:45,606::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`8f7df765-3faf-4b56-8860-4aab6ce317d2`::Granted request >Thread-34::DEBUG::2014-07-24 11:01:45,606::task::827::TaskManager.Task::(resourceAcquired) Task=`6360c293-c324-4fe1-b22d-d4c52895b373`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:01:45,606::task::990::TaskManager.Task::(_decref) Task=`6360c293-c324-4fe1-b22d-d4c52895b373`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:01:45,607::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:01:45,607::task::1185::TaskManager.Task::(prepare) Task=`6360c293-c324-4fe1-b22d-d4c52895b373`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:01:45,608::task::595::TaskManager.Task::(_updateState) Task=`6360c293-c324-4fe1-b22d-d4c52895b373`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:01:45,608::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:01:45,608::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:01:45,608::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:01:45,608::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:01:45,608::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:01:45,609::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:01:45,609::task::990::TaskManager.Task::(_decref) Task=`6360c293-c324-4fe1-b22d-d4c52895b373`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:01:47,494::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:01:47,569::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362553 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:01:49,582::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:01:49,656::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035425 s, 28.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:01:51,259::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:01:51,281::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0119723 s, 342 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:01:51,669::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:01:51,742::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034195 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:01:53,754::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:01:53,840::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0467095 s, 21.9 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:01:55,663::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:01:55,672::task::595::TaskManager.Task::(_updateState) Task=`9ca18bcd-d972-4408-9b8b-d5840c356257`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:01:55,672::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:01:55,673::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:01:55,673::task::1185::TaskManager.Task::(prepare) Task=`9ca18bcd-d972-4408-9b8b-d5840c356257`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:01:55,673::task::595::TaskManager.Task::(_updateState) Task=`9ca18bcd-d972-4408-9b8b-d5840c356257`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:01:55,673::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:01:55,673::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:01:55,673::task::990::TaskManager.Task::(_decref) Task=`9ca18bcd-d972-4408-9b8b-d5840c356257`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:01:55,710::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:01:55,711::task::595::TaskManager.Task::(_updateState) Task=`5b42b20d-4e75-46c6-a513-c7b22c48a1d4`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:01:55,711::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:01:55,711::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`48ff8b27-0147-435d-8a01-6256d4abc541`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:01:55,711::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:01:55,712::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:01:55,712::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`48ff8b27-0147-435d-8a01-6256d4abc541`::Granted request >Thread-34::DEBUG::2014-07-24 11:01:55,712::task::827::TaskManager.Task::(resourceAcquired) Task=`5b42b20d-4e75-46c6-a513-c7b22c48a1d4`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:01:55,712::task::990::TaskManager.Task::(_decref) Task=`5b42b20d-4e75-46c6-a513-c7b22c48a1d4`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:01:55,713::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:01:55,713::task::1185::TaskManager.Task::(prepare) Task=`5b42b20d-4e75-46c6-a513-c7b22c48a1d4`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:01:55,713::task::595::TaskManager.Task::(_updateState) Task=`5b42b20d-4e75-46c6-a513-c7b22c48a1d4`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:01:55,714::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:01:55,714::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:01:55,714::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:01:55,714::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:01:55,714::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:01:55,714::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:01:55,715::task::990::TaskManager.Task::(_decref) Task=`5b42b20d-4e75-46c6-a513-c7b22c48a1d4`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:01:55,853::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:01:55,926::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340501 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:01:57,938::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:01:58,017::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0396074 s, 25.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:01:58,138::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-13::DEBUG::2014-07-24 11:01:58,282::task::595::TaskManager.Task::(_updateState) Task=`f57131e3-6db3-4691-b820-26b792369f43`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:01:58,283::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:01:58,283::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0119723', 'lastCheck': '7.0', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:01:58,284::task::1185::TaskManager.Task::(prepare) Task=`f57131e3-6db3-4691-b820-26b792369f43`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0119723', 'lastCheck': '7.0', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:01:58,284::task::595::TaskManager.Task::(_updateState) Task=`f57131e3-6db3-4691-b820-26b792369f43`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:01:58,284::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:01:58,284::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:01:58,284::task::990::TaskManager.Task::(_decref) Task=`f57131e3-6db3-4691-b820-26b792369f43`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:02:00,030::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:02:00,104::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351118 s, 29.2 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:02:00,686::task::595::TaskManager.Task::(_updateState) Task=`b34c0fa9-2acd-4c4f-879a-4572b5945a01`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:02:00,686::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:02:00,686::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:02:00,687::task::1185::TaskManager.Task::(prepare) Task=`b34c0fa9-2acd-4c4f-879a-4572b5945a01`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:02:00,687::task::595::TaskManager.Task::(_updateState) Task=`b34c0fa9-2acd-4c4f-879a-4572b5945a01`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:02:00,687::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:02:00,687::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:02:00,687::task::990::TaskManager.Task::(_decref) Task=`b34c0fa9-2acd-4c4f-879a-4572b5945a01`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:02:01,285::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:02:01,294::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000631754 s, 6.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:02:02,117::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:02:02,193::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361393 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:02:04,205::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:02:04,280::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365559 s, 28.0 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:02:05,783::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:02:05,791::task::595::TaskManager.Task::(_updateState) Task=`f66d7ef5-662f-4e18-9a55-e78f31030b09`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:02:05,791::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:02:05,792::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:02:05,792::task::1185::TaskManager.Task::(prepare) Task=`f66d7ef5-662f-4e18-9a55-e78f31030b09`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:02:05,792::task::595::TaskManager.Task::(_updateState) Task=`f66d7ef5-662f-4e18-9a55-e78f31030b09`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:02:05,792::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:02:05,792::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:02:05,792::task::990::TaskManager.Task::(_decref) Task=`f66d7ef5-662f-4e18-9a55-e78f31030b09`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:02:05,852::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:02:05,852::task::595::TaskManager.Task::(_updateState) Task=`0d1a3069-4fae-4842-b3a5-011479a74206`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:02:05,853::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:02:05,853::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c4cb9dc5-a6bb-424d-a103-a91152593b0e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:02:05,853::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:02:05,853::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:02:05,854::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c4cb9dc5-a6bb-424d-a103-a91152593b0e`::Granted request >Thread-34::DEBUG::2014-07-24 11:02:05,854::task::827::TaskManager.Task::(resourceAcquired) Task=`0d1a3069-4fae-4842-b3a5-011479a74206`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:02:05,854::task::990::TaskManager.Task::(_decref) Task=`0d1a3069-4fae-4842-b3a5-011479a74206`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:02:05,855::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:02:05,855::task::1185::TaskManager.Task::(prepare) Task=`0d1a3069-4fae-4842-b3a5-011479a74206`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:02:05,855::task::595::TaskManager.Task::(_updateState) Task=`0d1a3069-4fae-4842-b3a5-011479a74206`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:02:05,855::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:02:05,856::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:02:05,856::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:02:05,856::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:02:05,856::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:02:05,856::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:02:05,857::task::990::TaskManager.Task::(_decref) Task=`0d1a3069-4fae-4842-b3a5-011479a74206`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:02:06,293::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:02:06,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364635 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:02:08,381::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:02:08,455::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354365 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:02:10,468::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:02:10,543::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362209 s, 28.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:02:11,299::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:02:11,314::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00601407 s, 681 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:02:12,555::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:02:12,628::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337306 s, 30.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:02:13,675::task::595::TaskManager.Task::(_updateState) Task=`e794a192-7962-4e34-9c22-3763d5f60507`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:02:13,675::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:02:13,676::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00601407', 'lastCheck': '2.4', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:02:13,676::task::1185::TaskManager.Task::(prepare) Task=`e794a192-7962-4e34-9c22-3763d5f60507`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00601407', 'lastCheck': '2.4', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:02:13,676::task::595::TaskManager.Task::(_updateState) Task=`e794a192-7962-4e34-9c22-3763d5f60507`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:02:13,676::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:02:13,676::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:02:13,676::task::990::TaskManager.Task::(_decref) Task=`e794a192-7962-4e34-9c22-3763d5f60507`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:02:14,640::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:02:14,721::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0382025 s, 26.8 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:02:15,933::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:02:15,933::task::595::TaskManager.Task::(_updateState) Task=`59194a02-7474-4f6d-921b-d85a66549ab4`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:02:15,933::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:02:15,934::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:02:15,934::task::1185::TaskManager.Task::(prepare) Task=`59194a02-7474-4f6d-921b-d85a66549ab4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:02:15,934::task::595::TaskManager.Task::(_updateState) Task=`59194a02-7474-4f6d-921b-d85a66549ab4`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:02:15,934::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:02:15,934::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:02:15,935::task::990::TaskManager.Task::(_decref) Task=`59194a02-7474-4f6d-921b-d85a66549ab4`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:02:15,981::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:02:15,981::task::595::TaskManager.Task::(_updateState) Task=`174bffaa-ada6-4850-ae67-4511c951dbed`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:02:15,982::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:02:15,982::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`33865b8f-ff39-48cc-bcb3-c5daf6c33806`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:02:15,982::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:02:15,982::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:02:15,983::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`33865b8f-ff39-48cc-bcb3-c5daf6c33806`::Granted request >Thread-34::DEBUG::2014-07-24 11:02:15,983::task::827::TaskManager.Task::(resourceAcquired) Task=`174bffaa-ada6-4850-ae67-4511c951dbed`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:02:15,983::task::990::TaskManager.Task::(_decref) Task=`174bffaa-ada6-4850-ae67-4511c951dbed`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:02:15,984::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:02:15,984::task::1185::TaskManager.Task::(prepare) Task=`174bffaa-ada6-4850-ae67-4511c951dbed`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:02:15,984::task::595::TaskManager.Task::(_updateState) Task=`174bffaa-ada6-4850-ae67-4511c951dbed`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:02:15,984::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:02:15,985::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:02:15,985::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:02:15,985::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:02:15,985::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:02:15,985::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:02:15,985::task::990::TaskManager.Task::(_decref) Task=`174bffaa-ada6-4850-ae67-4511c951dbed`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:02:16,734::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:02:16,807::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336578 s, 30.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:02:18,819::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:02:18,894::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351465 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:02:20,906::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:02:20,981::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364294 s, 28.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:02:21,319::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:02:21,340::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0120303 s, 340 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:02:22,993::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:02:23,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341444 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:02:25,079::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:02:25,154::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036084 s, 28.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:02:26,092::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:02:26,093::task::595::TaskManager.Task::(_updateState) Task=`0b6275b4-58de-44f4-b504-5d6432573249`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:02:26,093::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:02:26,094::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:02:26,094::task::1185::TaskManager.Task::(prepare) Task=`0b6275b4-58de-44f4-b504-5d6432573249`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:02:26,094::task::595::TaskManager.Task::(_updateState) Task=`0b6275b4-58de-44f4-b504-5d6432573249`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:02:26,094::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:02:26,094::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:02:26,094::task::990::TaskManager.Task::(_decref) Task=`0b6275b4-58de-44f4-b504-5d6432573249`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:02:26,140::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:02:26,141::task::595::TaskManager.Task::(_updateState) Task=`c263de1d-f48b-4340-b69e-418701a7a79d`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:02:26,141::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:02:26,141::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`134d5d14-3494-46af-be12-42215c596f61`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:02:26,141::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:02:26,142::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:02:26,142::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`134d5d14-3494-46af-be12-42215c596f61`::Granted request >Thread-34::DEBUG::2014-07-24 11:02:26,142::task::827::TaskManager.Task::(resourceAcquired) Task=`c263de1d-f48b-4340-b69e-418701a7a79d`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:02:26,142::task::990::TaskManager.Task::(_decref) Task=`c263de1d-f48b-4340-b69e-418701a7a79d`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:02:26,143::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:02:26,143::task::1185::TaskManager.Task::(prepare) Task=`c263de1d-f48b-4340-b69e-418701a7a79d`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:02:26,143::task::595::TaskManager.Task::(_updateState) Task=`c263de1d-f48b-4340-b69e-418701a7a79d`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:02:26,144::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:02:26,144::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:02:26,144::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:02:26,144::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:02:26,144::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:02:26,144::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:02:26,145::task::990::TaskManager.Task::(_decref) Task=`c263de1d-f48b-4340-b69e-418701a7a79d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:02:27,167::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:02:27,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03462 s, 29.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:02:28,176::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:02:29,253::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:02:29,328::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364079 s, 28.1 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:02:29,433::task::595::TaskManager.Task::(_updateState) Task=`0f6396e7-0894-43f4-88c2-65a1090c9e89`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:02:29,433::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:02:29,434::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0120303', 'lastCheck': '8.1', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:02:29,434::task::1185::TaskManager.Task::(prepare) Task=`0f6396e7-0894-43f4-88c2-65a1090c9e89`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0120303', 'lastCheck': '8.1', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:02:29,434::task::595::TaskManager.Task::(_updateState) Task=`0f6396e7-0894-43f4-88c2-65a1090c9e89`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:02:29,434::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:02:29,434::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:02:29,434::task::990::TaskManager.Task::(_decref) Task=`0f6396e7-0894-43f4-88c2-65a1090c9e89`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:02:31,340::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-24 11:02:31,351::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:02:31,370::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00472359 s, 867 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:02:31,449::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0694496 s, 14.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:02:33,461::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:02:33,818::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.317536 s, 3.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:02:35,831::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:02:35,903::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339486 s, 30.2 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:02:36,243::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:02:36,243::task::595::TaskManager.Task::(_updateState) Task=`3e13a375-30c8-4f3e-a531-592a007b1cb1`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:02:36,244::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:02:36,244::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:02:36,244::task::1185::TaskManager.Task::(prepare) Task=`3e13a375-30c8-4f3e-a531-592a007b1cb1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:02:36,244::task::595::TaskManager.Task::(_updateState) Task=`3e13a375-30c8-4f3e-a531-592a007b1cb1`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:02:36,244::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:02:36,245::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:02:36,245::task::990::TaskManager.Task::(_decref) Task=`3e13a375-30c8-4f3e-a531-592a007b1cb1`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:02:36,292::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:02:36,292::task::595::TaskManager.Task::(_updateState) Task=`9e803f46-a6c5-40f8-95aa-43dda12b8443`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:02:36,292::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:02:36,292::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b99c53f9-0b63-400e-8cc5-af1c5936d5fa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:02:36,293::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:02:36,293::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:02:36,293::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b99c53f9-0b63-400e-8cc5-af1c5936d5fa`::Granted request >Thread-34::DEBUG::2014-07-24 11:02:36,293::task::827::TaskManager.Task::(resourceAcquired) Task=`9e803f46-a6c5-40f8-95aa-43dda12b8443`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:02:36,294::task::990::TaskManager.Task::(_decref) Task=`9e803f46-a6c5-40f8-95aa-43dda12b8443`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:02:36,294::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:02:36,294::task::1185::TaskManager.Task::(prepare) Task=`9e803f46-a6c5-40f8-95aa-43dda12b8443`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:02:36,295::task::595::TaskManager.Task::(_updateState) Task=`9e803f46-a6c5-40f8-95aa-43dda12b8443`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:02:36,295::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:02:36,295::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:02:36,295::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:02:36,295::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:02:36,295::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:02:36,296::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:02:36,296::task::990::TaskManager.Task::(_decref) Task=`9e803f46-a6c5-40f8-95aa-43dda12b8443`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:02:37,928::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:02:38,007::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.039608 s, 25.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:02:40,020::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:02:40,095::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361474 s, 28.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:02:41,399::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:02:41,408::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000685477 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:02:42,107::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:02:42,434::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367967 s, 27.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:02:44,457::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:02:44,531::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349285 s, 29.3 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:02:45,313::task::595::TaskManager.Task::(_updateState) Task=`4f1b0939-a38f-409c-b457-d92671ea7506`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:02:45,313::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:02:45,313::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000685477', 'lastCheck': '3.9', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:02:45,313::task::1185::TaskManager.Task::(prepare) Task=`4f1b0939-a38f-409c-b457-d92671ea7506`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000685477', 'lastCheck': '3.9', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:02:45,314::task::595::TaskManager.Task::(_updateState) Task=`4f1b0939-a38f-409c-b457-d92671ea7506`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:02:45,314::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:02:45,314::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:02:45,314::task::990::TaskManager.Task::(_decref) Task=`4f1b0939-a38f-409c-b457-d92671ea7506`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:02:46,333::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:02:46,333::task::595::TaskManager.Task::(_updateState) Task=`2d302aba-a70b-4828-8997-fa5380a33de3`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:02:46,334::logUtils::44::dispatcher::(wrapper) Run and protect: updateVM(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', vmList=[{'imglist': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'ovf': '<?xml version=\'1.0\' encoding=\'UTF-8\'?><ovf:Envelope xmlns:ovf="http://schemas.dmtf.org/ovf/envelope/1/" xmlns:rasd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_ResourceAllocationSettingData" xmlns:vssd="http://schemas.dmtf.org/wbem/wscim/1/cim-schema/2/CIM_VirtualSystemSettingData" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" ovf:version="3.4.0.0"><References><File ovf:href="7afbd34c-3fd8-438a-964b-ff0a25fc709c/e18ca0ee-e29f-4b85-b352-62c5aeed9be2" ovf:id="e18ca0ee-e29f-4b85-b352-62c5aeed9be2" ovf:size="10737418240" ovf:description="Active VM"/><Nic ovf:id="1ed866ec-23e4-4ccd-9379-f34f4e553dae"/></References><Section xsi:type="ovf:NetworkSection_Type"><Info>List of networks</Info><Network ovf:name="Network 1"/></Section><Section xsi:type="ovf:DiskSection_Type"><Info>List of Virtual Disks</Info><Disk ovf:diskId="e18ca0ee-e29f-4b85-b352-62c5aeed9be2" ovf:size="10" ovf:actual_size="3" ovf:vm_snapshot_id="6a189e7d-a52e-491a-adc5-5dd5bd3fe97b" ovf:parentRef="" ovf:fileRef="7afbd34c-3fd8-438a-964b-ff0a25fc709c/e18ca0ee-e29f-4b85-b352-62c5aeed9be2" ovf:format="http://www.gnome.org/~markmc/qcow-image-format.html" ovf:volume-format="COW" ovf:volume-type="Sparse" ovf:disk-interface="VirtIO_SCSI" ovf:boot="true" ovf:disk-alias="VM1_Disk1" ovf:wipe-after-delete="false"/></Section><Content ovf:id="out" xsi:type="ovf:VirtualSystem_Type"><Description></Description><CreationDate>2014/07/24 07:23:30</CreationDate><ExportDate>2014/07/24 08:02:45</ExportDate><DeleteProtected>false</DeleteProtected><SsoMethod>guest_agent</SsoMethod><IsSmartcardEnabled>false</IsSmartcardEnabled><TimeZone></TimeZone><default_boot_sequence>13</default_boot_sequence><Generation>2</Generation><VmType>1</VmType><MinAllocatedMem>1024</MinAllocatedMem><IsStateless>false</IsStateless><IsRunAndPause>false</IsRunAndPause><AutoStartup>false</AutoStartup><Priority>1</Priority><CreatedByUserId>fdfc627c-d875-11e0-90f0-83df133b58cc</CreatedByUserId><Name>VM1</Name><TemplateId>00000000-0000-0000-0000-000000000000</TemplateId><TemplateName>Blank</TemplateName><IsInitilized>true</IsInitilized><Origin>3</Origin><DefaultDisplayType>1</DefaultDisplayType><TrustedService>false</TrustedService><OriginalTemplateId>00000000-0000-0000-0000-000000000000</OriginalTemplateId><OriginalTemplateName>Blank</OriginalTemplateName><UseLatestVersion>false</UseLatestVersion><Section ovf:id="6fca7e11-8f3f-4784-bdab-7e7f9503cd5b" ovf:required="false" xsi:type="ovf:OperatingSystemSection_Type"><Info>Guest Operating System</Info><Description>other</Description></Section><Section xsi:type="ovf:VirtualHardwareSection_Type"><Info>1 CPU, 1024 Memeory</Info><System><vssd:VirtualSystemType>ENGINE 3.4.0.0</vssd:VirtualSystemType></System><Item><rasd:Caption>1 virtual cpu</rasd:Caption><rasd:Description>Number of virtual CPU</rasd:Description><rasd:InstanceId>1</rasd:InstanceId><rasd:ResourceType>3</rasd:ResourceType><rasd:num_of_sockets>1</rasd:num_of_sockets><rasd:cpu_per_socket>1</rasd:cpu_per_socket></Item><Item><rasd:Caption>1024 MB of memory</rasd:Caption><rasd:Description>Memory Size</rasd:Description><rasd:InstanceId>2</rasd:InstanceId><rasd:ResourceType>4</rasd:ResourceType><rasd:AllocationUnits>MegaBytes</rasd:AllocationUnits><rasd:VirtualQuantity>1024</rasd:VirtualQuantity></Item><Item><rasd:Caption>VM1_Disk1</rasd:Caption><rasd:InstanceId>e18ca0ee-e29f-4b85-b352-62c5aeed9be2</rasd:InstanceId><rasd:ResourceType>17</rasd:ResourceType><rasd:HostResource>7afbd34c-3fd8-438a-964b-ff0a25fc709c/e18ca0ee-e29f-4b85-b352-62c5aeed9be2</rasd:HostResource><rasd:Parent>00000000-0000-0000-0000-000000000000</rasd:Parent><rasd:Template>00000000-0000-0000-0000-000000000000</rasd:Template><rasd:ApplicationList></rasd:ApplicationList><rasd:StorageId>23aa0606-edc3-4882-a4aa-18aa1983458f</rasd:StorageId><rasd:StoragePoolId>637ea13c-81a8-4b44-8cab-961458b01883</rasd:StoragePoolId><rasd:CreationDate>2014/07/24 07:24:13</rasd:CreationDate><rasd:LastModified>2014/07/24 07:24:13</rasd:LastModified><rasd:last_modified_date>2014/07/24 08:02:45</rasd:last_modified_date></Item><Item><rasd:Caption>Ethernet adapter on rhevm</rasd:Caption><rasd:InstanceId>1ed866ec-23e4-4ccd-9379-f34f4e553dae</rasd:InstanceId><rasd:ResourceType>10</rasd:ResourceType><rasd:OtherResourceType>rhevm</rasd:OtherResourceType><rasd:ResourceSubType>3</rasd:ResourceSubType><rasd:Connection>rhevm</rasd:Connection><rasd:Linked>true</rasd:Linked><rasd:Name>nic1</rasd:Name><rasd:MACAddress>00:1a:4a:58:22:89</rasd:MACAddress><rasd:speed>1000</rasd:speed></Item><Item><rasd:Caption>USB Controller</rasd:Caption><rasd:InstanceId>3</rasd:InstanceId><rasd:ResourceType>23</rasd:ResourceType><rasd:UsbPolicy>DISABLED</rasd:UsbPolicy></Item></Section></Content></ovf:Envelope>', 'vm': '6fca7e11-8f3f-4784-bdab-7e7f9503cd5b'}], sdUUID=None, options=None) >Thread-34::DEBUG::2014-07-24 11:02:46,334::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`9cbf492d-e2f3-4385-b585-5b471c7d7a59`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1346' at 'updateVM' >Thread-34::DEBUG::2014-07-24 11:02:46,334::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:02:46,335::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:02:46,335::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`9cbf492d-e2f3-4385-b585-5b471c7d7a59`::Granted request >Thread-34::DEBUG::2014-07-24 11:02:46,335::task::827::TaskManager.Task::(resourceAcquired) Task=`2d302aba-a70b-4828-8997-fa5380a33de3`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:02:46,335::task::990::TaskManager.Task::(_decref) Task=`2d302aba-a70b-4828-8997-fa5380a33de3`::ref 1 aborting False >Thread-34::DEBUG::2014-07-24 11:02:46,336::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.vms_23aa0606-edc3-4882-a4aa-18aa1983458f`ReqID=`a0e5fff6-3c99-499f-ba7b-ed7167047fdb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1351' at 'updateVM' >Thread-34::DEBUG::2014-07-24 11:02:46,336::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.vms_23aa0606-edc3-4882-a4aa-18aa1983458f' for lock type 'exclusive' >Thread-34::DEBUG::2014-07-24 11:02:46,336::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.vms_23aa0606-edc3-4882-a4aa-18aa1983458f' is free. Now locking as 'exclusive' (1 active user) >Thread-34::DEBUG::2014-07-24 11:02:46,336::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.vms_23aa0606-edc3-4882-a4aa-18aa1983458f`ReqID=`a0e5fff6-3c99-499f-ba7b-ed7167047fdb`::Granted request >Thread-34::DEBUG::2014-07-24 11:02:46,336::task::827::TaskManager.Task::(resourceAcquired) Task=`2d302aba-a70b-4828-8997-fa5380a33de3`::_resourcesAcquired: Storage.vms_23aa0606-edc3-4882-a4aa-18aa1983458f (exclusive) >Thread-34::DEBUG::2014-07-24 11:02:46,337::task::990::TaskManager.Task::(_decref) Task=`2d302aba-a70b-4828-8997-fa5380a33de3`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:02:46,337::sp::1237::Storage.StoragePool::(updateVM) spUUID=637ea13c-81a8-4b44-8cab-961458b01883 sdUUID=23aa0606-edc3-4882-a4aa-18aa1983458f >Thread-34::INFO::2014-07-24 11:02:46,337::sp::1248::Storage.StoragePool::(updateVM) vmUUID=6fca7e11-8f3f-4784-bdab-7e7f9503cd5b imgList=['7afbd34c-3fd8-438a-964b-ff0a25fc709c'] >Thread-34::INFO::2014-07-24 11:02:46,338::logUtils::47::dispatcher::(wrapper) Run and protect: updateVM, Return response: None >Thread-34::DEBUG::2014-07-24 11:02:46,338::task::1185::TaskManager.Task::(prepare) Task=`2d302aba-a70b-4828-8997-fa5380a33de3`::finished: None >Thread-34::DEBUG::2014-07-24 11:02:46,338::task::595::TaskManager.Task::(_updateState) Task=`2d302aba-a70b-4828-8997-fa5380a33de3`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:02:46,338::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.vms_23aa0606-edc3-4882-a4aa-18aa1983458f': < ResourceRef 'Storage.vms_23aa0606-edc3-4882-a4aa-18aa1983458f', isValid: 'True' obj: 'None'>, 'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:02:46,338::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:02:46,339::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.vms_23aa0606-edc3-4882-a4aa-18aa1983458f' >Thread-34::DEBUG::2014-07-24 11:02:46,339::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.vms_23aa0606-edc3-4882-a4aa-18aa1983458f' (0 active users) >Thread-34::DEBUG::2014-07-24 11:02:46,339::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.vms_23aa0606-edc3-4882-a4aa-18aa1983458f' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:02:46,339::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.vms_23aa0606-edc3-4882-a4aa-18aa1983458f', Clearing records. >Thread-34::DEBUG::2014-07-24 11:02:46,339::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:02:46,340::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:02:46,340::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:02:46,340::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:02:46,340::task::990::TaskManager.Task::(_decref) Task=`2d302aba-a70b-4828-8997-fa5380a33de3`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 11:02:46,484::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:02:46,485::task::595::TaskManager.Task::(_updateState) Task=`46583df4-9e27-4954-9402-7ec6051748ba`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:02:46,485::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:02:46,485::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:02:46,485::task::1185::TaskManager.Task::(prepare) Task=`46583df4-9e27-4954-9402-7ec6051748ba`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:02:46,485::task::595::TaskManager.Task::(_updateState) Task=`46583df4-9e27-4954-9402-7ec6051748ba`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:02:46,486::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:02:46,486::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:02:46,486::task::990::TaskManager.Task::(_decref) Task=`46583df4-9e27-4954-9402-7ec6051748ba`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:02:46,543::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-34::DEBUG::2014-07-24 11:02:46,599::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:02:46,600::task::595::TaskManager.Task::(_updateState) Task=`48f9b27f-b880-461d-800c-2a8800ae5fb7`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:02:46,601::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:02:46,603::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`9f4512f9-fe07-405e-a115-d19f6aaa28b6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:02:46,604::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:02:46,606::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:02:46,606::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`9f4512f9-fe07-405e-a115-d19f6aaa28b6`::Granted request >Thread-34::DEBUG::2014-07-24 11:02:46,608::task::827::TaskManager.Task::(resourceAcquired) Task=`48f9b27f-b880-461d-800c-2a8800ae5fb7`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:02:46,609::task::990::TaskManager.Task::(_decref) Task=`48f9b27f-b880-461d-800c-2a8800ae5fb7`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:02:46,613::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:02:46,614::task::1185::TaskManager.Task::(prepare) Task=`48f9b27f-b880-461d-800c-2a8800ae5fb7`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:02:46,615::task::595::TaskManager.Task::(_updateState) Task=`48f9b27f-b880-461d-800c-2a8800ae5fb7`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:02:46,616::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:02:46,617::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:02:46,618::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:02:46,619::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:02:46,620::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:02:46,621::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:02:46,622::task::990::TaskManager.Task::(_decref) Task=`48f9b27f-b880-461d-800c-2a8800ae5fb7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:02:46,648::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363782 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:02:48,660::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:02:48,734::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352565 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:02:50,746::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:02:50,821::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341319 s, 30.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:02:51,413::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:02:51,432::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0106922 s, 383 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:02:52,833::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:02:52,917::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0441725 s, 23.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:02:54,929::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:02:55,006::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0374165 s, 27.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:02:56,724::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:02:56,724::task::595::TaskManager.Task::(_updateState) Task=`49685b5e-4175-4a09-bb92-a5e0595309a3`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:02:56,725::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:02:56,725::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:02:56,725::task::1185::TaskManager.Task::(prepare) Task=`49685b5e-4175-4a09-bb92-a5e0595309a3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:02:56,725::task::595::TaskManager.Task::(_updateState) Task=`49685b5e-4175-4a09-bb92-a5e0595309a3`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:02:56,725::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:02:56,726::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:02:56,726::task::990::TaskManager.Task::(_decref) Task=`49685b5e-4175-4a09-bb92-a5e0595309a3`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:02:56,772::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:02:56,773::task::595::TaskManager.Task::(_updateState) Task=`53307de7-4e64-4101-8974-83548d776939`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:02:56,773::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:02:56,773::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4d281809-7d7c-480b-874a-f349fce212da`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:02:56,773::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:02:56,774::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:02:56,774::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4d281809-7d7c-480b-874a-f349fce212da`::Granted request >Thread-34::DEBUG::2014-07-24 11:02:56,774::task::827::TaskManager.Task::(resourceAcquired) Task=`53307de7-4e64-4101-8974-83548d776939`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:02:56,774::task::990::TaskManager.Task::(_decref) Task=`53307de7-4e64-4101-8974-83548d776939`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:02:56,775::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:02:56,775::task::1185::TaskManager.Task::(prepare) Task=`53307de7-4e64-4101-8974-83548d776939`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:02:56,775::task::595::TaskManager.Task::(_updateState) Task=`53307de7-4e64-4101-8974-83548d776939`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:02:56,776::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:02:56,776::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:02:56,776::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:02:56,776::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:02:56,776::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:02:56,776::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:02:56,777::task::990::TaskManager.Task::(_decref) Task=`53307de7-4e64-4101-8974-83548d776939`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:02:57,018::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:02:57,092::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348942 s, 29.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:02:58,212::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:02:59,104::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:02:59,178::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035177 s, 29.1 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:03:00,838::task::595::TaskManager.Task::(_updateState) Task=`d5002bb2-0647-432d-b839-6f6208c856ab`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:03:00,838::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:03:00,838::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:03:00,839::task::1185::TaskManager.Task::(prepare) Task=`d5002bb2-0647-432d-b839-6f6208c856ab`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:03:00,839::task::595::TaskManager.Task::(_updateState) Task=`d5002bb2-0647-432d-b839-6f6208c856ab`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:03:00,839::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:03:00,839::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:03:00,839::task::990::TaskManager.Task::(_decref) Task=`d5002bb2-0647-432d-b839-6f6208c856ab`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:03:01,191::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:03:01,265::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352556 s, 29.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:03:01,438::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:03:01,448::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000833339 s, 4.9 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:03:02,313::task::595::TaskManager.Task::(_updateState) Task=`2cd9cc1b-154d-4aeb-9b17-33727f8dfa6f`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:03:02,314::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:03:02,314::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000833339', 'lastCheck': '0.9', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:03:02,314::task::1185::TaskManager.Task::(prepare) Task=`2cd9cc1b-154d-4aeb-9b17-33727f8dfa6f`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000833339', 'lastCheck': '0.9', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:03:02,314::task::595::TaskManager.Task::(_updateState) Task=`2cd9cc1b-154d-4aeb-9b17-33727f8dfa6f`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:03:02,314::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:03:02,314::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:03:02,315::task::990::TaskManager.Task::(_decref) Task=`2cd9cc1b-154d-4aeb-9b17-33727f8dfa6f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:03:03,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:03:03,353::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364809 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:03:05,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:03:05,441::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351309 s, 29.1 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:03:06,882::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:03:06,882::task::595::TaskManager.Task::(_updateState) Task=`4d118580-b079-4b36-bbf5-5713af2f4d77`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:03:06,882::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:03:06,883::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:03:06,883::task::1185::TaskManager.Task::(prepare) Task=`4d118580-b079-4b36-bbf5-5713af2f4d77`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:03:06,883::task::595::TaskManager.Task::(_updateState) Task=`4d118580-b079-4b36-bbf5-5713af2f4d77`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:03:06,883::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:03:06,883::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:03:06,883::task::990::TaskManager.Task::(_decref) Task=`4d118580-b079-4b36-bbf5-5713af2f4d77`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:03:06,930::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:03:06,931::task::595::TaskManager.Task::(_updateState) Task=`1c5c8ea1-0110-43a4-b97c-eb663476b551`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:03:06,931::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:03:06,931::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c2025319-61a6-4089-b48f-35c4df2ef4aa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:03:06,931::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:03:06,932::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:03:06,932::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c2025319-61a6-4089-b48f-35c4df2ef4aa`::Granted request >Thread-34::DEBUG::2014-07-24 11:03:06,932::task::827::TaskManager.Task::(resourceAcquired) Task=`1c5c8ea1-0110-43a4-b97c-eb663476b551`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:03:06,932::task::990::TaskManager.Task::(_decref) Task=`1c5c8ea1-0110-43a4-b97c-eb663476b551`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:03:06,933::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:03:06,933::task::1185::TaskManager.Task::(prepare) Task=`1c5c8ea1-0110-43a4-b97c-eb663476b551`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:03:06,933::task::595::TaskManager.Task::(_updateState) Task=`1c5c8ea1-0110-43a4-b97c-eb663476b551`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:03:06,933::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:03:06,934::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:03:06,934::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:03:06,934::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:03:06,934::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:03:06,934::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:03:06,935::task::990::TaskManager.Task::(_decref) Task=`1c5c8ea1-0110-43a4-b97c-eb663476b551`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:03:07,454::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:03:07,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347917 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:03:09,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:03:09,613::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341869 s, 30.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:03:11,452::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:03:11,466::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00510107 s, 803 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:03:11,625::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:03:11,704::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357544 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:03:13,716::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:03:13,791::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350139 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:03:15,804::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:03:15,878::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352408 s, 29.1 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:03:17,104::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:03:17,105::task::595::TaskManager.Task::(_updateState) Task=`5a76e92e-7ddd-405d-89bf-c35a4da52ff5`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:03:17,105::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:03:17,105::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:03:17,105::task::1185::TaskManager.Task::(prepare) Task=`5a76e92e-7ddd-405d-89bf-c35a4da52ff5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:03:17,106::task::595::TaskManager.Task::(_updateState) Task=`5a76e92e-7ddd-405d-89bf-c35a4da52ff5`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:03:17,106::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:03:17,106::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:03:17,106::task::990::TaskManager.Task::(_decref) Task=`5a76e92e-7ddd-405d-89bf-c35a4da52ff5`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:03:17,153::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:03:17,153::task::595::TaskManager.Task::(_updateState) Task=`95ba0cd5-9772-4a94-bca9-f341dc657414`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:03:17,153::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:03:17,154::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`2f69f6e0-8a7e-4df7-ac1b-c01053334651`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:03:17,154::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:03:17,154::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:03:17,154::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`2f69f6e0-8a7e-4df7-ac1b-c01053334651`::Granted request >Thread-34::DEBUG::2014-07-24 11:03:17,155::task::827::TaskManager.Task::(resourceAcquired) Task=`95ba0cd5-9772-4a94-bca9-f341dc657414`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:03:17,155::task::990::TaskManager.Task::(_decref) Task=`95ba0cd5-9772-4a94-bca9-f341dc657414`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:03:17,155::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:03:17,156::task::1185::TaskManager.Task::(prepare) Task=`95ba0cd5-9772-4a94-bca9-f341dc657414`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:03:17,156::task::595::TaskManager.Task::(_updateState) Task=`95ba0cd5-9772-4a94-bca9-f341dc657414`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:03:17,156::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:03:17,156::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:03:17,156::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:03:17,156::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:03:17,157::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:03:17,157::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:03:17,157::task::990::TaskManager.Task::(_decref) Task=`95ba0cd5-9772-4a94-bca9-f341dc657414`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:03:17,890::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:03:17,964::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347187 s, 29.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:03:18,100::task::595::TaskManager.Task::(_updateState) Task=`8160c5e4-ad87-456a-b78c-4b595579df43`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:03:18,101::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:03:18,101::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00510107', 'lastCheck': '6.6', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:03:18,101::task::1185::TaskManager.Task::(prepare) Task=`8160c5e4-ad87-456a-b78c-4b595579df43`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00510107', 'lastCheck': '6.6', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:03:18,101::task::595::TaskManager.Task::(_updateState) Task=`8160c5e4-ad87-456a-b78c-4b595579df43`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:03:18,101::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:03:18,101::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:03:18,102::task::990::TaskManager.Task::(_decref) Task=`8160c5e4-ad87-456a-b78c-4b595579df43`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:03:19,976::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:03:20,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358178 s, 28.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:03:21,471::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:03:21,491::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0121781 s, 336 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:03:22,076::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:03:22,154::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0376336 s, 27.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:03:24,166::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:03:24,240::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034797 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:03:26,253::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:03:26,328::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352776 s, 29.0 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:03:27,260::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:03:27,261::task::595::TaskManager.Task::(_updateState) Task=`f2b790e8-92d8-4bb1-bd29-c82412836d30`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:03:27,261::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:03:27,262::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:03:27,262::task::1185::TaskManager.Task::(prepare) Task=`f2b790e8-92d8-4bb1-bd29-c82412836d30`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:03:27,262::task::595::TaskManager.Task::(_updateState) Task=`f2b790e8-92d8-4bb1-bd29-c82412836d30`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:03:27,262::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:03:27,262::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:03:27,262::task::990::TaskManager.Task::(_decref) Task=`f2b790e8-92d8-4bb1-bd29-c82412836d30`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:03:27,299::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:03:27,299::task::595::TaskManager.Task::(_updateState) Task=`b6c7d263-ac97-4be9-ac26-2c141e88cdd3`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:03:27,299::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:03:27,300::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`9786b20d-467c-494f-9d2e-44a6b1bcf02f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:03:27,300::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:03:27,300::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:03:27,300::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`9786b20d-467c-494f-9d2e-44a6b1bcf02f`::Granted request >Thread-34::DEBUG::2014-07-24 11:03:27,300::task::827::TaskManager.Task::(resourceAcquired) Task=`b6c7d263-ac97-4be9-ac26-2c141e88cdd3`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:03:27,301::task::990::TaskManager.Task::(_decref) Task=`b6c7d263-ac97-4be9-ac26-2c141e88cdd3`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:03:27,301::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:03:27,302::task::1185::TaskManager.Task::(prepare) Task=`b6c7d263-ac97-4be9-ac26-2c141e88cdd3`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:03:27,302::task::595::TaskManager.Task::(_updateState) Task=`b6c7d263-ac97-4be9-ac26-2c141e88cdd3`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:03:27,302::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:03:27,302::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:03:27,302::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:03:27,303::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:03:27,303::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:03:27,303::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:03:27,303::task::990::TaskManager.Task::(_decref) Task=`b6c7d263-ac97-4be9-ac26-2c141e88cdd3`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-07-24 11:03:28,248::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:03:28,340::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:03:28,415::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361429 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:03:30,427::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:03:30,502::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351216 s, 29.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:03:31,496::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:03:31,516::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0121519 s, 337 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:03:32,517::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:03:32,882::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.325689 s, 3.1 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:03:33,705::task::595::TaskManager.Task::(_updateState) Task=`1ccf8a2b-88c5-4928-a195-c3396da9cd2e`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:03:33,705::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:03:33,705::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0121519', 'lastCheck': '2.2', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:03:33,705::task::1185::TaskManager.Task::(prepare) Task=`1ccf8a2b-88c5-4928-a195-c3396da9cd2e`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0121519', 'lastCheck': '2.2', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:03:33,705::task::595::TaskManager.Task::(_updateState) Task=`1ccf8a2b-88c5-4928-a195-c3396da9cd2e`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:03:33,706::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:03:33,706::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:03:33,706::task::990::TaskManager.Task::(_decref) Task=`1ccf8a2b-88c5-4928-a195-c3396da9cd2e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:03:34,894::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:03:35,004::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0706204 s, 14.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:03:37,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:03:37,092::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362823 s, 28.2 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:03:37,370::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:03:37,371::task::595::TaskManager.Task::(_updateState) Task=`da06f7c5-5c73-48d1-bd19-2c07850ed661`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:03:37,371::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:03:37,371::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:03:37,371::task::1185::TaskManager.Task::(prepare) Task=`da06f7c5-5c73-48d1-bd19-2c07850ed661`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:03:37,372::task::595::TaskManager.Task::(_updateState) Task=`da06f7c5-5c73-48d1-bd19-2c07850ed661`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:03:37,372::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:03:37,372::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:03:37,372::task::990::TaskManager.Task::(_decref) Task=`da06f7c5-5c73-48d1-bd19-2c07850ed661`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:03:37,429::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:03:37,430::task::595::TaskManager.Task::(_updateState) Task=`3deedb3d-1967-4812-8a00-552d4aa19b96`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:03:37,430::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:03:37,430::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`49c6b730-f9c6-46c1-8af1-c19d712edbe7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:03:37,430::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:03:37,431::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:03:37,431::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`49c6b730-f9c6-46c1-8af1-c19d712edbe7`::Granted request >Thread-34::DEBUG::2014-07-24 11:03:37,431::task::827::TaskManager.Task::(resourceAcquired) Task=`3deedb3d-1967-4812-8a00-552d4aa19b96`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:03:37,431::task::990::TaskManager.Task::(_decref) Task=`3deedb3d-1967-4812-8a00-552d4aa19b96`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:03:37,432::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:03:37,432::task::1185::TaskManager.Task::(prepare) Task=`3deedb3d-1967-4812-8a00-552d4aa19b96`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:03:37,432::task::595::TaskManager.Task::(_updateState) Task=`3deedb3d-1967-4812-8a00-552d4aa19b96`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:03:37,433::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:03:37,433::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:03:37,433::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:03:37,433::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:03:37,433::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:03:37,434::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:03:37,434::task::990::TaskManager.Task::(_decref) Task=`3deedb3d-1967-4812-8a00-552d4aa19b96`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:03:39,104::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:03:39,179::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352194 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:03:41,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:03:41,266::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355985 s, 28.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:03:41,521::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:03:41,542::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0115411 s, 355 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:03:43,279::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:03:43,355::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369729 s, 27.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:03:45,367::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:03:45,442::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354303 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:03:47,454::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-13::DEBUG::2014-07-24 11:03:47,497::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:03:47,499::task::595::TaskManager.Task::(_updateState) Task=`deaa66c1-17bb-4553-9f09-03f609061ad4`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:03:47,500::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:03:47,502::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:03:47,502::task::1185::TaskManager.Task::(prepare) Task=`deaa66c1-17bb-4553-9f09-03f609061ad4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:03:47,504::task::595::TaskManager.Task::(_updateState) Task=`deaa66c1-17bb-4553-9f09-03f609061ad4`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:03:47,505::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:03:47,506::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:03:47,507::task::990::TaskManager.Task::(_decref) Task=`deaa66c1-17bb-4553-9f09-03f609061ad4`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:03:47,540::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:03:47,542::task::595::TaskManager.Task::(_updateState) Task=`01315390-c10e-4ebf-856b-a06978358c10`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:03:47,542::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:03:47,544::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`310fc589-5d72-43fb-96c1-8db96172eea1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:03:47,545::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:03:47,547::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:03:47,548::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`310fc589-5d72-43fb-96c1-8db96172eea1`::Granted request >Thread-34::DEBUG::2014-07-24 11:03:47,550::task::827::TaskManager.Task::(resourceAcquired) Task=`01315390-c10e-4ebf-856b-a06978358c10`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:03:47,551::task::990::TaskManager.Task::(_decref) Task=`01315390-c10e-4ebf-856b-a06978358c10`::ref 1 aborting False >Dummy-33::DEBUG::2014-07-24 11:03:47,552::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0405669 s, 25.2 MB/s\n'; <rc> = 0 >Thread-34::INFO::2014-07-24 11:03:47,555::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:03:47,556::task::1185::TaskManager.Task::(prepare) Task=`01315390-c10e-4ebf-856b-a06978358c10`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:03:47,557::task::595::TaskManager.Task::(_updateState) Task=`01315390-c10e-4ebf-856b-a06978358c10`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:03:47,558::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:03:47,559::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:03:47,560::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:03:47,561::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:03:47,561::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:03:47,562::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:03:47,562::task::990::TaskManager.Task::(_decref) Task=`01315390-c10e-4ebf-856b-a06978358c10`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 11:03:49,077::task::595::TaskManager.Task::(_updateState) Task=`47efc621-8da9-4282-9d98-67fc8275f158`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:03:49,077::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:03:49,077::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0115411', 'lastCheck': '7.5', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:03:49,078::task::1185::TaskManager.Task::(prepare) Task=`47efc621-8da9-4282-9d98-67fc8275f158`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0115411', 'lastCheck': '7.5', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:03:49,078::task::595::TaskManager.Task::(_updateState) Task=`47efc621-8da9-4282-9d98-67fc8275f158`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:03:49,078::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:03:49,078::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:03:49,078::task::990::TaskManager.Task::(_decref) Task=`47efc621-8da9-4282-9d98-67fc8275f158`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:03:49,576::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:03:49,941::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.326081 s, 3.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:03:51,546::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:03:51,567::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0123158 s, 333 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:03:51,953::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:03:52,064::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0711568 s, 14.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:03:54,076::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:03:54,151::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363096 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:03:56,164::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:03:56,245::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0409248 s, 25.0 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:03:57,625::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:03:57,625::task::595::TaskManager.Task::(_updateState) Task=`c3dd8e74-1e0a-454b-bcb4-9632acadaa32`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:03:57,625::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:03:57,626::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:03:57,626::task::1185::TaskManager.Task::(prepare) Task=`c3dd8e74-1e0a-454b-bcb4-9632acadaa32`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:03:57,626::task::595::TaskManager.Task::(_updateState) Task=`c3dd8e74-1e0a-454b-bcb4-9632acadaa32`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:03:57,626::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:03:57,626::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:03:57,626::task::990::TaskManager.Task::(_decref) Task=`c3dd8e74-1e0a-454b-bcb4-9632acadaa32`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:03:57,660::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:03:57,660::task::595::TaskManager.Task::(_updateState) Task=`ec06dcc6-3232-4889-adeb-72cd6a24350f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:03:57,661::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:03:57,661::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`31299d1c-c139-428d-90fc-4daf23b90d73`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:03:57,661::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:03:57,661::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:03:57,662::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`31299d1c-c139-428d-90fc-4daf23b90d73`::Granted request >Thread-34::DEBUG::2014-07-24 11:03:57,662::task::827::TaskManager.Task::(resourceAcquired) Task=`ec06dcc6-3232-4889-adeb-72cd6a24350f`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:03:57,662::task::990::TaskManager.Task::(_decref) Task=`ec06dcc6-3232-4889-adeb-72cd6a24350f`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:03:57,663::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:03:57,663::task::1185::TaskManager.Task::(prepare) Task=`ec06dcc6-3232-4889-adeb-72cd6a24350f`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:03:57,663::task::595::TaskManager.Task::(_updateState) Task=`ec06dcc6-3232-4889-adeb-72cd6a24350f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:03:57,663::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:03:57,664::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:03:57,664::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:03:57,664::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:03:57,664::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:03:57,664::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:03:57,665::task::990::TaskManager.Task::(_decref) Task=`ec06dcc6-3232-4889-adeb-72cd6a24350f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:03:58,257::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >VM Channels Listener::DEBUG::2014-07-24 11:03:58,285::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:03:58,335::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0391636 s, 26.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:04:00,347::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:04:00,427::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0396002 s, 25.9 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:04:00,986::task::595::TaskManager.Task::(_updateState) Task=`cb26e26d-2e32-484e-b6c3-9c3f0c95c2ed`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:04:00,986::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:04:00,987::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:04:00,987::task::1185::TaskManager.Task::(prepare) Task=`cb26e26d-2e32-484e-b6c3-9c3f0c95c2ed`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:04:00,987::task::595::TaskManager.Task::(_updateState) Task=`cb26e26d-2e32-484e-b6c3-9c3f0c95c2ed`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:04:00,987::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:04:00,987::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:04:00,987::task::990::TaskManager.Task::(_decref) Task=`cb26e26d-2e32-484e-b6c3-9c3f0c95c2ed`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:04:01,571::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:04:01,581::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000766773 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:04:02,439::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:04:02,512::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337384 s, 30.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:04:04,425::task::595::TaskManager.Task::(_updateState) Task=`ed86e791-e529-4a20-a3bb-859c9a1d8c10`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:04:04,425::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:04:04,425::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000766773', 'lastCheck': '2.8', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:04:04,426::task::1185::TaskManager.Task::(prepare) Task=`ed86e791-e529-4a20-a3bb-859c9a1d8c10`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000766773', 'lastCheck': '2.8', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:04:04,426::task::595::TaskManager.Task::(_updateState) Task=`ed86e791-e529-4a20-a3bb-859c9a1d8c10`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:04:04,426::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:04:04,426::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:04:04,426::task::990::TaskManager.Task::(_decref) Task=`ed86e791-e529-4a20-a3bb-859c9a1d8c10`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:04:04,524::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:04:04,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0415965 s, 24.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:04:06,618::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:04:06,693::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363432 s, 28.2 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:04:07,794::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:04:07,794::task::595::TaskManager.Task::(_updateState) Task=`46276236-2545-4957-8926-dd0d9afb388f`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:04:07,794::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:04:07,795::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:04:07,795::task::1185::TaskManager.Task::(prepare) Task=`46276236-2545-4957-8926-dd0d9afb388f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:04:07,795::task::595::TaskManager.Task::(_updateState) Task=`46276236-2545-4957-8926-dd0d9afb388f`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:04:07,795::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:04:07,795::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:04:07,795::task::990::TaskManager.Task::(_decref) Task=`46276236-2545-4957-8926-dd0d9afb388f`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:04:07,872::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:04:07,873::task::595::TaskManager.Task::(_updateState) Task=`7b0faaa2-8043-43b6-a9bf-f965d04712a3`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:04:07,873::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:04:07,873::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`04a15aa8-6e63-4926-9deb-de19a96f532a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:04:07,874::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:04:07,874::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:04:07,874::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`04a15aa8-6e63-4926-9deb-de19a96f532a`::Granted request >Thread-34::DEBUG::2014-07-24 11:04:07,874::task::827::TaskManager.Task::(resourceAcquired) Task=`7b0faaa2-8043-43b6-a9bf-f965d04712a3`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:04:07,874::task::990::TaskManager.Task::(_decref) Task=`7b0faaa2-8043-43b6-a9bf-f965d04712a3`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:04:07,875::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:04:07,875::task::1185::TaskManager.Task::(prepare) Task=`7b0faaa2-8043-43b6-a9bf-f965d04712a3`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:04:07,876::task::595::TaskManager.Task::(_updateState) Task=`7b0faaa2-8043-43b6-a9bf-f965d04712a3`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:04:07,876::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:04:07,876::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:04:07,876::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:04:07,876::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:04:07,877::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:04:07,877::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:04:07,877::task::990::TaskManager.Task::(_decref) Task=`7b0faaa2-8043-43b6-a9bf-f965d04712a3`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:04:08,705::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:04:08,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347901 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:04:10,791::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:04:10,867::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363998 s, 28.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:04:11,585::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:04:11,595::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000731299 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:04:12,879::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:04:12,954::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349928 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:04:14,966::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:04:15,041::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343114 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:04:17,053::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:04:17,127::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034641 s, 29.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:04:17,947::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:04:17,960::task::595::TaskManager.Task::(_updateState) Task=`5234c788-85f4-43d4-ab61-066e52a494e2`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:04:17,961::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:04:17,961::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:04:17,961::task::1185::TaskManager.Task::(prepare) Task=`5234c788-85f4-43d4-ab61-066e52a494e2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:04:17,961::task::595::TaskManager.Task::(_updateState) Task=`5234c788-85f4-43d4-ab61-066e52a494e2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:04:17,961::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:04:17,961::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:04:17,962::task::990::TaskManager.Task::(_decref) Task=`5234c788-85f4-43d4-ab61-066e52a494e2`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:04:18,007::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:04:18,008::task::595::TaskManager.Task::(_updateState) Task=`c07b561d-6d81-4b2c-8557-3ac374e50164`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:04:18,008::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:04:18,008::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`524c7498-d743-49e3-9d44-82464e83ac1e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:04:18,008::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:04:18,009::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:04:18,009::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`524c7498-d743-49e3-9d44-82464e83ac1e`::Granted request >Thread-34::DEBUG::2014-07-24 11:04:18,009::task::827::TaskManager.Task::(resourceAcquired) Task=`c07b561d-6d81-4b2c-8557-3ac374e50164`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:04:18,009::task::990::TaskManager.Task::(_decref) Task=`c07b561d-6d81-4b2c-8557-3ac374e50164`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:04:18,010::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:04:18,010::task::1185::TaskManager.Task::(prepare) Task=`c07b561d-6d81-4b2c-8557-3ac374e50164`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:04:18,010::task::595::TaskManager.Task::(_updateState) Task=`c07b561d-6d81-4b2c-8557-3ac374e50164`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:04:18,011::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:04:18,011::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:04:18,011::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:04:18,011::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:04:18,011::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:04:18,011::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:04:18,012::task::990::TaskManager.Task::(_decref) Task=`c07b561d-6d81-4b2c-8557-3ac374e50164`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:04:19,140::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:04:19,215::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362256 s, 28.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:04:20,033::task::595::TaskManager.Task::(_updateState) Task=`f5f6e476-b749-4c43-90a8-6ce7067a4b36`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:04:20,033::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:04:20,033::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000731299', 'lastCheck': '8.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:04:20,033::task::1185::TaskManager.Task::(prepare) Task=`f5f6e476-b749-4c43-90a8-6ce7067a4b36`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000731299', 'lastCheck': '8.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:04:20,033::task::595::TaskManager.Task::(_updateState) Task=`f5f6e476-b749-4c43-90a8-6ce7067a4b36`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:04:20,034::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:04:20,034::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:04:20,034::task::990::TaskManager.Task::(_decref) Task=`f5f6e476-b749-4c43-90a8-6ce7067a4b36`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:04:21,227::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:04:21,302::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355274 s, 28.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:04:21,600::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:04:21,609::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000758251 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:04:23,314::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:04:23,391::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0371086 s, 27.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:04:25,403::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:04:25,478::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362977 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:04:27,491::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:04:27,566::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361686 s, 28.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:04:28,077::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:04:28,091::task::595::TaskManager.Task::(_updateState) Task=`3608307d-0dae-4673-b867-2ed150d4421c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:04:28,091::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:04:28,092::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:04:28,092::task::1185::TaskManager.Task::(prepare) Task=`3608307d-0dae-4673-b867-2ed150d4421c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:04:28,092::task::595::TaskManager.Task::(_updateState) Task=`3608307d-0dae-4673-b867-2ed150d4421c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:04:28,092::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:04:28,092::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:04:28,093::task::990::TaskManager.Task::(_decref) Task=`3608307d-0dae-4673-b867-2ed150d4421c`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:04:28,124::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:04:28,124::task::595::TaskManager.Task::(_updateState) Task=`5d8571d9-f18b-4b1a-b548-c651a9d22d4f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:04:28,125::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:04:28,125::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`74b31bb9-337f-4af5-9fb6-388668056426`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:04:28,125::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:04:28,125::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:04:28,126::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`74b31bb9-337f-4af5-9fb6-388668056426`::Granted request >Thread-34::DEBUG::2014-07-24 11:04:28,126::task::827::TaskManager.Task::(resourceAcquired) Task=`5d8571d9-f18b-4b1a-b548-c651a9d22d4f`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:04:28,126::task::990::TaskManager.Task::(_decref) Task=`5d8571d9-f18b-4b1a-b548-c651a9d22d4f`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:04:28,127::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:04:28,127::task::1185::TaskManager.Task::(prepare) Task=`5d8571d9-f18b-4b1a-b548-c651a9d22d4f`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:04:28,127::task::595::TaskManager.Task::(_updateState) Task=`5d8571d9-f18b-4b1a-b548-c651a9d22d4f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:04:28,127::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:04:28,127::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:04:28,128::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:04:28,128::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:04:28,128::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:04:28,128::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:04:28,128::task::990::TaskManager.Task::(_decref) Task=`5d8571d9-f18b-4b1a-b548-c651a9d22d4f`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-07-24 11:04:28,328::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:04:29,578::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:04:29,655::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364906 s, 28.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:04:31,614::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:04:31,643::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0202287 s, 202 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:04:31,667::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:04:31,744::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037164 s, 27.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:04:33,757::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:04:33,836::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0391287 s, 26.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:04:35,376::task::595::TaskManager.Task::(_updateState) Task=`07f0952f-64f7-4772-8d0f-f8877b6d3393`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:04:35,377::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:04:35,377::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0202287', 'lastCheck': '3.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:04:35,377::task::1185::TaskManager.Task::(prepare) Task=`07f0952f-64f7-4772-8d0f-f8877b6d3393`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0202287', 'lastCheck': '3.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:04:35,377::task::595::TaskManager.Task::(_updateState) Task=`07f0952f-64f7-4772-8d0f-f8877b6d3393`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:04:35,377::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:04:35,378::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:04:35,378::task::990::TaskManager.Task::(_decref) Task=`07f0952f-64f7-4772-8d0f-f8877b6d3393`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:04:35,849::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:04:35,924::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347783 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:04:37,936::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:04:38,012::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366383 s, 27.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:04:38,219::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:04:38,228::task::595::TaskManager.Task::(_updateState) Task=`3a80b141-6761-4fae-9367-d86056595cef`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:04:38,228::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:04:38,229::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:04:38,229::task::1185::TaskManager.Task::(prepare) Task=`3a80b141-6761-4fae-9367-d86056595cef`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:04:38,229::task::595::TaskManager.Task::(_updateState) Task=`3a80b141-6761-4fae-9367-d86056595cef`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:04:38,229::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:04:38,229::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:04:38,229::task::990::TaskManager.Task::(_decref) Task=`3a80b141-6761-4fae-9367-d86056595cef`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:04:38,269::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:04:38,269::task::595::TaskManager.Task::(_updateState) Task=`89c98275-cd65-4be2-ac01-ccc44dc4fb48`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:04:38,269::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:04:38,270::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`880125a4-aa5d-4a20-934e-d1d451f3ecc3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:04:38,270::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:04:38,270::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:04:38,270::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`880125a4-aa5d-4a20-934e-d1d451f3ecc3`::Granted request >Thread-34::DEBUG::2014-07-24 11:04:38,271::task::827::TaskManager.Task::(resourceAcquired) Task=`89c98275-cd65-4be2-ac01-ccc44dc4fb48`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:04:38,271::task::990::TaskManager.Task::(_decref) Task=`89c98275-cd65-4be2-ac01-ccc44dc4fb48`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:04:38,272::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:04:38,272::task::1185::TaskManager.Task::(prepare) Task=`89c98275-cd65-4be2-ac01-ccc44dc4fb48`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:04:38,272::task::595::TaskManager.Task::(_updateState) Task=`89c98275-cd65-4be2-ac01-ccc44dc4fb48`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:04:38,272::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:04:38,272::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:04:38,272::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:04:38,273::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:04:38,273::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:04:38,273::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:04:38,273::task::990::TaskManager.Task::(_decref) Task=`89c98275-cd65-4be2-ac01-ccc44dc4fb48`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:04:40,024::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:04:40,100::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367567 s, 27.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:04:41,647::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:04:41,668::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0115426 s, 355 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:04:42,113::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:04:42,186::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343534 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:04:44,199::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:04:44,274::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368985 s, 27.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:04:46,287::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:04:46,385::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340892 s, 30.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:04:48,339::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:04:48,340::task::595::TaskManager.Task::(_updateState) Task=`d083dd38-2d30-4a88-affd-c7836b74186c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:04:48,340::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:04:48,340::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:04:48,340::task::1185::TaskManager.Task::(prepare) Task=`d083dd38-2d30-4a88-affd-c7836b74186c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:04:48,341::task::595::TaskManager.Task::(_updateState) Task=`d083dd38-2d30-4a88-affd-c7836b74186c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:04:48,341::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:04:48,341::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:04:48,341::task::990::TaskManager.Task::(_decref) Task=`d083dd38-2d30-4a88-affd-c7836b74186c`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:04:48,372::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:04:48,373::task::595::TaskManager.Task::(_updateState) Task=`e7505227-adf4-42ba-a929-62266aa29507`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:04:48,373::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:04:48,373::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`9d415358-5828-4f3e-84d8-899297331811`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:04:48,373::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:04:48,374::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:04:48,374::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`9d415358-5828-4f3e-84d8-899297331811`::Granted request >Thread-34::DEBUG::2014-07-24 11:04:48,374::task::827::TaskManager.Task::(resourceAcquired) Task=`e7505227-adf4-42ba-a929-62266aa29507`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:04:48,374::task::990::TaskManager.Task::(_decref) Task=`e7505227-adf4-42ba-a929-62266aa29507`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:04:48,375::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:04:48,375::task::1185::TaskManager.Task::(prepare) Task=`e7505227-adf4-42ba-a929-62266aa29507`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:04:48,375::task::595::TaskManager.Task::(_updateState) Task=`e7505227-adf4-42ba-a929-62266aa29507`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:04:48,375::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:04:48,376::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:04:48,376::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:04:48,376::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:04:48,376::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:04:48,376::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:04:48,377::task::990::TaskManager.Task::(_decref) Task=`e7505227-adf4-42ba-a929-62266aa29507`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:04:48,397::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:04:48,471::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034255 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:04:50,483::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:04:50,557::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350215 s, 29.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:04:50,744::task::595::TaskManager.Task::(_updateState) Task=`f333d1b6-fc4a-401f-be6d-4d6a631fa9dc`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:04:50,744::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:04:50,744::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0115426', 'lastCheck': '9.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:04:50,745::task::1185::TaskManager.Task::(prepare) Task=`f333d1b6-fc4a-401f-be6d-4d6a631fa9dc`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0115426', 'lastCheck': '9.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:04:50,745::task::595::TaskManager.Task::(_updateState) Task=`f333d1b6-fc4a-401f-be6d-4d6a631fa9dc`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:04:50,745::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:04:50,745::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:04:50,745::task::990::TaskManager.Task::(_decref) Task=`f333d1b6-fc4a-401f-be6d-4d6a631fa9dc`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:04:51,673::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:04:51,693::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0119762 s, 342 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:04:52,569::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:04:52,643::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349223 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:04:54,656::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:04:54,730::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345016 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:04:56,742::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:04:56,818::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339559 s, 30.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:04:58,365::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-14::DEBUG::2014-07-24 11:04:58,437::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:04:58,438::task::595::TaskManager.Task::(_updateState) Task=`a4c1b01a-2dca-46e7-bffa-a9f8b524ec5d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:04:58,438::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:04:58,438::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:04:58,438::task::1185::TaskManager.Task::(prepare) Task=`a4c1b01a-2dca-46e7-bffa-a9f8b524ec5d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:04:58,439::task::595::TaskManager.Task::(_updateState) Task=`a4c1b01a-2dca-46e7-bffa-a9f8b524ec5d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:04:58,439::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:04:58,439::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:04:58,439::task::990::TaskManager.Task::(_decref) Task=`a4c1b01a-2dca-46e7-bffa-a9f8b524ec5d`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:04:58,482::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:04:58,482::task::595::TaskManager.Task::(_updateState) Task=`22b0f918-a6f8-4fd8-b3d4-bac05eb785f2`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:04:58,483::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:04:58,484::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`74fa475f-7eee-4901-8c75-74c1c86a54e0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:04:58,484::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:04:58,484::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:04:58,484::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`74fa475f-7eee-4901-8c75-74c1c86a54e0`::Granted request >Thread-34::DEBUG::2014-07-24 11:04:58,485::task::827::TaskManager.Task::(resourceAcquired) Task=`22b0f918-a6f8-4fd8-b3d4-bac05eb785f2`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:04:58,485::task::990::TaskManager.Task::(_decref) Task=`22b0f918-a6f8-4fd8-b3d4-bac05eb785f2`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:04:58,486::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:04:58,486::task::1185::TaskManager.Task::(prepare) Task=`22b0f918-a6f8-4fd8-b3d4-bac05eb785f2`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:04:58,486::task::595::TaskManager.Task::(_updateState) Task=`22b0f918-a6f8-4fd8-b3d4-bac05eb785f2`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:04:58,486::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:04:58,486::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:04:58,487::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:04:58,487::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:04:58,487::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:04:58,487::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:04:58,487::task::990::TaskManager.Task::(_decref) Task=`22b0f918-a6f8-4fd8-b3d4-bac05eb785f2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:04:58,830::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:04:58,904::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343271 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:05:00,916::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:05:00,991::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350409 s, 29.2 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:05:01,141::task::595::TaskManager.Task::(_updateState) Task=`4e1be2d8-7313-43bd-9c05-2b52fe685bbd`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:05:01,141::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:05:01,142::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:05:01,142::task::1185::TaskManager.Task::(prepare) Task=`4e1be2d8-7313-43bd-9c05-2b52fe685bbd`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:05:01,142::task::595::TaskManager.Task::(_updateState) Task=`4e1be2d8-7313-43bd-9c05-2b52fe685bbd`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:05:01,142::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:05:01,142::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:05:01,143::task::990::TaskManager.Task::(_decref) Task=`4e1be2d8-7313-43bd-9c05-2b52fe685bbd`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:05:01,698::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:05:01,719::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0120856 s, 339 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:05:03,003::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:05:03,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367891 s, 27.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:05:05,095::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:05:05,169::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346067 s, 29.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:05:06,103::task::595::TaskManager.Task::(_updateState) Task=`7505b8df-86dc-48cc-8cda-be0b7ab54fd8`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:05:06,103::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:05:06,103::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0120856', 'lastCheck': '4.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:05:06,103::task::1185::TaskManager.Task::(prepare) Task=`7505b8df-86dc-48cc-8cda-be0b7ab54fd8`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0120856', 'lastCheck': '4.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:05:06,103::task::595::TaskManager.Task::(_updateState) Task=`7505b8df-86dc-48cc-8cda-be0b7ab54fd8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:05:06,104::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:05:06,104::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:05:06,104::task::990::TaskManager.Task::(_decref) Task=`7505b8df-86dc-48cc-8cda-be0b7ab54fd8`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:05:07,182::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:05:07,257::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353995 s, 28.9 MB/s\n'; <rc> = 0 >libvirtEventLoop::DEBUG::2014-07-24 11:05:07,665::clientIF::553::vm.Vm::(dispatchLibvirtEvents) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::graphics event phase 2 localAddr {'node': '10.35.64.88', 'service': '', 'family': 0} remoteAddr {'node': '10.35.2.195', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-07-24 11:05:07,666::clientIF::553::vm.Vm::(dispatchLibvirtEvents) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::graphics event phase 2 localAddr {'node': '10.35.64.88', 'service': '', 'family': 0} remoteAddr {'node': '10.35.2.195', 'service': '', 'family': 0}authScheme spice subject [] >libvirtEventLoop::DEBUG::2014-07-24 11:05:07,667::clientIF::553::vm.Vm::(dispatchLibvirtEvents) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::graphics event phase 2 localAddr {'node': '10.35.64.88', 'service': '', 'family': 0} remoteAddr {'node': '10.35.2.195', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-07-24 11:05:07,668::clientIF::553::vm.Vm::(dispatchLibvirtEvents) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::graphics event phase 2 localAddr {'node': '10.35.64.88', 'service': '', 'family': 0} remoteAddr {'node': '10.35.2.195', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-07-24 11:05:07,671::clientIF::553::vm.Vm::(dispatchLibvirtEvents) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::graphics event phase 2 localAddr {'node': '10.35.64.88', 'service': '', 'family': 0} remoteAddr {'node': '10.35.2.195', 'service': '', 'family': 0}authScheme subject [] >Thread-14::DEBUG::2014-07-24 11:05:08,553::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:05:08,554::task::595::TaskManager.Task::(_updateState) Task=`9250b1ac-b362-42d3-ab59-a2322e32681a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:05:08,554::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:05:08,554::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:05:08,555::task::1185::TaskManager.Task::(prepare) Task=`9250b1ac-b362-42d3-ab59-a2322e32681a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:05:08,555::task::595::TaskManager.Task::(_updateState) Task=`9250b1ac-b362-42d3-ab59-a2322e32681a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:05:08,555::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:05:08,555::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:05:08,555::task::990::TaskManager.Task::(_decref) Task=`9250b1ac-b362-42d3-ab59-a2322e32681a`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:05:08,588::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:05:08,588::task::595::TaskManager.Task::(_updateState) Task=`78b25518-265f-49b7-8104-910038b8f12a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:05:08,588::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:05:08,589::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`51fe7b5a-a97e-4ab2-83da-eb544c6580ac`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:05:08,589::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:05:08,589::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:05:08,589::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`51fe7b5a-a97e-4ab2-83da-eb544c6580ac`::Granted request >Thread-34::DEBUG::2014-07-24 11:05:08,590::task::827::TaskManager.Task::(resourceAcquired) Task=`78b25518-265f-49b7-8104-910038b8f12a`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:05:08,590::task::990::TaskManager.Task::(_decref) Task=`78b25518-265f-49b7-8104-910038b8f12a`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:05:08,591::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:05:08,591::task::1185::TaskManager.Task::(prepare) Task=`78b25518-265f-49b7-8104-910038b8f12a`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:05:08,591::task::595::TaskManager.Task::(_updateState) Task=`78b25518-265f-49b7-8104-910038b8f12a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:05:08,591::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:05:08,591::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:05:08,591::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:05:08,592::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:05:08,592::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:05:08,592::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:05:08,592::task::990::TaskManager.Task::(_decref) Task=`78b25518-265f-49b7-8104-910038b8f12a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:05:09,270::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:05:09,344::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347399 s, 29.5 MB/s\n'; <rc> = 0 >Thread-38::DEBUG::2014-07-24 11:05:09,666::guestIF::346::vm.Vm::(desktopLock) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::desktopLock called >Thread-39::DEBUG::2014-07-24 11:05:09,667::guestIF::346::vm.Vm::(desktopLock) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::desktopLock called >Thread-40::DEBUG::2014-07-24 11:05:09,668::guestIF::346::vm.Vm::(desktopLock) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::desktopLock called >Thread-41::DEBUG::2014-07-24 11:05:09,669::guestIF::346::vm.Vm::(desktopLock) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::desktopLock called >Thread-42::DEBUG::2014-07-24 11:05:09,672::guestIF::346::vm.Vm::(desktopLock) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::desktopLock called >Dummy-33::DEBUG::2014-07-24 11:05:11,360::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:05:11,436::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362896 s, 28.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:05:11,724::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:05:11,744::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0111828 s, 366 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:05:13,449::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:05:13,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349927 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:05:15,535::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:05:15,611::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345779 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:05:17,623::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:05:17,696::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337417 s, 30.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:05:18,647::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:05:18,647::task::595::TaskManager.Task::(_updateState) Task=`a3ce64b2-1896-4468-9e8b-23dc18648a52`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:05:18,647::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:05:18,648::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:05:18,648::task::1185::TaskManager.Task::(prepare) Task=`a3ce64b2-1896-4468-9e8b-23dc18648a52`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:05:18,648::task::595::TaskManager.Task::(_updateState) Task=`a3ce64b2-1896-4468-9e8b-23dc18648a52`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:05:18,648::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:05:18,648::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:05:18,648::task::990::TaskManager.Task::(_decref) Task=`a3ce64b2-1896-4468-9e8b-23dc18648a52`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:05:18,681::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:05:18,681::task::595::TaskManager.Task::(_updateState) Task=`43a8efe5-e18e-4ac1-aac3-ec903a6afd94`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:05:18,681::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:05:18,682::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4329d094-866e-4a47-ab27-b69e54efaaea`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:05:18,682::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:05:18,682::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:05:18,682::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4329d094-866e-4a47-ab27-b69e54efaaea`::Granted request >Thread-34::DEBUG::2014-07-24 11:05:18,683::task::827::TaskManager.Task::(resourceAcquired) Task=`43a8efe5-e18e-4ac1-aac3-ec903a6afd94`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:05:18,683::task::990::TaskManager.Task::(_decref) Task=`43a8efe5-e18e-4ac1-aac3-ec903a6afd94`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:05:18,683::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:05:18,684::task::1185::TaskManager.Task::(prepare) Task=`43a8efe5-e18e-4ac1-aac3-ec903a6afd94`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:05:18,684::task::595::TaskManager.Task::(_updateState) Task=`43a8efe5-e18e-4ac1-aac3-ec903a6afd94`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:05:18,684::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:05:18,684::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:05:18,684::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:05:18,685::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:05:18,685::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:05:18,685::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:05:18,685::task::990::TaskManager.Task::(_decref) Task=`43a8efe5-e18e-4ac1-aac3-ec903a6afd94`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:05:19,708::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:05:19,782::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344768 s, 29.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:05:21,529::task::595::TaskManager.Task::(_updateState) Task=`9cf0a3a6-d4e8-45bc-9275-ccebe9f92d91`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:05:21,529::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:05:21,530::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0111828', 'lastCheck': '9.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:05:21,530::task::1185::TaskManager.Task::(prepare) Task=`9cf0a3a6-d4e8-45bc-9275-ccebe9f92d91`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0111828', 'lastCheck': '9.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:05:21,530::task::595::TaskManager.Task::(_updateState) Task=`9cf0a3a6-d4e8-45bc-9275-ccebe9f92d91`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:05:21,530::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:05:21,530::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:05:21,531::task::990::TaskManager.Task::(_decref) Task=`9cf0a3a6-d4e8-45bc-9275-ccebe9f92d91`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:05:21,749::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:05:21,761::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000869969 s, 4.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:05:21,794::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:05:21,873::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0378241 s, 27.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:05:23,886::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:05:23,961::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035528 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:05:25,973::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:05:26,050::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354374 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:05:28,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:05:28,136::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347784 s, 29.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:05:28,403::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-14::DEBUG::2014-07-24 11:05:28,745::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:05:28,746::task::595::TaskManager.Task::(_updateState) Task=`4dfa9ca5-e4f0-40f4-844c-33e8855f770e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:05:28,746::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:05:28,746::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:05:28,747::task::1185::TaskManager.Task::(prepare) Task=`4dfa9ca5-e4f0-40f4-844c-33e8855f770e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:05:28,747::task::595::TaskManager.Task::(_updateState) Task=`4dfa9ca5-e4f0-40f4-844c-33e8855f770e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:05:28,747::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:05:28,747::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:05:28,747::task::990::TaskManager.Task::(_decref) Task=`4dfa9ca5-e4f0-40f4-844c-33e8855f770e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:05:28,783::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:05:28,783::task::595::TaskManager.Task::(_updateState) Task=`55f7e417-c685-4022-869a-c1811dbeea00`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:05:28,783::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:05:28,784::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f7026b18-9032-4eea-ac89-89e7595b4d50`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:05:28,784::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:05:28,784::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:05:28,784::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f7026b18-9032-4eea-ac89-89e7595b4d50`::Granted request >Thread-34::DEBUG::2014-07-24 11:05:28,785::task::827::TaskManager.Task::(resourceAcquired) Task=`55f7e417-c685-4022-869a-c1811dbeea00`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:05:28,785::task::990::TaskManager.Task::(_decref) Task=`55f7e417-c685-4022-869a-c1811dbeea00`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:05:28,786::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:05:28,786::task::1185::TaskManager.Task::(prepare) Task=`55f7e417-c685-4022-869a-c1811dbeea00`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:05:28,786::task::595::TaskManager.Task::(_updateState) Task=`55f7e417-c685-4022-869a-c1811dbeea00`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:05:28,786::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:05:28,786::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:05:28,787::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:05:28,787::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:05:28,787::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:05:28,787::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:05:28,787::task::990::TaskManager.Task::(_decref) Task=`55f7e417-c685-4022-869a-c1811dbeea00`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:05:30,149::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:05:30,224::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364343 s, 28.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:05:31,768::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:05:31,786::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00976211 s, 420 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:05:32,237::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:05:32,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363302 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:05:34,324::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:05:34,398::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347326 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:05:36,410::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:05:36,489::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0392989 s, 26.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:05:36,959::task::595::TaskManager.Task::(_updateState) Task=`5f8522f0-aeda-4da0-b5a6-7c97f6c02e82`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:05:36,960::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:05:36,960::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00976211', 'lastCheck': '5.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:05:36,960::task::1185::TaskManager.Task::(prepare) Task=`5f8522f0-aeda-4da0-b5a6-7c97f6c02e82`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00976211', 'lastCheck': '5.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:05:36,960::task::595::TaskManager.Task::(_updateState) Task=`5f8522f0-aeda-4da0-b5a6-7c97f6c02e82`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:05:36,961::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:05:36,961::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:05:36,961::task::990::TaskManager.Task::(_decref) Task=`5f8522f0-aeda-4da0-b5a6-7c97f6c02e82`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:05:38,514::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:05:38,598::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0453583 s, 22.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:05:38,847::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:05:38,847::task::595::TaskManager.Task::(_updateState) Task=`bddd88f9-e023-42ce-836a-8ab9914652ec`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:05:38,848::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:05:38,848::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:05:38,848::task::1185::TaskManager.Task::(prepare) Task=`bddd88f9-e023-42ce-836a-8ab9914652ec`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:05:38,848::task::595::TaskManager.Task::(_updateState) Task=`bddd88f9-e023-42ce-836a-8ab9914652ec`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:05:38,848::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:05:38,849::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:05:38,849::task::990::TaskManager.Task::(_decref) Task=`bddd88f9-e023-42ce-836a-8ab9914652ec`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:05:38,885::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:05:38,885::task::595::TaskManager.Task::(_updateState) Task=`f04e293d-21e5-4e7e-a175-9ce1d16e06a0`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:05:38,886::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:05:38,886::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`606a944c-8df0-4d8e-b740-723c0df75d51`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:05:38,886::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:05:38,886::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:05:38,887::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`606a944c-8df0-4d8e-b740-723c0df75d51`::Granted request >Thread-34::DEBUG::2014-07-24 11:05:38,887::task::827::TaskManager.Task::(resourceAcquired) Task=`f04e293d-21e5-4e7e-a175-9ce1d16e06a0`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:05:38,887::task::990::TaskManager.Task::(_decref) Task=`f04e293d-21e5-4e7e-a175-9ce1d16e06a0`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:05:38,888::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:05:38,888::task::1185::TaskManager.Task::(prepare) Task=`f04e293d-21e5-4e7e-a175-9ce1d16e06a0`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:05:38,888::task::595::TaskManager.Task::(_updateState) Task=`f04e293d-21e5-4e7e-a175-9ce1d16e06a0`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:05:38,888::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:05:38,889::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:05:38,889::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:05:38,889::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:05:38,889::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:05:38,889::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:05:38,889::task::990::TaskManager.Task::(_decref) Task=`f04e293d-21e5-4e7e-a175-9ce1d16e06a0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:05:40,611::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:05:40,686::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036417 s, 28.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:05:41,790::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:05:41,811::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0124152 s, 330 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:05:42,699::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:05:42,774::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361946 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:05:44,786::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:05:44,861::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363038 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:05:46,874::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:05:46,946::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335179 s, 30.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:05:48,958::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-24 11:05:49,000::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:05:49,001::task::595::TaskManager.Task::(_updateState) Task=`26eef569-f130-45e7-ace7-1dadc9301bac`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:05:49,001::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:05:49,001::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:05:49,001::task::1185::TaskManager.Task::(prepare) Task=`26eef569-f130-45e7-ace7-1dadc9301bac`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:05:49,002::task::595::TaskManager.Task::(_updateState) Task=`26eef569-f130-45e7-ace7-1dadc9301bac`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:05:49,002::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:05:49,002::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:05:49,002::task::990::TaskManager.Task::(_decref) Task=`26eef569-f130-45e7-ace7-1dadc9301bac`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:05:49,121::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:05:49,121::task::595::TaskManager.Task::(_updateState) Task=`3bedef55-daa1-44c8-a25f-0db2026b49ec`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:05:49,121::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:05:49,122::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`5b76aa4f-abc0-454a-8cd2-a9f76f270f71`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:05:49,122::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:05:49,122::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:05:49,122::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`5b76aa4f-abc0-454a-8cd2-a9f76f270f71`::Granted request >Thread-34::DEBUG::2014-07-24 11:05:49,123::task::827::TaskManager.Task::(resourceAcquired) Task=`3bedef55-daa1-44c8-a25f-0db2026b49ec`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:05:49,123::task::990::TaskManager.Task::(_decref) Task=`3bedef55-daa1-44c8-a25f-0db2026b49ec`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:05:49,124::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:05:49,124::task::1185::TaskManager.Task::(prepare) Task=`3bedef55-daa1-44c8-a25f-0db2026b49ec`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:05:49,124::task::595::TaskManager.Task::(_updateState) Task=`3bedef55-daa1-44c8-a25f-0db2026b49ec`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:05:49,124::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:05:49,124::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:05:49,125::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:05:49,125::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:05:49,125::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:05:49,125::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:05:49,125::task::990::TaskManager.Task::(_decref) Task=`3bedef55-daa1-44c8-a25f-0db2026b49ec`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:05:49,325::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.326536 s, 3.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:05:51,338::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:05:51,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361783 s, 28.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:05:51,816::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:05:51,825::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000697902 s, 5.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:05:52,413::task::595::TaskManager.Task::(_updateState) Task=`c81d492f-f8ca-412c-a81b-c9714532a6d3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:05:52,414::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:05:52,414::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000697902', 'lastCheck': '0.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:05:52,414::task::1185::TaskManager.Task::(prepare) Task=`c81d492f-f8ca-412c-a81b-c9714532a6d3`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000697902', 'lastCheck': '0.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:05:52,414::task::595::TaskManager.Task::(_updateState) Task=`c81d492f-f8ca-412c-a81b-c9714532a6d3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:05:52,415::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:05:52,415::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:05:52,415::task::990::TaskManager.Task::(_decref) Task=`c81d492f-f8ca-412c-a81b-c9714532a6d3`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:05:53,426::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:05:53,499::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335477 s, 30.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:05:55,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:05:55,585::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347766 s, 29.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:05:56,001::BindingXMLRPC::1067::vds::(wrapper) client [10.35.163.76]::call vmSetTicket with ('6fca7e11-8f3f-4784-bdab-7e7f9503cd5b', 'PDgzamziRIgj', '120', 'disconnect', {'userName': 'admin', 'userId': 'fdfc627c-d875-11e0-90f0-83df133b58cc'}) {} flowID [2afd180d] >Thread-14::DEBUG::2014-07-24 11:05:56,037::BindingXMLRPC::1074::vds::(wrapper) return vmSetTicket with {'status': {'message': 'Done', 'code': 0}} >Dummy-33::DEBUG::2014-07-24 11:05:57,597::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:05:57,671::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343817 s, 29.8 MB/s\n'; <rc> = 0 >libvirtEventLoop::DEBUG::2014-07-24 11:05:57,786::clientIF::553::vm.Vm::(dispatchLibvirtEvents) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::graphics event phase 0 localAddr {'node': '10.35.64.88', 'service': '', 'family': 0} remoteAddr {'node': '10.35.2.195', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-07-24 11:05:57,817::clientIF::553::vm.Vm::(dispatchLibvirtEvents) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::graphics event phase 1 localAddr {'node': '10.35.64.88', 'service': '', 'family': 0} remoteAddr {'node': '10.35.2.195', 'service': '', 'family': 0}authScheme spice subject [] >libvirtEventLoop::DEBUG::2014-07-24 11:05:57,826::clientIF::553::vm.Vm::(dispatchLibvirtEvents) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::graphics event phase 0 localAddr {'node': '10.35.64.88', 'service': '', 'family': 0} remoteAddr {'node': '10.35.2.195', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-07-24 11:05:57,861::clientIF::553::vm.Vm::(dispatchLibvirtEvents) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::graphics event phase 1 localAddr {'node': '10.35.64.88', 'service': '', 'family': 0} remoteAddr {'node': '10.35.2.195', 'service': '', 'family': 0}authScheme spice subject [] >libvirtEventLoop::DEBUG::2014-07-24 11:05:57,905::clientIF::553::vm.Vm::(dispatchLibvirtEvents) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::graphics event phase 0 localAddr {'node': '10.35.64.88', 'service': '', 'family': 0} remoteAddr {'node': '10.35.2.195', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-07-24 11:05:57,905::clientIF::553::vm.Vm::(dispatchLibvirtEvents) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::graphics event phase 0 localAddr {'node': '10.35.64.88', 'service': '', 'family': 0} remoteAddr {'node': '10.35.2.195', 'service': '', 'family': 0}authScheme subject [] >libvirtEventLoop::DEBUG::2014-07-24 11:05:57,967::clientIF::553::vm.Vm::(dispatchLibvirtEvents) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::graphics event phase 1 localAddr {'node': '10.35.64.88', 'service': '', 'family': 0} remoteAddr {'node': '10.35.2.195', 'service': '', 'family': 0}authScheme spice subject [] >libvirtEventLoop::DEBUG::2014-07-24 11:05:57,968::clientIF::553::vm.Vm::(dispatchLibvirtEvents) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::graphics event phase 1 localAddr {'node': '10.35.64.88', 'service': '', 'family': 0} remoteAddr {'node': '10.35.2.195', 'service': '', 'family': 0}authScheme spice subject [] >VM Channels Listener::DEBUG::2014-07-24 11:05:58,447::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-14::DEBUG::2014-07-24 11:05:59,268::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:05:59,269::task::595::TaskManager.Task::(_updateState) Task=`79f12cdc-a1f8-4817-b788-37d9f9a3691d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:05:59,269::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:05:59,269::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:05:59,269::task::1185::TaskManager.Task::(prepare) Task=`79f12cdc-a1f8-4817-b788-37d9f9a3691d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:05:59,269::task::595::TaskManager.Task::(_updateState) Task=`79f12cdc-a1f8-4817-b788-37d9f9a3691d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:05:59,270::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:05:59,270::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:05:59,270::task::990::TaskManager.Task::(_decref) Task=`79f12cdc-a1f8-4817-b788-37d9f9a3691d`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:05:59,318::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:05:59,318::task::595::TaskManager.Task::(_updateState) Task=`a32684c1-4e93-4fea-902b-397a93bf05d5`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:05:59,318::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:05:59,319::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`9ef1f1e4-3415-4817-a45f-fc5a0ecf6981`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:05:59,319::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:05:59,319::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:05:59,319::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`9ef1f1e4-3415-4817-a45f-fc5a0ecf6981`::Granted request >Thread-34::DEBUG::2014-07-24 11:05:59,320::task::827::TaskManager.Task::(resourceAcquired) Task=`a32684c1-4e93-4fea-902b-397a93bf05d5`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:05:59,320::task::990::TaskManager.Task::(_decref) Task=`a32684c1-4e93-4fea-902b-397a93bf05d5`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:05:59,321::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:05:59,321::task::1185::TaskManager.Task::(prepare) Task=`a32684c1-4e93-4fea-902b-397a93bf05d5`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:05:59,321::task::595::TaskManager.Task::(_updateState) Task=`a32684c1-4e93-4fea-902b-397a93bf05d5`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:05:59,321::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:05:59,322::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:05:59,322::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:05:59,322::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:05:59,322::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:05:59,322::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:05:59,323::task::990::TaskManager.Task::(_decref) Task=`a32684c1-4e93-4fea-902b-397a93bf05d5`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:05:59,683::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:05:59,756::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338694 s, 30.2 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:06:01,303::task::595::TaskManager.Task::(_updateState) Task=`5cc16089-538d-4686-95c2-34daf9e54de6`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:06:01,318::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:06:01,318::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:06:01,318::task::1185::TaskManager.Task::(prepare) Task=`5cc16089-538d-4686-95c2-34daf9e54de6`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:06:01,318::task::595::TaskManager.Task::(_updateState) Task=`5cc16089-538d-4686-95c2-34daf9e54de6`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:06:01,318::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:06:01,319::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:06:01,319::task::990::TaskManager.Task::(_decref) Task=`5cc16089-538d-4686-95c2-34daf9e54de6`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:06:01,769::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-24 11:06:01,832::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:06:01,849::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00295777 s, 1.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:06:01,892::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346279 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:06:03,904::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:06:03,980::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357996 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:06:05,992::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:06:06,066::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342156 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:06:08,079::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:06:08,152::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347451 s, 29.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:06:08,200::task::595::TaskManager.Task::(_updateState) Task=`88af32cf-a88d-4348-a1c9-419f46ae2bf9`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:06:08,200::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:06:08,201::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00295777', 'lastCheck': '6.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:06:08,201::task::1185::TaskManager.Task::(prepare) Task=`88af32cf-a88d-4348-a1c9-419f46ae2bf9`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00295777', 'lastCheck': '6.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:06:08,201::task::595::TaskManager.Task::(_updateState) Task=`88af32cf-a88d-4348-a1c9-419f46ae2bf9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:06:08,201::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:06:08,201::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:06:08,202::task::990::TaskManager.Task::(_decref) Task=`88af32cf-a88d-4348-a1c9-419f46ae2bf9`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 11:06:09,416::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [6bfd44d8] >Thread-14::DEBUG::2014-07-24 11:06:09,416::task::595::TaskManager.Task::(_updateState) Task=`5c9344d9-a6ce-40e9-992d-21750fc9e0c2`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:06:09,417::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:06:09,417::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:06:09,417::task::1185::TaskManager.Task::(prepare) Task=`5c9344d9-a6ce-40e9-992d-21750fc9e0c2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:06:09,417::task::595::TaskManager.Task::(_updateState) Task=`5c9344d9-a6ce-40e9-992d-21750fc9e0c2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:06:09,417::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:06:09,417::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:06:09,418::task::990::TaskManager.Task::(_decref) Task=`5c9344d9-a6ce-40e9-992d-21750fc9e0c2`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:06:09,451::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [6bfd44d8] >Thread-34::DEBUG::2014-07-24 11:06:09,451::task::595::TaskManager.Task::(_updateState) Task=`36c39421-e67c-4301-b2eb-a70ee660678e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:06:09,451::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:06:09,452::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`70fc5efb-a566-4ef7-b18f-c56070f7df9c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:06:09,452::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:06:09,452::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:06:09,452::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`70fc5efb-a566-4ef7-b18f-c56070f7df9c`::Granted request >Thread-34::DEBUG::2014-07-24 11:06:09,452::task::827::TaskManager.Task::(resourceAcquired) Task=`36c39421-e67c-4301-b2eb-a70ee660678e`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:06:09,453::task::990::TaskManager.Task::(_decref) Task=`36c39421-e67c-4301-b2eb-a70ee660678e`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:06:09,453::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:06:09,453::task::1185::TaskManager.Task::(prepare) Task=`36c39421-e67c-4301-b2eb-a70ee660678e`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:06:09,454::task::595::TaskManager.Task::(_updateState) Task=`36c39421-e67c-4301-b2eb-a70ee660678e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:06:09,454::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:06:09,454::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:06:09,454::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:06:09,454::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:06:09,455::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:06:09,455::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:06:09,455::task::990::TaskManager.Task::(_decref) Task=`36c39421-e67c-4301-b2eb-a70ee660678e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:06:10,165::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:06:10,243::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379924 s, 27.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:06:11,877::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 23aa0606-edc3-4882-a4aa-18aa1983458f >Thread-18::DEBUG::2014-07-24 11:06:11,877::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-18::DEBUG::2014-07-24 11:06:11,877::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:06:11,904::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.0175879 s, 116 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:06:11,904::misc::264::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.0175879 s, 116 kB/s'], size: 2048 >Thread-18::DEBUG::2014-07-24 11:06:11,904::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-18::WARNING::2014-07-24 11:06:11,904::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-18::DEBUG::2014-07-24 11:06:11,904::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-18::DEBUG::2014-07-24 11:06:11,905::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 11:06:11,905::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 11:06:11,905::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 11:06:11,905::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 11:06:11,906::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 11:06:11,906::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-18::DEBUG::2014-07-24 11:06:12,174::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:06:12,176::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 11:06:12,176::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'LOCKPOLICY=', 'POOL_DOMAINS=23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'POOL_DESCRIPTION=DS1', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_UUID=637ea13c-81a8-4b44-8cab-961458b01883', 'POOL_SPM_ID=1', '_SHA_CKSUM=a749afdc7119a2d6aad840af5c63c9b28c0b612c', 'POOL_SPM_LVER=0'] >Thread-18::INFO::2014-07-24 11:06:12,177::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_imageNS already registered >Thread-18::INFO::2014-07-24 11:06:12,177::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_volumeNS already registered >Thread-18::INFO::2014-07-24 11:06:12,177::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_lvmActivationNS already registered >Thread-18::DEBUG::2014-07-24 11:06:12,178::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:06:12,255::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-24 11:06:12,339::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:06:12,343::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:06:12,360::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000809718 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:06:12,396::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362794 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:06:14,408::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:06:14,484::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359461 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:06:16,496::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:06:16,570::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348942 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:06:18,583::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:06:18,677::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0491606 s, 20.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:06:19,528::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:06:19,529::task::595::TaskManager.Task::(_updateState) Task=`0f38ff77-035d-42ea-932a-1596400e73a0`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:06:19,529::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:06:19,529::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:06:19,530::task::1185::TaskManager.Task::(prepare) Task=`0f38ff77-035d-42ea-932a-1596400e73a0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:06:19,530::task::595::TaskManager.Task::(_updateState) Task=`0f38ff77-035d-42ea-932a-1596400e73a0`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:06:19,530::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:06:19,530::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:06:19,530::task::990::TaskManager.Task::(_decref) Task=`0f38ff77-035d-42ea-932a-1596400e73a0`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:06:19,588::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:06:19,588::task::595::TaskManager.Task::(_updateState) Task=`4cc148b4-db2e-4a11-ae86-6c9aead93884`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:06:19,588::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:06:19,589::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ef3e5faa-4542-4141-b6df-8374c92dc6ca`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:06:19,589::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:06:19,589::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:06:19,589::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ef3e5faa-4542-4141-b6df-8374c92dc6ca`::Granted request >Thread-34::DEBUG::2014-07-24 11:06:19,589::task::827::TaskManager.Task::(resourceAcquired) Task=`4cc148b4-db2e-4a11-ae86-6c9aead93884`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:06:19,590::task::990::TaskManager.Task::(_decref) Task=`4cc148b4-db2e-4a11-ae86-6c9aead93884`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:06:19,590::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:06:19,591::task::1185::TaskManager.Task::(prepare) Task=`4cc148b4-db2e-4a11-ae86-6c9aead93884`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:06:19,591::task::595::TaskManager.Task::(_updateState) Task=`4cc148b4-db2e-4a11-ae86-6c9aead93884`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:06:19,591::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:06:19,591::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:06:19,591::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:06:19,591::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:06:19,592::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:06:19,592::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:06:19,592::task::990::TaskManager.Task::(_decref) Task=`4cc148b4-db2e-4a11-ae86-6c9aead93884`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:06:20,690::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:06:20,765::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361263 s, 28.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:06:22,393::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:06:22,402::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000725164 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:06:22,777::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:06:22,854::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370834 s, 27.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:06:23,742::task::595::TaskManager.Task::(_updateState) Task=`6782886f-22c1-4619-9688-69385117a078`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:06:23,753::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:06:23,754::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000725164', 'lastCheck': '1.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:06:23,754::task::1185::TaskManager.Task::(prepare) Task=`6782886f-22c1-4619-9688-69385117a078`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000725164', 'lastCheck': '1.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:06:23,754::task::595::TaskManager.Task::(_updateState) Task=`6782886f-22c1-4619-9688-69385117a078`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:06:23,754::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:06:23,754::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:06:23,754::task::990::TaskManager.Task::(_decref) Task=`6782886f-22c1-4619-9688-69385117a078`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:06:24,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:06:24,942::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348077 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:06:26,954::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:06:27,323::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.328466 s, 3.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:06:28,485::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:06:29,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:06:29,411::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344172 s, 29.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:06:29,678::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [5176ccd6] >Thread-14::DEBUG::2014-07-24 11:06:29,678::task::595::TaskManager.Task::(_updateState) Task=`9ae62c5c-d3b3-4f53-afda-c6dc276e5cd5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:06:29,679::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:06:29,679::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:06:29,679::task::1185::TaskManager.Task::(prepare) Task=`9ae62c5c-d3b3-4f53-afda-c6dc276e5cd5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:06:29,679::task::595::TaskManager.Task::(_updateState) Task=`9ae62c5c-d3b3-4f53-afda-c6dc276e5cd5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:06:29,680::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:06:29,680::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:06:29,680::task::990::TaskManager.Task::(_decref) Task=`9ae62c5c-d3b3-4f53-afda-c6dc276e5cd5`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:06:29,750::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [5176ccd6] >Thread-34::DEBUG::2014-07-24 11:06:29,750::task::595::TaskManager.Task::(_updateState) Task=`5c101130-d33e-4ab7-9a33-f24ddb5996b7`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:06:29,751::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:06:29,751::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`643a22b9-03c7-43cc-b0f2-8941470fb7d8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:06:29,751::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:06:29,752::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:06:29,752::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`643a22b9-03c7-43cc-b0f2-8941470fb7d8`::Granted request >Thread-34::DEBUG::2014-07-24 11:06:29,752::task::827::TaskManager.Task::(resourceAcquired) Task=`5c101130-d33e-4ab7-9a33-f24ddb5996b7`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:06:29,752::task::990::TaskManager.Task::(_decref) Task=`5c101130-d33e-4ab7-9a33-f24ddb5996b7`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:06:29,753::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:06:29,753::task::1185::TaskManager.Task::(prepare) Task=`5c101130-d33e-4ab7-9a33-f24ddb5996b7`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:06:29,753::task::595::TaskManager.Task::(_updateState) Task=`5c101130-d33e-4ab7-9a33-f24ddb5996b7`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:06:29,753::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:06:29,754::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:06:29,754::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:06:29,754::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:06:29,754::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:06:29,754::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:06:29,755::task::990::TaskManager.Task::(_decref) Task=`5c101130-d33e-4ab7-9a33-f24ddb5996b7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:06:31,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:06:31,498::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035234 s, 29.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:06:32,406::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:06:32,415::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000657195 s, 6.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:06:33,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:06:33,586::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355129 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:06:35,598::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:06:35,673::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349255 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:06:37,684::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:06:37,762::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0371187 s, 27.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:06:39,313::task::595::TaskManager.Task::(_updateState) Task=`2ceb6281-d6b2-4242-9516-38d75cba4553`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:06:39,313::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:06:39,313::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657195', 'lastCheck': '6.9', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:06:39,313::task::1185::TaskManager.Task::(prepare) Task=`2ceb6281-d6b2-4242-9516-38d75cba4553`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000657195', 'lastCheck': '6.9', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:06:39,313::task::595::TaskManager.Task::(_updateState) Task=`2ceb6281-d6b2-4242-9516-38d75cba4553`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:06:39,314::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:06:39,314::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:06:39,314::task::990::TaskManager.Task::(_decref) Task=`2ceb6281-d6b2-4242-9516-38d75cba4553`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:06:39,775::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-24 11:06:39,827::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:06:39,828::task::595::TaskManager.Task::(_updateState) Task=`ef5ee05b-db77-4bae-b4f0-b7bc12efe332`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:06:39,829::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:06:39,830::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:06:39,831::task::1185::TaskManager.Task::(prepare) Task=`ef5ee05b-db77-4bae-b4f0-b7bc12efe332`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:06:39,832::task::595::TaskManager.Task::(_updateState) Task=`ef5ee05b-db77-4bae-b4f0-b7bc12efe332`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:06:39,832::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:06:39,833::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:06:39,834::task::990::TaskManager.Task::(_decref) Task=`ef5ee05b-db77-4bae-b4f0-b7bc12efe332`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:06:39,861::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344962 s, 29.7 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-24 11:06:39,887::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:06:39,888::task::595::TaskManager.Task::(_updateState) Task=`ccc67fb7-757b-437a-8e07-ca7612cef8e0`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:06:39,888::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:06:39,888::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c9dfc739-f5f1-41c1-b18d-5fc4382cce78`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:06:39,889::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:06:39,889::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:06:39,889::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c9dfc739-f5f1-41c1-b18d-5fc4382cce78`::Granted request >Thread-34::DEBUG::2014-07-24 11:06:39,889::task::827::TaskManager.Task::(resourceAcquired) Task=`ccc67fb7-757b-437a-8e07-ca7612cef8e0`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:06:39,889::task::990::TaskManager.Task::(_decref) Task=`ccc67fb7-757b-437a-8e07-ca7612cef8e0`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:06:39,890::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:06:39,890::task::1185::TaskManager.Task::(prepare) Task=`ccc67fb7-757b-437a-8e07-ca7612cef8e0`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:06:39,891::task::595::TaskManager.Task::(_updateState) Task=`ccc67fb7-757b-437a-8e07-ca7612cef8e0`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:06:39,891::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:06:39,891::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:06:39,891::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:06:39,891::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:06:39,892::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:06:39,892::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:06:39,892::task::990::TaskManager.Task::(_decref) Task=`ccc67fb7-757b-437a-8e07-ca7612cef8e0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:06:41,873::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:06:41,952::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341311 s, 30.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:06:42,420::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:06:42,430::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000719794 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:06:43,964::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:06:44,043::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0394787 s, 25.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:06:46,055::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:06:46,131::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362302 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:06:48,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:06:48,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347289 s, 29.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:06:50,001::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:06:50,001::task::595::TaskManager.Task::(_updateState) Task=`2c03af1a-793e-44d2-9b8a-8b362cbde930`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:06:50,001::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:06:50,002::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:06:50,002::task::1185::TaskManager.Task::(prepare) Task=`2c03af1a-793e-44d2-9b8a-8b362cbde930`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:06:50,002::task::595::TaskManager.Task::(_updateState) Task=`2c03af1a-793e-44d2-9b8a-8b362cbde930`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:06:50,002::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:06:50,002::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:06:50,002::task::990::TaskManager.Task::(_decref) Task=`2c03af1a-793e-44d2-9b8a-8b362cbde930`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:06:50,092::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:06:50,092::task::595::TaskManager.Task::(_updateState) Task=`eef48945-a4be-4644-bec7-903f685baf70`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:06:50,093::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:06:50,093::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`9dab0fe9-e321-4571-aa6b-8612f6b80a3e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:06:50,093::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:06:50,093::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:06:50,094::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`9dab0fe9-e321-4571-aa6b-8612f6b80a3e`::Granted request >Thread-34::DEBUG::2014-07-24 11:06:50,094::task::827::TaskManager.Task::(resourceAcquired) Task=`eef48945-a4be-4644-bec7-903f685baf70`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:06:50,094::task::990::TaskManager.Task::(_decref) Task=`eef48945-a4be-4644-bec7-903f685baf70`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:06:50,095::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:06:50,095::task::1185::TaskManager.Task::(prepare) Task=`eef48945-a4be-4644-bec7-903f685baf70`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:06:50,095::task::595::TaskManager.Task::(_updateState) Task=`eef48945-a4be-4644-bec7-903f685baf70`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:06:50,095::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:06:50,095::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:06:50,096::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:06:50,096::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:06:50,096::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:06:50,096::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:06:50,096::task::990::TaskManager.Task::(_decref) Task=`eef48945-a4be-4644-bec7-903f685baf70`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:06:50,230::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:06:50,305::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357751 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:06:52,317::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:06:52,394::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370037 s, 27.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:06:52,435::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:06:52,444::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000685477 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:06:54,406::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:06:54,480::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351559 s, 29.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:06:54,794::task::595::TaskManager.Task::(_updateState) Task=`1746a101-88f2-4228-89c1-f17fbc63dce4`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:06:54,795::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:06:54,795::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000685477', 'lastCheck': '2.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:06:54,795::task::1185::TaskManager.Task::(prepare) Task=`1746a101-88f2-4228-89c1-f17fbc63dce4`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000685477', 'lastCheck': '2.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:06:54,795::task::595::TaskManager.Task::(_updateState) Task=`1746a101-88f2-4228-89c1-f17fbc63dce4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:06:54,795::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:06:54,796::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:06:54,796::task::990::TaskManager.Task::(_decref) Task=`1746a101-88f2-4228-89c1-f17fbc63dce4`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:06:56,493::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:06:56,568::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363339 s, 28.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:06:58,523::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:06:58,581::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:06:58,658::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0378369 s, 27.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:07:00,224::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:07:00,224::task::595::TaskManager.Task::(_updateState) Task=`243ab8f3-5960-48e8-9ce2-219da9e64cee`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:07:00,224::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:07:00,225::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:07:00,225::task::1185::TaskManager.Task::(prepare) Task=`243ab8f3-5960-48e8-9ce2-219da9e64cee`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:07:00,225::task::595::TaskManager.Task::(_updateState) Task=`243ab8f3-5960-48e8-9ce2-219da9e64cee`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:07:00,225::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:07:00,225::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:07:00,225::task::990::TaskManager.Task::(_decref) Task=`243ab8f3-5960-48e8-9ce2-219da9e64cee`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:07:00,293::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:07:00,294::task::595::TaskManager.Task::(_updateState) Task=`4f017e65-2150-4e65-9191-5d3404a3592e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:07:00,294::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:07:00,294::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c7fdb4d1-6d0d-4266-b24b-25a6829fb145`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:07:00,295::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:07:00,295::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:07:00,295::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c7fdb4d1-6d0d-4266-b24b-25a6829fb145`::Granted request >Thread-34::DEBUG::2014-07-24 11:07:00,295::task::827::TaskManager.Task::(resourceAcquired) Task=`4f017e65-2150-4e65-9191-5d3404a3592e`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:07:00,295::task::990::TaskManager.Task::(_decref) Task=`4f017e65-2150-4e65-9191-5d3404a3592e`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:07:00,296::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:07:00,296::task::1185::TaskManager.Task::(prepare) Task=`4f017e65-2150-4e65-9191-5d3404a3592e`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:07:00,296::task::595::TaskManager.Task::(_updateState) Task=`4f017e65-2150-4e65-9191-5d3404a3592e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:07:00,297::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:07:00,297::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:07:00,297::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:07:00,297::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:07:00,297::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:07:00,297::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:07:00,298::task::990::TaskManager.Task::(_decref) Task=`4f017e65-2150-4e65-9191-5d3404a3592e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:07:00,670::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:07:00,745::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355659 s, 28.8 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:07:01,489::task::595::TaskManager.Task::(_updateState) Task=`36ad38b4-0215-4916-bff8-13ef46fe8900`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:07:01,489::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:07:01,489::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:07:01,489::task::1185::TaskManager.Task::(prepare) Task=`36ad38b4-0215-4916-bff8-13ef46fe8900`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:07:01,490::task::595::TaskManager.Task::(_updateState) Task=`36ad38b4-0215-4916-bff8-13ef46fe8900`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:07:01,490::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:07:01,490::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:07:01,490::task::990::TaskManager.Task::(_decref) Task=`36ad38b4-0215-4916-bff8-13ef46fe8900`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:07:02,449::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:07:02,458::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000781378 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:07:02,758::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:07:02,834::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370798 s, 27.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:07:04,847::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:07:04,923::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361157 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:07:06,935::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:07:07,012::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0381027 s, 26.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:07:09,025::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:07:09,378::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.313717 s, 3.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:07:10,363::task::595::TaskManager.Task::(_updateState) Task=`385ba982-8913-4462-9966-c31184d1c552`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:07:10,364::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:07:10,364::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000781378', 'lastCheck': '7.9', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:07:10,364::task::1185::TaskManager.Task::(prepare) Task=`385ba982-8913-4462-9966-c31184d1c552`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000781378', 'lastCheck': '7.9', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:07:10,364::task::595::TaskManager.Task::(_updateState) Task=`385ba982-8913-4462-9966-c31184d1c552`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:07:10,364::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:07:10,364::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:07:10,365::task::990::TaskManager.Task::(_decref) Task=`385ba982-8913-4462-9966-c31184d1c552`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 11:07:10,515::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:07:10,515::task::595::TaskManager.Task::(_updateState) Task=`204825b0-5b30-4ca3-b5b2-1eda661831fe`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:07:10,516::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:07:10,516::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:07:10,516::task::1185::TaskManager.Task::(prepare) Task=`204825b0-5b30-4ca3-b5b2-1eda661831fe`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:07:10,516::task::595::TaskManager.Task::(_updateState) Task=`204825b0-5b30-4ca3-b5b2-1eda661831fe`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:07:10,516::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:07:10,517::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:07:10,517::task::990::TaskManager.Task::(_decref) Task=`204825b0-5b30-4ca3-b5b2-1eda661831fe`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:07:10,614::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:07:10,614::task::595::TaskManager.Task::(_updateState) Task=`f0e5d5dc-28a4-4966-a6cb-da5218e545b1`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:07:10,614::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:07:10,615::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`86758a6e-da1d-4d7a-a2a9-dfde110f093d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:07:10,615::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:07:10,615::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:07:10,615::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`86758a6e-da1d-4d7a-a2a9-dfde110f093d`::Granted request >Thread-34::DEBUG::2014-07-24 11:07:10,615::task::827::TaskManager.Task::(resourceAcquired) Task=`f0e5d5dc-28a4-4966-a6cb-da5218e545b1`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:07:10,616::task::990::TaskManager.Task::(_decref) Task=`f0e5d5dc-28a4-4966-a6cb-da5218e545b1`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:07:10,616::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:07:10,616::task::1185::TaskManager.Task::(prepare) Task=`f0e5d5dc-28a4-4966-a6cb-da5218e545b1`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:07:10,617::task::595::TaskManager.Task::(_updateState) Task=`f0e5d5dc-28a4-4966-a6cb-da5218e545b1`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:07:10,617::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:07:10,617::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:07:10,617::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:07:10,617::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:07:10,618::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:07:10,618::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:07:10,618::task::990::TaskManager.Task::(_decref) Task=`f0e5d5dc-28a4-4966-a6cb-da5218e545b1`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:07:11,390::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:07:11,463::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339104 s, 30.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:07:12,462::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:07:12,472::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000655956 s, 6.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:07:13,476::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:07:13,553::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362085 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:07:15,565::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:07:15,639::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346199 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:07:17,652::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:07:17,726::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034882 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:07:19,738::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:07:19,810::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329815 s, 31.0 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:07:20,688::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:07:20,689::task::595::TaskManager.Task::(_updateState) Task=`69c070ad-8d8c-412c-96c1-a08a71943c3d`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:07:20,689::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:07:20,689::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:07:20,689::task::1185::TaskManager.Task::(prepare) Task=`69c070ad-8d8c-412c-96c1-a08a71943c3d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:07:20,689::task::595::TaskManager.Task::(_updateState) Task=`69c070ad-8d8c-412c-96c1-a08a71943c3d`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:07:20,690::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:07:20,690::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:07:20,690::task::990::TaskManager.Task::(_decref) Task=`69c070ad-8d8c-412c-96c1-a08a71943c3d`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:07:20,735::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:07:20,735::task::595::TaskManager.Task::(_updateState) Task=`3156be8a-a3a6-45ce-b497-24eb24c7cf47`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:07:20,736::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:07:20,736::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`cfcd8cd1-534c-4e80-87e4-c79d4baebbe9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:07:20,736::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:07:20,736::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:07:20,737::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`cfcd8cd1-534c-4e80-87e4-c79d4baebbe9`::Granted request >Thread-34::DEBUG::2014-07-24 11:07:20,737::task::827::TaskManager.Task::(resourceAcquired) Task=`3156be8a-a3a6-45ce-b497-24eb24c7cf47`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:07:20,737::task::990::TaskManager.Task::(_decref) Task=`3156be8a-a3a6-45ce-b497-24eb24c7cf47`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:07:20,738::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:07:20,738::task::1185::TaskManager.Task::(prepare) Task=`3156be8a-a3a6-45ce-b497-24eb24c7cf47`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:07:20,738::task::595::TaskManager.Task::(_updateState) Task=`3156be8a-a3a6-45ce-b497-24eb24c7cf47`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:07:20,738::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:07:20,738::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:07:20,739::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:07:20,739::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:07:20,739::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:07:20,739::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:07:20,739::task::990::TaskManager.Task::(_decref) Task=`3156be8a-a3a6-45ce-b497-24eb24c7cf47`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:07:21,823::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:07:21,898::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343584 s, 29.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:07:22,478::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:07:22,487::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000708858 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:07:23,911::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:07:23,986::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344841 s, 29.7 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:07:25,913::task::595::TaskManager.Task::(_updateState) Task=`ea70dfc2-4d1e-4e73-b2f6-e13e1497c1e8`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:07:25,913::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:07:25,913::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000708858', 'lastCheck': '3.4', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:07:25,913::task::1185::TaskManager.Task::(prepare) Task=`ea70dfc2-4d1e-4e73-b2f6-e13e1497c1e8`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000708858', 'lastCheck': '3.4', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:07:25,913::task::595::TaskManager.Task::(_updateState) Task=`ea70dfc2-4d1e-4e73-b2f6-e13e1497c1e8`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:07:25,913::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:07:25,914::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:07:25,914::task::990::TaskManager.Task::(_decref) Task=`ea70dfc2-4d1e-4e73-b2f6-e13e1497c1e8`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:07:25,999::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:07:26,072::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334164 s, 30.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:07:28,084::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:07:28,158::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356472 s, 28.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:07:28,562::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:07:30,184::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:07:30,258::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350519 s, 29.2 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:07:30,799::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:07:30,799::task::595::TaskManager.Task::(_updateState) Task=`46cab968-1e16-42c7-9832-260cbf3b9de1`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:07:30,799::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:07:30,800::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:07:30,800::task::1185::TaskManager.Task::(prepare) Task=`46cab968-1e16-42c7-9832-260cbf3b9de1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:07:30,800::task::595::TaskManager.Task::(_updateState) Task=`46cab968-1e16-42c7-9832-260cbf3b9de1`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:07:30,800::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:07:30,800::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:07:30,801::task::990::TaskManager.Task::(_decref) Task=`46cab968-1e16-42c7-9832-260cbf3b9de1`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:07:30,835::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:07:30,835::task::595::TaskManager.Task::(_updateState) Task=`9a31331f-ef55-4bda-93d5-c4e698d5cbcf`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:07:30,835::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:07:30,836::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`a2c5158c-577e-451d-8427-9c1ce2e7868e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:07:30,836::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:07:30,836::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:07:30,836::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`a2c5158c-577e-451d-8427-9c1ce2e7868e`::Granted request >Thread-34::DEBUG::2014-07-24 11:07:30,837::task::827::TaskManager.Task::(resourceAcquired) Task=`9a31331f-ef55-4bda-93d5-c4e698d5cbcf`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:07:30,837::task::990::TaskManager.Task::(_decref) Task=`9a31331f-ef55-4bda-93d5-c4e698d5cbcf`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:07:30,838::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:07:30,838::task::1185::TaskManager.Task::(prepare) Task=`9a31331f-ef55-4bda-93d5-c4e698d5cbcf`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:07:30,838::task::595::TaskManager.Task::(_updateState) Task=`9a31331f-ef55-4bda-93d5-c4e698d5cbcf`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:07:30,838::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:07:30,838::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:07:30,839::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:07:30,839::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:07:30,839::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:07:30,839::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:07:30,839::task::990::TaskManager.Task::(_decref) Task=`9a31331f-ef55-4bda-93d5-c4e698d5cbcf`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:07:32,270::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:07:32,349::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344752 s, 29.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:07:32,492::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:07:32,505::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00465964 s, 879 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:07:34,361::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:07:34,436::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352015 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:07:36,448::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:07:36,520::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032738 s, 31.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:07:38,533::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:07:38,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327989 s, 31.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:07:40,617::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:07:40,691::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349241 s, 29.3 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:07:40,900::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:07:40,901::task::595::TaskManager.Task::(_updateState) Task=`62e6f2bb-60b9-4f45-80f7-d75049a59989`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:07:40,901::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:07:40,901::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:07:40,901::task::1185::TaskManager.Task::(prepare) Task=`62e6f2bb-60b9-4f45-80f7-d75049a59989`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:07:40,901::task::595::TaskManager.Task::(_updateState) Task=`62e6f2bb-60b9-4f45-80f7-d75049a59989`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:07:40,902::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:07:40,902::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:07:40,902::task::990::TaskManager.Task::(_decref) Task=`62e6f2bb-60b9-4f45-80f7-d75049a59989`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:07:40,950::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:07:40,950::task::595::TaskManager.Task::(_updateState) Task=`5985282d-5d71-4e4b-a4d6-bea3f3c1d307`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:07:40,950::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:07:40,952::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`abfca491-6cd8-47ad-9641-1c8678b53243`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:07:40,952::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:07:40,952::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:07:40,952::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`abfca491-6cd8-47ad-9641-1c8678b53243`::Granted request >Thread-34::DEBUG::2014-07-24 11:07:40,953::task::827::TaskManager.Task::(resourceAcquired) Task=`5985282d-5d71-4e4b-a4d6-bea3f3c1d307`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:07:40,953::task::990::TaskManager.Task::(_decref) Task=`5985282d-5d71-4e4b-a4d6-bea3f3c1d307`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:07:40,954::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:07:40,954::task::1185::TaskManager.Task::(prepare) Task=`5985282d-5d71-4e4b-a4d6-bea3f3c1d307`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:07:40,954::task::595::TaskManager.Task::(_updateState) Task=`5985282d-5d71-4e4b-a4d6-bea3f3c1d307`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:07:40,954::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:07:40,954::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:07:40,954::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:07:40,955::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:07:40,955::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:07:40,955::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:07:40,955::task::990::TaskManager.Task::(_decref) Task=`5985282d-5d71-4e4b-a4d6-bea3f3c1d307`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 11:07:41,464::task::595::TaskManager.Task::(_updateState) Task=`640a4ac5-ae93-4ea1-a501-307f5cc9f6ba`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:07:41,464::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:07:41,464::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00465964', 'lastCheck': '9.0', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:07:41,464::task::1185::TaskManager.Task::(prepare) Task=`640a4ac5-ae93-4ea1-a501-307f5cc9f6ba`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00465964', 'lastCheck': '9.0', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:07:41,464::task::595::TaskManager.Task::(_updateState) Task=`640a4ac5-ae93-4ea1-a501-307f5cc9f6ba`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:07:41,465::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:07:41,465::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:07:41,465::task::990::TaskManager.Task::(_decref) Task=`640a4ac5-ae93-4ea1-a501-307f5cc9f6ba`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:07:42,510::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:07:42,531::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0121888 s, 336 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:07:42,704::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:07:42,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361265 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:07:44,792::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:07:44,876::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033244 s, 30.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:07:46,887::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:07:46,974::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0471882 s, 21.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:07:48,986::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:07:49,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344064 s, 29.8 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:07:51,022::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:07:51,023::task::595::TaskManager.Task::(_updateState) Task=`5d615a75-6be7-4c98-ab77-5a2bae40e9e3`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:07:51,023::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:07:51,023::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:07:51,024::task::1185::TaskManager.Task::(prepare) Task=`5d615a75-6be7-4c98-ab77-5a2bae40e9e3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:07:51,024::task::595::TaskManager.Task::(_updateState) Task=`5d615a75-6be7-4c98-ab77-5a2bae40e9e3`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:07:51,024::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:07:51,024::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:07:51,024::task::990::TaskManager.Task::(_decref) Task=`5d615a75-6be7-4c98-ab77-5a2bae40e9e3`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:07:51,057::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:07:51,057::task::595::TaskManager.Task::(_updateState) Task=`69c1bd9e-6b24-48ad-981a-932fa60ce138`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:07:51,058::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:07:51,058::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1bf95ac4-711a-4a26-aa83-eddab68ea604`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:07:51,058::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:07:51,059::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:07:51,059::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1bf95ac4-711a-4a26-aa83-eddab68ea604`::Granted request >Thread-34::DEBUG::2014-07-24 11:07:51,059::task::827::TaskManager.Task::(resourceAcquired) Task=`69c1bd9e-6b24-48ad-981a-932fa60ce138`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:07:51,059::task::990::TaskManager.Task::(_decref) Task=`69c1bd9e-6b24-48ad-981a-932fa60ce138`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:07:51,060::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:07:51,060::task::1185::TaskManager.Task::(prepare) Task=`69c1bd9e-6b24-48ad-981a-932fa60ce138`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:07:51,060::task::595::TaskManager.Task::(_updateState) Task=`69c1bd9e-6b24-48ad-981a-932fa60ce138`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:07:51,061::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:07:51,061::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:07:51,061::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:07:51,061::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:07:51,061::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:07:51,061::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:07:51,062::task::990::TaskManager.Task::(_decref) Task=`69c1bd9e-6b24-48ad-981a-932fa60ce138`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:07:51,073::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:07:51,147::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342909 s, 29.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:07:52,536::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:07:52,573::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0284864 s, 144 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:07:53,160::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:07:53,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03633 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:07:55,248::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:07:55,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0325303 s, 31.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:07:56,936::task::595::TaskManager.Task::(_updateState) Task=`325bd7d0-5e79-4742-9251-ee5c215c1e1c`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:07:56,936::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:07:56,937::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0284864', 'lastCheck': '4.4', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:07:56,937::task::1185::TaskManager.Task::(prepare) Task=`325bd7d0-5e79-4742-9251-ee5c215c1e1c`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0284864', 'lastCheck': '4.4', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:07:56,937::task::595::TaskManager.Task::(_updateState) Task=`325bd7d0-5e79-4742-9251-ee5c215c1e1c`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:07:56,937::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:07:56,937::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:07:56,937::task::990::TaskManager.Task::(_decref) Task=`325bd7d0-5e79-4742-9251-ee5c215c1e1c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:07:57,332::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:07:57,409::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0371351 s, 27.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:07:58,600::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:07:59,421::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:07:59,494::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333898 s, 30.7 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:08:01,133::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:08:01,133::task::595::TaskManager.Task::(_updateState) Task=`a3017667-7fcd-44dc-ab47-c1e8a3f84c63`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:08:01,133::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:08:01,134::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:08:01,134::task::1185::TaskManager.Task::(prepare) Task=`a3017667-7fcd-44dc-ab47-c1e8a3f84c63`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:08:01,134::task::595::TaskManager.Task::(_updateState) Task=`a3017667-7fcd-44dc-ab47-c1e8a3f84c63`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:08:01,134::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:08:01,134::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:08:01,135::task::990::TaskManager.Task::(_decref) Task=`a3017667-7fcd-44dc-ab47-c1e8a3f84c63`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:08:01,178::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:08:01,178::task::595::TaskManager.Task::(_updateState) Task=`47c58d38-5f9a-47e2-9b6e-c3d75f8df4cb`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:08:01,179::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:08:01,179::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`11c8197b-1478-470e-a695-eff61f5a7bbe`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:08:01,179::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:08:01,179::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:08:01,180::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`11c8197b-1478-470e-a695-eff61f5a7bbe`::Granted request >Thread-34::DEBUG::2014-07-24 11:08:01,180::task::827::TaskManager.Task::(resourceAcquired) Task=`47c58d38-5f9a-47e2-9b6e-c3d75f8df4cb`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:08:01,180::task::990::TaskManager.Task::(_decref) Task=`47c58d38-5f9a-47e2-9b6e-c3d75f8df4cb`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:08:01,181::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:08:01,181::task::1185::TaskManager.Task::(prepare) Task=`47c58d38-5f9a-47e2-9b6e-c3d75f8df4cb`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:08:01,181::task::595::TaskManager.Task::(_updateState) Task=`47c58d38-5f9a-47e2-9b6e-c3d75f8df4cb`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:08:01,181::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:08:01,182::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:08:01,182::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:08:01,182::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:08:01,182::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:08:01,182::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:08:01,183::task::990::TaskManager.Task::(_decref) Task=`47c58d38-5f9a-47e2-9b6e-c3d75f8df4cb`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:08:01,506::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:08:01,584::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355638 s, 28.8 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:08:01,702::task::595::TaskManager.Task::(_updateState) Task=`fc0cf4eb-5800-4c52-a154-6588cfdd7e01`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:08:01,702::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:08:01,704::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:08:01,704::task::1185::TaskManager.Task::(prepare) Task=`fc0cf4eb-5800-4c52-a154-6588cfdd7e01`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:08:01,704::task::595::TaskManager.Task::(_updateState) Task=`fc0cf4eb-5800-4c52-a154-6588cfdd7e01`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:08:01,704::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:08:01,704::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:08:01,704::task::990::TaskManager.Task::(_decref) Task=`fc0cf4eb-5800-4c52-a154-6588cfdd7e01`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:08:02,580::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:08:02,606::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0176616 s, 232 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:08:03,597::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:08:03,674::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330499 s, 31.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:08:05,685::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:08:05,762::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358903 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:08:07,774::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:08:07,848::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033742 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:08:09,860::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:08:09,933::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033394 s, 30.7 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:08:11,243::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:08:11,250::task::595::TaskManager.Task::(_updateState) Task=`143477ef-a7e9-44dc-8064-0d3a976104b2`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:08:11,250::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:08:11,250::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:08:11,250::task::1185::TaskManager.Task::(prepare) Task=`143477ef-a7e9-44dc-8064-0d3a976104b2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:08:11,251::task::595::TaskManager.Task::(_updateState) Task=`143477ef-a7e9-44dc-8064-0d3a976104b2`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:08:11,251::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:08:11,251::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:08:11,251::task::990::TaskManager.Task::(_decref) Task=`143477ef-a7e9-44dc-8064-0d3a976104b2`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:08:11,282::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:08:11,283::task::595::TaskManager.Task::(_updateState) Task=`6bf56621-632c-47a3-97ea-fbba8e635953`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:08:11,283::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:08:11,283::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1ffef78d-4103-4331-a3d3-023381e91e1b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:08:11,283::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:08:11,284::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:08:11,284::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1ffef78d-4103-4331-a3d3-023381e91e1b`::Granted request >Thread-34::DEBUG::2014-07-24 11:08:11,284::task::827::TaskManager.Task::(resourceAcquired) Task=`6bf56621-632c-47a3-97ea-fbba8e635953`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:08:11,284::task::990::TaskManager.Task::(_decref) Task=`6bf56621-632c-47a3-97ea-fbba8e635953`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:08:11,285::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:08:11,285::task::1185::TaskManager.Task::(prepare) Task=`6bf56621-632c-47a3-97ea-fbba8e635953`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:08:11,285::task::595::TaskManager.Task::(_updateState) Task=`6bf56621-632c-47a3-97ea-fbba8e635953`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:08:11,286::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:08:11,286::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:08:11,286::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:08:11,286::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:08:11,286::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:08:11,287::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:08:11,287::task::990::TaskManager.Task::(_decref) Task=`6bf56621-632c-47a3-97ea-fbba8e635953`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:08:11,944::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:08:12,019::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345343 s, 29.7 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:08:12,303::task::595::TaskManager.Task::(_updateState) Task=`c94faa96-ef66-47f1-930b-8637eef6cd63`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:08:12,303::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:08:12,304::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0176616', 'lastCheck': '9.7', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:08:12,304::task::1185::TaskManager.Task::(prepare) Task=`c94faa96-ef66-47f1-930b-8637eef6cd63`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0176616', 'lastCheck': '9.7', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:08:12,304::task::595::TaskManager.Task::(_updateState) Task=`c94faa96-ef66-47f1-930b-8637eef6cd63`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:08:12,304::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:08:12,304::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:08:12,304::task::990::TaskManager.Task::(_decref) Task=`c94faa96-ef66-47f1-930b-8637eef6cd63`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:08:12,612::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:08:12,622::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000706077 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:08:14,031::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:08:14,102::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0326943 s, 31.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:08:16,115::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:08:16,189::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035313 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:08:18,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:08:18,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03421 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:08:20,287::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:08:20,361::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342265 s, 29.9 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:08:21,355::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [22918c4c] >Thread-13::DEBUG::2014-07-24 11:08:21,355::task::595::TaskManager.Task::(_updateState) Task=`d61c492c-e5a7-4972-bccc-fd663364d313`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:08:21,355::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:08:21,356::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:08:21,356::task::1185::TaskManager.Task::(prepare) Task=`d61c492c-e5a7-4972-bccc-fd663364d313`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:08:21,356::task::595::TaskManager.Task::(_updateState) Task=`d61c492c-e5a7-4972-bccc-fd663364d313`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:08:21,356::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:08:21,356::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:08:21,356::task::990::TaskManager.Task::(_decref) Task=`d61c492c-e5a7-4972-bccc-fd663364d313`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:08:21,392::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [22918c4c] >Thread-34::DEBUG::2014-07-24 11:08:21,392::task::595::TaskManager.Task::(_updateState) Task=`1564ba1f-9077-49e8-ad50-c3b93f453327`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:08:21,393::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:08:21,393::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`16d92c97-ecb2-4d77-b7e3-0ad3a559e99b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:08:21,393::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:08:21,394::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:08:21,394::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`16d92c97-ecb2-4d77-b7e3-0ad3a559e99b`::Granted request >Thread-34::DEBUG::2014-07-24 11:08:21,394::task::827::TaskManager.Task::(resourceAcquired) Task=`1564ba1f-9077-49e8-ad50-c3b93f453327`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:08:21,394::task::990::TaskManager.Task::(_decref) Task=`1564ba1f-9077-49e8-ad50-c3b93f453327`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:08:21,395::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:08:21,395::task::1185::TaskManager.Task::(prepare) Task=`1564ba1f-9077-49e8-ad50-c3b93f453327`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:08:21,396::task::595::TaskManager.Task::(_updateState) Task=`1564ba1f-9077-49e8-ad50-c3b93f453327`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:08:21,396::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:08:21,396::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:08:21,396::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:08:21,396::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:08:21,396::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:08:21,397::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:08:21,397::task::990::TaskManager.Task::(_decref) Task=`1564ba1f-9077-49e8-ad50-c3b93f453327`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:08:22,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:08:22,447::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347806 s, 29.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:08:22,627::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:08:22,640::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00475985 s, 861 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:08:24,459::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:08:24,533::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348095 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:08:26,545::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:08:26,619::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347669 s, 29.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:08:27,690::task::595::TaskManager.Task::(_updateState) Task=`5854215d-2a8b-47cc-915b-b2fad79da7ea`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:08:27,690::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:08:27,691::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00475985', 'lastCheck': '5.0', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:08:27,691::task::1185::TaskManager.Task::(prepare) Task=`5854215d-2a8b-47cc-915b-b2fad79da7ea`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00475985', 'lastCheck': '5.0', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:08:27,691::task::595::TaskManager.Task::(_updateState) Task=`5854215d-2a8b-47cc-915b-b2fad79da7ea`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:08:27,691::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:08:27,691::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:08:27,691::task::990::TaskManager.Task::(_decref) Task=`5854215d-2a8b-47cc-915b-b2fad79da7ea`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:08:28,631::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >VM Channels Listener::DEBUG::2014-07-24 11:08:28,642::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:08:28,704::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329423 s, 31.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:08:30,716::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:08:30,788::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328434 s, 31.2 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:08:31,450::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:08:31,451::task::595::TaskManager.Task::(_updateState) Task=`aa3f81f9-54c2-4d8f-a149-c7854423f3a4`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:08:31,451::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:08:31,451::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:08:31,451::task::1185::TaskManager.Task::(prepare) Task=`aa3f81f9-54c2-4d8f-a149-c7854423f3a4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:08:31,452::task::595::TaskManager.Task::(_updateState) Task=`aa3f81f9-54c2-4d8f-a149-c7854423f3a4`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:08:31,452::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:08:31,452::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:08:31,452::task::990::TaskManager.Task::(_decref) Task=`aa3f81f9-54c2-4d8f-a149-c7854423f3a4`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:08:31,484::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:08:31,484::task::595::TaskManager.Task::(_updateState) Task=`b5be79b9-2ac8-461e-8f81-98a748e17ca3`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:08:31,485::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:08:31,485::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f31676f6-94cb-4d9b-ae60-bf1eec023b23`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:08:31,487::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:08:31,487::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:08:31,487::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f31676f6-94cb-4d9b-ae60-bf1eec023b23`::Granted request >Thread-34::DEBUG::2014-07-24 11:08:31,488::task::827::TaskManager.Task::(resourceAcquired) Task=`b5be79b9-2ac8-461e-8f81-98a748e17ca3`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:08:31,488::task::990::TaskManager.Task::(_decref) Task=`b5be79b9-2ac8-461e-8f81-98a748e17ca3`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:08:31,488::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:08:31,489::task::1185::TaskManager.Task::(prepare) Task=`b5be79b9-2ac8-461e-8f81-98a748e17ca3`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:08:31,489::task::595::TaskManager.Task::(_updateState) Task=`b5be79b9-2ac8-461e-8f81-98a748e17ca3`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:08:31,489::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:08:31,489::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:08:31,489::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:08:31,489::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:08:31,490::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:08:31,490::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:08:31,490::task::990::TaskManager.Task::(_decref) Task=`b5be79b9-2ac8-461e-8f81-98a748e17ca3`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:08:32,645::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:08:32,665::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0124183 s, 330 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:08:32,800::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:08:32,874::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341822 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:08:34,886::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:08:34,960::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339992 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:08:36,972::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:08:37,046::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347067 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:08:39,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:08:39,158::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0559835 s, 18.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:08:41,170::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:08:41,243::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333468 s, 30.7 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:08:41,547::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:08:41,548::task::595::TaskManager.Task::(_updateState) Task=`413fc8d4-8b8d-4f85-b52c-1f46cf6ff2aa`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:08:41,548::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:08:41,548::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:08:41,548::task::1185::TaskManager.Task::(prepare) Task=`413fc8d4-8b8d-4f85-b52c-1f46cf6ff2aa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:08:41,549::task::595::TaskManager.Task::(_updateState) Task=`413fc8d4-8b8d-4f85-b52c-1f46cf6ff2aa`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:08:41,549::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:08:41,549::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:08:41,549::task::990::TaskManager.Task::(_decref) Task=`413fc8d4-8b8d-4f85-b52c-1f46cf6ff2aa`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:08:41,582::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:08:41,582::task::595::TaskManager.Task::(_updateState) Task=`d0b59908-fa3d-468f-bbf8-731fde51877e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:08:41,582::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:08:41,583::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ed465cc2-56ea-40f9-b326-2fe326455c70`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:08:41,583::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:08:41,583::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:08:41,583::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ed465cc2-56ea-40f9-b326-2fe326455c70`::Granted request >Thread-34::DEBUG::2014-07-24 11:08:41,584::task::827::TaskManager.Task::(resourceAcquired) Task=`d0b59908-fa3d-468f-bbf8-731fde51877e`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:08:41,584::task::990::TaskManager.Task::(_decref) Task=`d0b59908-fa3d-468f-bbf8-731fde51877e`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:08:41,584::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:08:41,585::task::1185::TaskManager.Task::(prepare) Task=`d0b59908-fa3d-468f-bbf8-731fde51877e`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:08:41,585::task::595::TaskManager.Task::(_updateState) Task=`d0b59908-fa3d-468f-bbf8-731fde51877e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:08:41,585::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:08:41,585::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:08:41,585::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:08:41,586::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:08:41,586::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:08:41,586::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:08:41,586::task::990::TaskManager.Task::(_decref) Task=`d0b59908-fa3d-468f-bbf8-731fde51877e`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:08:42,670::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:08:42,690::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0109173 s, 375 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:08:43,100::task::595::TaskManager.Task::(_updateState) Task=`e42d1d5c-f793-4f6f-86d3-b3d8bd78ad26`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:08:43,100::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:08:43,101::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0109173', 'lastCheck': '0.4', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:08:43,101::task::1185::TaskManager.Task::(prepare) Task=`e42d1d5c-f793-4f6f-86d3-b3d8bd78ad26`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0109173', 'lastCheck': '0.4', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:08:43,101::task::595::TaskManager.Task::(_updateState) Task=`e42d1d5c-f793-4f6f-86d3-b3d8bd78ad26`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:08:43,101::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:08:43,101::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:08:43,101::task::990::TaskManager.Task::(_decref) Task=`e42d1d5c-f793-4f6f-86d3-b3d8bd78ad26`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:08:43,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:08:43,329::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332575 s, 30.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:08:45,341::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:08:45,417::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349007 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:08:47,429::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:08:47,504::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354336 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:08:49,516::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:08:49,591::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350887 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:08:51,603::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-13::DEBUG::2014-07-24 11:08:51,642::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:08:51,643::task::595::TaskManager.Task::(_updateState) Task=`682807e3-843a-4677-ade0-be4f41f6cc4a`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:08:51,644::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:08:51,645::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:08:51,646::task::1185::TaskManager.Task::(prepare) Task=`682807e3-843a-4677-ade0-be4f41f6cc4a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:08:51,647::task::595::TaskManager.Task::(_updateState) Task=`682807e3-843a-4677-ade0-be4f41f6cc4a`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:08:51,647::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:08:51,648::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:08:51,649::task::990::TaskManager.Task::(_decref) Task=`682807e3-843a-4677-ade0-be4f41f6cc4a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:08:51,686::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0428581 s, 23.9 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-24 11:08:51,694::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:08:51,695::task::595::TaskManager.Task::(_updateState) Task=`28a73b89-6a70-4481-ba0a-ecdf3f376a4f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:08:51,695::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:08:51,697::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4617b0f2-70c9-4d30-b5d3-6c7ae1ad2d6c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:08:51,697::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:08:51,698::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:08:51,699::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4617b0f2-70c9-4d30-b5d3-6c7ae1ad2d6c`::Granted request >Thread-34::DEBUG::2014-07-24 11:08:51,701::task::827::TaskManager.Task::(resourceAcquired) Task=`28a73b89-6a70-4481-ba0a-ecdf3f376a4f`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:08:51,701::task::990::TaskManager.Task::(_decref) Task=`28a73b89-6a70-4481-ba0a-ecdf3f376a4f`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:08:51,704::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:08:51,705::task::1185::TaskManager.Task::(prepare) Task=`28a73b89-6a70-4481-ba0a-ecdf3f376a4f`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:08:51,705::task::595::TaskManager.Task::(_updateState) Task=`28a73b89-6a70-4481-ba0a-ecdf3f376a4f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:08:51,706::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:08:51,706::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:08:51,707::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:08:51,708::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:08:51,708::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:08:51,709::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:08:51,710::task::990::TaskManager.Task::(_decref) Task=`28a73b89-6a70-4481-ba0a-ecdf3f376a4f`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:08:52,695::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:08:52,716::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0119365 s, 343 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:08:53,716::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:08:53,788::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327608 s, 31.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:08:55,801::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:08:55,876::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344873 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:08:57,888::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:08:57,961::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338215 s, 30.3 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:08:58,468::task::595::TaskManager.Task::(_updateState) Task=`543d54d8-c893-4b5d-98d4-9559b617ebff`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:08:58,469::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:08:58,469::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0119365', 'lastCheck': '5.7', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:08:58,469::task::1185::TaskManager.Task::(prepare) Task=`543d54d8-c893-4b5d-98d4-9559b617ebff`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0119365', 'lastCheck': '5.7', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:08:58,469::task::595::TaskManager.Task::(_updateState) Task=`543d54d8-c893-4b5d-98d4-9559b617ebff`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:08:58,469::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:08:58,469::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:08:58,470::task::990::TaskManager.Task::(_decref) Task=`543d54d8-c893-4b5d-98d4-9559b617ebff`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-07-24 11:08:58,686::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:08:59,974::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:09:00,048::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340888 s, 30.0 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:09:01,774::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:09:01,774::task::595::TaskManager.Task::(_updateState) Task=`f664579d-bc53-439e-9ee6-00aed4ebbb5f`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:09:01,774::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:09:01,775::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:09:01,775::task::1185::TaskManager.Task::(prepare) Task=`f664579d-bc53-439e-9ee6-00aed4ebbb5f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:09:01,775::task::595::TaskManager.Task::(_updateState) Task=`f664579d-bc53-439e-9ee6-00aed4ebbb5f`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:09:01,775::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:09:01,775::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:09:01,775::task::990::TaskManager.Task::(_decref) Task=`f664579d-bc53-439e-9ee6-00aed4ebbb5f`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:09:01,809::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:09:01,809::task::595::TaskManager.Task::(_updateState) Task=`6088424a-087a-4461-a09f-c695b476cb3b`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:09:01,809::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:09:01,810::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d0a17d3a-ffe7-4734-8c24-dcb49a8618ba`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:09:01,810::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:09:01,810::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:09:01,810::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d0a17d3a-ffe7-4734-8c24-dcb49a8618ba`::Granted request >Thread-34::DEBUG::2014-07-24 11:09:01,811::task::827::TaskManager.Task::(resourceAcquired) Task=`6088424a-087a-4461-a09f-c695b476cb3b`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:09:01,811::task::990::TaskManager.Task::(_decref) Task=`6088424a-087a-4461-a09f-c695b476cb3b`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:09:01,812::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:09:01,812::task::1185::TaskManager.Task::(prepare) Task=`6088424a-087a-4461-a09f-c695b476cb3b`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:09:01,812::task::595::TaskManager.Task::(_updateState) Task=`6088424a-087a-4461-a09f-c695b476cb3b`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:09:01,812::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:09:01,812::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:09:01,813::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:09:01,813::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:09:01,813::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:09:01,813::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:09:01,813::task::990::TaskManager.Task::(_decref) Task=`6088424a-087a-4461-a09f-c695b476cb3b`::ref 0 aborting False >Thread-37::DEBUG::2014-07-24 11:09:01,882::task::595::TaskManager.Task::(_updateState) Task=`3bf2b772-82c8-43fd-8294-c8b77a727b79`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:09:01,882::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:09:01,882::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:09:01,883::task::1185::TaskManager.Task::(prepare) Task=`3bf2b772-82c8-43fd-8294-c8b77a727b79`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:09:01,883::task::595::TaskManager.Task::(_updateState) Task=`3bf2b772-82c8-43fd-8294-c8b77a727b79`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:09:01,883::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:09:01,883::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:09:01,883::task::990::TaskManager.Task::(_decref) Task=`3bf2b772-82c8-43fd-8294-c8b77a727b79`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:09:02,060::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:09:02,136::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0326816 s, 31.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:09:02,721::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:09:02,741::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.010744 s, 381 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:09:04,148::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:09:04,243::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0430094 s, 23.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:09:06,259::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:09:06,758::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.458947 s, 2.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:09:08,770::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:09:08,842::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330646 s, 31.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:09:10,855::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:09:10,929::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354162 s, 28.9 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:09:11,879::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:09:11,879::task::595::TaskManager.Task::(_updateState) Task=`a7cc5bff-634a-4571-b0b7-e21b2929ffc5`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:09:11,879::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:09:11,880::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:09:11,880::task::1185::TaskManager.Task::(prepare) Task=`a7cc5bff-634a-4571-b0b7-e21b2929ffc5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:09:11,880::task::595::TaskManager.Task::(_updateState) Task=`a7cc5bff-634a-4571-b0b7-e21b2929ffc5`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:09:11,880::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:09:11,880::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:09:11,880::task::990::TaskManager.Task::(_decref) Task=`a7cc5bff-634a-4571-b0b7-e21b2929ffc5`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:09:11,919::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:09:11,919::task::595::TaskManager.Task::(_updateState) Task=`4e3e7844-14ad-43c0-af9d-fce415e4bbae`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:09:11,919::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:09:11,920::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e30880e6-2443-449c-87a7-1efe5200987f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:09:11,920::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:09:11,920::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:09:11,920::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e30880e6-2443-449c-87a7-1efe5200987f`::Granted request >Thread-34::DEBUG::2014-07-24 11:09:11,921::task::827::TaskManager.Task::(resourceAcquired) Task=`4e3e7844-14ad-43c0-af9d-fce415e4bbae`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:09:11,921::task::990::TaskManager.Task::(_decref) Task=`4e3e7844-14ad-43c0-af9d-fce415e4bbae`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:09:11,921::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:09:11,922::task::1185::TaskManager.Task::(prepare) Task=`4e3e7844-14ad-43c0-af9d-fce415e4bbae`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:09:11,922::task::595::TaskManager.Task::(_updateState) Task=`4e3e7844-14ad-43c0-af9d-fce415e4bbae`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:09:11,922::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:09:11,922::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:09:11,922::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:09:11,923::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:09:11,923::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:09:11,923::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:09:11,923::task::990::TaskManager.Task::(_decref) Task=`4e3e7844-14ad-43c0-af9d-fce415e4bbae`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:09:12,745::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:09:12,754::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000593735 s, 6.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:09:12,942::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:09:13,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033651 s, 30.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:09:13,824::task::595::TaskManager.Task::(_updateState) Task=`20e34c40-7c23-464c-b524-e362bb09f17d`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:09:13,824::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:09:13,825::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000593735', 'lastCheck': '1.1', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:09:13,825::task::1185::TaskManager.Task::(prepare) Task=`20e34c40-7c23-464c-b524-e362bb09f17d`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000593735', 'lastCheck': '1.1', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:09:13,825::task::595::TaskManager.Task::(_updateState) Task=`20e34c40-7c23-464c-b524-e362bb09f17d`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:09:13,825::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:09:13,825::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:09:13,825::task::990::TaskManager.Task::(_decref) Task=`20e34c40-7c23-464c-b524-e362bb09f17d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:09:15,026::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:09:15,101::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355377 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:09:17,113::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:09:17,190::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369674 s, 27.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:09:19,203::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:09:19,280::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0377913 s, 27.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:09:21,292::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:09:21,369::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349466 s, 29.3 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:09:21,980::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:09:21,980::task::595::TaskManager.Task::(_updateState) Task=`7ca7ee9f-a66d-4858-9462-437580a23c1c`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:09:21,981::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:09:21,981::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:09:21,981::task::1185::TaskManager.Task::(prepare) Task=`7ca7ee9f-a66d-4858-9462-437580a23c1c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:09:21,981::task::595::TaskManager.Task::(_updateState) Task=`7ca7ee9f-a66d-4858-9462-437580a23c1c`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:09:21,982::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:09:21,982::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:09:21,982::task::990::TaskManager.Task::(_decref) Task=`7ca7ee9f-a66d-4858-9462-437580a23c1c`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:09:22,020::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:09:22,020::task::595::TaskManager.Task::(_updateState) Task=`908a2ed4-3119-403d-944f-8d62c53992b6`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:09:22,020::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:09:22,021::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d1866630-220e-45e4-b6ce-c56bb00294b6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:09:22,021::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:09:22,021::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:09:22,021::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d1866630-220e-45e4-b6ce-c56bb00294b6`::Granted request >Thread-34::DEBUG::2014-07-24 11:09:22,022::task::827::TaskManager.Task::(resourceAcquired) Task=`908a2ed4-3119-403d-944f-8d62c53992b6`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:09:22,022::task::990::TaskManager.Task::(_decref) Task=`908a2ed4-3119-403d-944f-8d62c53992b6`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:09:22,023::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:09:22,023::task::1185::TaskManager.Task::(prepare) Task=`908a2ed4-3119-403d-944f-8d62c53992b6`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:09:22,023::task::595::TaskManager.Task::(_updateState) Task=`908a2ed4-3119-403d-944f-8d62c53992b6`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:09:22,023::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:09:22,023::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:09:22,024::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:09:22,024::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:09:22,024::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:09:22,024::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:09:22,024::task::990::TaskManager.Task::(_decref) Task=`908a2ed4-3119-403d-944f-8d62c53992b6`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:09:22,759::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:09:22,775::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00714863 s, 573 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:09:23,381::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:09:23,458::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356778 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:09:25,470::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:09:25,544::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340704 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:09:27,557::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:09:27,630::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340191 s, 30.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:09:28,724::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-13::DEBUG::2014-07-24 11:09:29,274::task::595::TaskManager.Task::(_updateState) Task=`2acefc48-1b98-40fb-bad8-a09466a7c3e8`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:09:29,275::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:09:29,275::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00714863', 'lastCheck': '6.5', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:09:29,275::task::1185::TaskManager.Task::(prepare) Task=`2acefc48-1b98-40fb-bad8-a09466a7c3e8`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00714863', 'lastCheck': '6.5', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:09:29,275::task::595::TaskManager.Task::(_updateState) Task=`2acefc48-1b98-40fb-bad8-a09466a7c3e8`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:09:29,276::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:09:29,276::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:09:29,276::task::990::TaskManager.Task::(_decref) Task=`2acefc48-1b98-40fb-bad8-a09466a7c3e8`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:09:29,643::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:09:29,743::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.047264 s, 21.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:09:31,760::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:09:31,834::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340606 s, 30.1 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:09:32,082::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:09:32,082::task::595::TaskManager.Task::(_updateState) Task=`310e9c3b-81d2-4845-bbbf-8677ec0e989f`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:09:32,082::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:09:32,083::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:09:32,083::task::1185::TaskManager.Task::(prepare) Task=`310e9c3b-81d2-4845-bbbf-8677ec0e989f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:09:32,083::task::595::TaskManager.Task::(_updateState) Task=`310e9c3b-81d2-4845-bbbf-8677ec0e989f`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:09:32,083::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:09:32,083::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:09:32,084::task::990::TaskManager.Task::(_decref) Task=`310e9c3b-81d2-4845-bbbf-8677ec0e989f`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:09:32,116::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:09:32,116::task::595::TaskManager.Task::(_updateState) Task=`a8f5aa78-1a76-435d-9562-6df275889681`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:09:32,117::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:09:32,117::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`53bec48f-c615-48b0-b2ed-baccbec09ba5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:09:32,117::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:09:32,117::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:09:32,118::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`53bec48f-c615-48b0-b2ed-baccbec09ba5`::Granted request >Thread-34::DEBUG::2014-07-24 11:09:32,118::task::827::TaskManager.Task::(resourceAcquired) Task=`a8f5aa78-1a76-435d-9562-6df275889681`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:09:32,118::task::990::TaskManager.Task::(_decref) Task=`a8f5aa78-1a76-435d-9562-6df275889681`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:09:32,119::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:09:32,119::task::1185::TaskManager.Task::(prepare) Task=`a8f5aa78-1a76-435d-9562-6df275889681`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:09:32,119::task::595::TaskManager.Task::(_updateState) Task=`a8f5aa78-1a76-435d-9562-6df275889681`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:09:32,119::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:09:32,120::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:09:32,120::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:09:32,120::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:09:32,120::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:09:32,120::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:09:32,120::task::990::TaskManager.Task::(_decref) Task=`a8f5aa78-1a76-435d-9562-6df275889681`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:09:32,779::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:09:32,789::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000741441 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:09:33,846::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:09:33,921::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352696 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:09:35,933::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:09:36,009::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343608 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:09:38,021::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:09:38,093::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331708 s, 30.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:09:40,106::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:09:40,180::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355168 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:09:42,193::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-13::DEBUG::2014-07-24 11:09:42,210::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:09:42,211::task::595::TaskManager.Task::(_updateState) Task=`fb29b372-3220-445e-b4a2-45bfa256ce7e`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:09:42,212::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:09:42,214::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:09:42,215::task::1185::TaskManager.Task::(prepare) Task=`fb29b372-3220-445e-b4a2-45bfa256ce7e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:09:42,216::task::595::TaskManager.Task::(_updateState) Task=`fb29b372-3220-445e-b4a2-45bfa256ce7e`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:09:42,217::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:09:42,217::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:09:42,218::task::990::TaskManager.Task::(_decref) Task=`fb29b372-3220-445e-b4a2-45bfa256ce7e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:09:42,254::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:09:42,255::task::595::TaskManager.Task::(_updateState) Task=`0df67227-943a-4158-9286-454b4cd236d9`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:09:42,256::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:09:42,258::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`95f37c99-619a-4b21-bf18-456136681b98`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:09:42,259::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:09:42,260::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:09:42,261::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`95f37c99-619a-4b21-bf18-456136681b98`::Granted request >Thread-34::DEBUG::2014-07-24 11:09:42,263::task::827::TaskManager.Task::(resourceAcquired) Task=`0df67227-943a-4158-9286-454b4cd236d9`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:09:42,264::task::990::TaskManager.Task::(_decref) Task=`0df67227-943a-4158-9286-454b4cd236d9`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:09:42,268::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:09:42,269::task::1185::TaskManager.Task::(prepare) Task=`0df67227-943a-4158-9286-454b4cd236d9`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:09:42,269::task::595::TaskManager.Task::(_updateState) Task=`0df67227-943a-4158-9286-454b4cd236d9`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:09:42,270::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:09:42,271::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:09:42,273::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:09:42,274::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:09:42,275::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:09:42,275::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:09:42,277::task::990::TaskManager.Task::(_decref) Task=`0df67227-943a-4158-9286-454b4cd236d9`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:09:42,302::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0448573 s, 22.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:09:42,794::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:09:42,808::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0061109 s, 670 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:09:44,314::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:09:44,389::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353743 s, 28.9 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:09:44,676::task::595::TaskManager.Task::(_updateState) Task=`a0550e1d-70ba-49d6-be36-58fd17ba6573`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:09:44,676::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:09:44,677::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0061109', 'lastCheck': '1.9', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:09:44,677::task::1185::TaskManager.Task::(prepare) Task=`a0550e1d-70ba-49d6-be36-58fd17ba6573`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0061109', 'lastCheck': '1.9', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:09:44,677::task::595::TaskManager.Task::(_updateState) Task=`a0550e1d-70ba-49d6-be36-58fd17ba6573`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:09:44,677::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:09:44,677::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:09:44,677::task::990::TaskManager.Task::(_decref) Task=`a0550e1d-70ba-49d6-be36-58fd17ba6573`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:09:46,401::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:09:46,476::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353734 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:09:48,488::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:09:48,563::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355294 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:09:50,575::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:09:50,648::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343284 s, 29.8 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:09:52,348::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:09:52,349::task::595::TaskManager.Task::(_updateState) Task=`9da8a406-d837-4dcd-be22-fdd2c63bd6a9`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:09:52,349::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:09:52,349::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:09:52,349::task::1185::TaskManager.Task::(prepare) Task=`9da8a406-d837-4dcd-be22-fdd2c63bd6a9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:09:52,350::task::595::TaskManager.Task::(_updateState) Task=`9da8a406-d837-4dcd-be22-fdd2c63bd6a9`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:09:52,350::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:09:52,350::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:09:52,350::task::990::TaskManager.Task::(_decref) Task=`9da8a406-d837-4dcd-be22-fdd2c63bd6a9`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:09:52,384::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:09:52,384::task::595::TaskManager.Task::(_updateState) Task=`f0e9efa8-b2fe-44cb-bd67-b280bbf3a40b`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:09:52,384::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:09:52,385::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b2cdf151-5625-4215-a6e1-05055c0984da`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:09:52,385::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:09:52,385::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:09:52,385::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b2cdf151-5625-4215-a6e1-05055c0984da`::Granted request >Thread-34::DEBUG::2014-07-24 11:09:52,386::task::827::TaskManager.Task::(resourceAcquired) Task=`f0e9efa8-b2fe-44cb-bd67-b280bbf3a40b`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:09:52,386::task::990::TaskManager.Task::(_decref) Task=`f0e9efa8-b2fe-44cb-bd67-b280bbf3a40b`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:09:52,387::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:09:52,387::task::1185::TaskManager.Task::(prepare) Task=`f0e9efa8-b2fe-44cb-bd67-b280bbf3a40b`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:09:52,387::task::595::TaskManager.Task::(_updateState) Task=`f0e9efa8-b2fe-44cb-bd67-b280bbf3a40b`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:09:52,387::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:09:52,387::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:09:52,387::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:09:52,388::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:09:52,388::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:09:52,388::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:09:52,388::task::990::TaskManager.Task::(_decref) Task=`f0e9efa8-b2fe-44cb-bd67-b280bbf3a40b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:09:52,661::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:09:52,737::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359759 s, 28.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:09:52,813::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:09:52,823::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00114962 s, 3.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:09:54,750::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:09:54,825::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345798 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:09:56,837::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:09:56,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355619 s, 28.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:09:58,764::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:09:58,925::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:09:58,999::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356223 s, 28.7 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:10:00,067::task::595::TaskManager.Task::(_updateState) Task=`cae1030a-7890-4f85-9e68-4dcdee8e3acc`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:10:00,067::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:10:00,068::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00114962', 'lastCheck': '7.2', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:10:00,068::task::1185::TaskManager.Task::(prepare) Task=`cae1030a-7890-4f85-9e68-4dcdee8e3acc`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00114962', 'lastCheck': '7.2', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:10:00,068::task::595::TaskManager.Task::(_updateState) Task=`cae1030a-7890-4f85-9e68-4dcdee8e3acc`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:10:00,068::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:10:00,068::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:10:00,068::task::990::TaskManager.Task::(_decref) Task=`cae1030a-7890-4f85-9e68-4dcdee8e3acc`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:10:01,012::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:10:01,086::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035283 s, 29.0 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:10:02,032::task::595::TaskManager.Task::(_updateState) Task=`bc8b4c15-c3d8-4b3e-9fc8-0146d0814b66`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:10:02,037::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:10:02,038::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:10:02,038::task::1185::TaskManager.Task::(prepare) Task=`bc8b4c15-c3d8-4b3e-9fc8-0146d0814b66`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:10:02,038::task::595::TaskManager.Task::(_updateState) Task=`bc8b4c15-c3d8-4b3e-9fc8-0146d0814b66`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:10:02,038::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:10:02,038::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:10:02,039::task::990::TaskManager.Task::(_decref) Task=`bc8b4c15-c3d8-4b3e-9fc8-0146d0814b66`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 11:10:02,448::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:10:02,448::task::595::TaskManager.Task::(_updateState) Task=`a432b232-90d2-471e-9bd1-5293219898aa`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:10:02,448::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:10:02,449::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:10:02,449::task::1185::TaskManager.Task::(prepare) Task=`a432b232-90d2-471e-9bd1-5293219898aa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:10:02,449::task::595::TaskManager.Task::(_updateState) Task=`a432b232-90d2-471e-9bd1-5293219898aa`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:10:02,449::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:10:02,449::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:10:02,449::task::990::TaskManager.Task::(_decref) Task=`a432b232-90d2-471e-9bd1-5293219898aa`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:10:02,481::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:10:02,481::task::595::TaskManager.Task::(_updateState) Task=`b849b65a-c363-4e09-ab3f-f359e4a45b77`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:10:02,481::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:10:02,482::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`61f71ee1-20f6-402e-98a8-0c3fa0913605`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:10:02,482::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:10:02,482::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:10:02,483::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`61f71ee1-20f6-402e-98a8-0c3fa0913605`::Granted request >Thread-34::DEBUG::2014-07-24 11:10:02,484::task::827::TaskManager.Task::(resourceAcquired) Task=`b849b65a-c363-4e09-ab3f-f359e4a45b77`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:10:02,484::task::990::TaskManager.Task::(_decref) Task=`b849b65a-c363-4e09-ab3f-f359e4a45b77`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:10:02,484::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:10:02,485::task::1185::TaskManager.Task::(prepare) Task=`b849b65a-c363-4e09-ab3f-f359e4a45b77`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:10:02,485::task::595::TaskManager.Task::(_updateState) Task=`b849b65a-c363-4e09-ab3f-f359e4a45b77`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:10:02,485::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:10:02,485::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:10:02,485::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:10:02,485::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:10:02,486::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:10:02,486::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:10:02,486::task::990::TaskManager.Task::(_decref) Task=`b849b65a-c363-4e09-ab3f-f359e4a45b77`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:10:02,828::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:10:02,851::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00709973 s, 577 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:10:03,099::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:10:03,175::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035858 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:10:05,186::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:10:05,261::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360429 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:10:07,274::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:10:07,347::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033488 s, 30.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:10:09,359::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:10:09,445::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0467268 s, 21.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:10:11,458::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:10:11,531::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338035 s, 30.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:10:12,558::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:10:12,558::task::595::TaskManager.Task::(_updateState) Task=`2f5f0890-e3c1-4651-8daa-3ae32ba8db69`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:10:12,559::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:10:12,559::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:10:12,559::task::1185::TaskManager.Task::(prepare) Task=`2f5f0890-e3c1-4651-8daa-3ae32ba8db69`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:10:12,559::task::595::TaskManager.Task::(_updateState) Task=`2f5f0890-e3c1-4651-8daa-3ae32ba8db69`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:10:12,560::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:10:12,560::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:10:12,560::task::990::TaskManager.Task::(_decref) Task=`2f5f0890-e3c1-4651-8daa-3ae32ba8db69`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:10:12,593::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:10:12,593::task::595::TaskManager.Task::(_updateState) Task=`e354f89b-6b50-476c-ab75-bfe38b78168e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:10:12,594::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:10:12,594::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c69e90c5-ea9f-48c8-8b16-03b8a5607bb3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:10:12,594::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:10:12,594::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:10:12,595::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c69e90c5-ea9f-48c8-8b16-03b8a5607bb3`::Granted request >Thread-34::DEBUG::2014-07-24 11:10:12,595::task::827::TaskManager.Task::(resourceAcquired) Task=`e354f89b-6b50-476c-ab75-bfe38b78168e`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:10:12,595::task::990::TaskManager.Task::(_decref) Task=`e354f89b-6b50-476c-ab75-bfe38b78168e`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:10:12,596::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:10:12,596::task::1185::TaskManager.Task::(prepare) Task=`e354f89b-6b50-476c-ab75-bfe38b78168e`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:10:12,596::task::595::TaskManager.Task::(_updateState) Task=`e354f89b-6b50-476c-ab75-bfe38b78168e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:10:12,596::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:10:12,596::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:10:12,597::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:10:12,597::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:10:12,597::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:10:12,597::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:10:12,597::task::990::TaskManager.Task::(_decref) Task=`e354f89b-6b50-476c-ab75-bfe38b78168e`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:10:12,857::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:10:12,876::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.010444 s, 392 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:10:13,544::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:10:13,616::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033218 s, 30.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:10:15,586::task::595::TaskManager.Task::(_updateState) Task=`0c52c563-723a-40bb-b904-7532b4acd590`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:10:15,586::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:10:15,586::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.010444', 'lastCheck': '2.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:10:15,586::task::1185::TaskManager.Task::(prepare) Task=`0c52c563-723a-40bb-b904-7532b4acd590`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.010444', 'lastCheck': '2.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:10:15,586::task::595::TaskManager.Task::(_updateState) Task=`0c52c563-723a-40bb-b904-7532b4acd590`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:10:15,587::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:10:15,587::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:10:15,587::task::990::TaskManager.Task::(_decref) Task=`0c52c563-723a-40bb-b904-7532b4acd590`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:10:15,629::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:10:15,703::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349437 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:10:17,720::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:10:17,793::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033302 s, 30.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:10:19,805::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:10:19,880::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353256 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:10:21,892::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:10:21,967::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352019 s, 29.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:10:22,667::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [5176ccd6] >Thread-14::DEBUG::2014-07-24 11:10:22,667::task::595::TaskManager.Task::(_updateState) Task=`a10124b9-d5b4-42c1-a816-1de9a45b6011`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:10:22,668::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:10:22,668::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:10:22,668::task::1185::TaskManager.Task::(prepare) Task=`a10124b9-d5b4-42c1-a816-1de9a45b6011`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:10:22,668::task::595::TaskManager.Task::(_updateState) Task=`a10124b9-d5b4-42c1-a816-1de9a45b6011`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:10:22,668::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:10:22,669::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:10:22,669::task::990::TaskManager.Task::(_decref) Task=`a10124b9-d5b4-42c1-a816-1de9a45b6011`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:10:22,708::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [5176ccd6] >Thread-34::DEBUG::2014-07-24 11:10:22,709::task::595::TaskManager.Task::(_updateState) Task=`4c181a7e-c7bd-4336-a335-c4ad1038e5f6`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:10:22,709::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:10:22,709::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`94816c75-d8c1-4f76-8b7a-fff62199ec62`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:10:22,709::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:10:22,710::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:10:22,710::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`94816c75-d8c1-4f76-8b7a-fff62199ec62`::Granted request >Thread-34::DEBUG::2014-07-24 11:10:22,710::task::827::TaskManager.Task::(resourceAcquired) Task=`4c181a7e-c7bd-4336-a335-c4ad1038e5f6`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:10:22,710::task::990::TaskManager.Task::(_decref) Task=`4c181a7e-c7bd-4336-a335-c4ad1038e5f6`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:10:22,711::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:10:22,711::task::1185::TaskManager.Task::(prepare) Task=`4c181a7e-c7bd-4336-a335-c4ad1038e5f6`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:10:22,711::task::595::TaskManager.Task::(_updateState) Task=`4c181a7e-c7bd-4336-a335-c4ad1038e5f6`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:10:22,712::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:10:22,712::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:10:22,712::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:10:22,712::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:10:22,712::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:10:22,712::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:10:22,713::task::990::TaskManager.Task::(_decref) Task=`4c181a7e-c7bd-4336-a335-c4ad1038e5f6`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:10:22,880::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:10:22,904::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0151269 s, 271 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:10:23,980::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:10:24,053::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340877 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:10:26,066::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:10:26,140::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340351 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:10:28,153::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:10:28,225::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329983 s, 31.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:10:28,802::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:10:30,237::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:10:30,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357594 s, 28.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:10:30,996::task::595::TaskManager.Task::(_updateState) Task=`17a610a6-0212-443c-b64a-1fb411d7cafe`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:10:30,996::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:10:30,996::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0151269', 'lastCheck': '8.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:10:30,996::task::1185::TaskManager.Task::(prepare) Task=`17a610a6-0212-443c-b64a-1fb411d7cafe`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0151269', 'lastCheck': '8.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:10:30,997::task::595::TaskManager.Task::(_updateState) Task=`17a610a6-0212-443c-b64a-1fb411d7cafe`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:10:30,997::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:10:30,997::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:10:30,997::task::990::TaskManager.Task::(_decref) Task=`17a610a6-0212-443c-b64a-1fb411d7cafe`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:10:32,325::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:10:32,397::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334488 s, 30.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:10:32,774::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:10:32,775::task::595::TaskManager.Task::(_updateState) Task=`710c4f79-9dde-4a6d-9d14-9fe3eca4ab1c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:10:32,775::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:10:32,775::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:10:32,775::task::1185::TaskManager.Task::(prepare) Task=`710c4f79-9dde-4a6d-9d14-9fe3eca4ab1c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:10:32,776::task::595::TaskManager.Task::(_updateState) Task=`710c4f79-9dde-4a6d-9d14-9fe3eca4ab1c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:10:32,776::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:10:32,776::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:10:32,776::task::990::TaskManager.Task::(_decref) Task=`710c4f79-9dde-4a6d-9d14-9fe3eca4ab1c`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:10:32,806::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:10:32,807::task::595::TaskManager.Task::(_updateState) Task=`c8e5da75-4843-458a-be28-155d085178c6`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:10:32,807::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:10:32,807::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`503d60fa-5c7e-4605-8e74-165b0dee5020`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:10:32,808::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:10:32,808::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:10:32,808::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`503d60fa-5c7e-4605-8e74-165b0dee5020`::Granted request >Thread-34::DEBUG::2014-07-24 11:10:32,808::task::827::TaskManager.Task::(resourceAcquired) Task=`c8e5da75-4843-458a-be28-155d085178c6`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:10:32,809::task::990::TaskManager.Task::(_decref) Task=`c8e5da75-4843-458a-be28-155d085178c6`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:10:32,809::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:10:32,809::task::1185::TaskManager.Task::(prepare) Task=`c8e5da75-4843-458a-be28-155d085178c6`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:10:32,810::task::595::TaskManager.Task::(_updateState) Task=`c8e5da75-4843-458a-be28-155d085178c6`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:10:32,810::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:10:32,810::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:10:32,810::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:10:32,810::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:10:32,811::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:10:32,811::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:10:32,811::task::990::TaskManager.Task::(_decref) Task=`c8e5da75-4843-458a-be28-155d085178c6`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:10:32,909::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:10:32,918::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000682615 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:10:34,410::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:10:34,484::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353397 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:10:36,497::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:10:36,572::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357284 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:10:38,584::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:10:38,658::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343363 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:10:40,671::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:10:40,746::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357914 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:10:42,760::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:10:42,834::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344647 s, 29.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:10:42,869::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [22918c4c] >Thread-14::DEBUG::2014-07-24 11:10:42,870::task::595::TaskManager.Task::(_updateState) Task=`de3fb205-7b45-4dc8-9d7d-1bd6f3a8aed8`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:10:42,870::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:10:42,871::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:10:42,871::task::1185::TaskManager.Task::(prepare) Task=`de3fb205-7b45-4dc8-9d7d-1bd6f3a8aed8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:10:42,871::task::595::TaskManager.Task::(_updateState) Task=`de3fb205-7b45-4dc8-9d7d-1bd6f3a8aed8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:10:42,871::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:10:42,871::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:10:42,871::task::990::TaskManager.Task::(_decref) Task=`de3fb205-7b45-4dc8-9d7d-1bd6f3a8aed8`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:10:42,914::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [22918c4c] >Thread-34::DEBUG::2014-07-24 11:10:42,914::task::595::TaskManager.Task::(_updateState) Task=`184807d7-97aa-49ec-b21c-d25cf135935b`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:10:42,914::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:10:42,915::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d283b9d7-10d1-45df-8999-56832b9f21d5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:10:42,915::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:10:42,915::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:10:42,915::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d283b9d7-10d1-45df-8999-56832b9f21d5`::Granted request >Thread-34::DEBUG::2014-07-24 11:10:42,916::task::827::TaskManager.Task::(resourceAcquired) Task=`184807d7-97aa-49ec-b21c-d25cf135935b`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:10:42,916::task::990::TaskManager.Task::(_decref) Task=`184807d7-97aa-49ec-b21c-d25cf135935b`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:10:42,917::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:10:42,917::task::1185::TaskManager.Task::(prepare) Task=`184807d7-97aa-49ec-b21c-d25cf135935b`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:10:42,917::task::595::TaskManager.Task::(_updateState) Task=`184807d7-97aa-49ec-b21c-d25cf135935b`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:10:42,917::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:10:42,917::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:10:42,918::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:10:42,918::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:10:42,918::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:10:42,918::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:10:42,918::task::990::TaskManager.Task::(_decref) Task=`184807d7-97aa-49ec-b21c-d25cf135935b`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:10:42,922::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:10:42,932::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000836982 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:10:44,846::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:10:44,919::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329209 s, 31.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:10:46,403::task::595::TaskManager.Task::(_updateState) Task=`b5bcb168-7b9d-4bc3-b644-1a740cfff9eb`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:10:46,403::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:10:46,403::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000836982', 'lastCheck': '3.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:10:46,404::task::1185::TaskManager.Task::(prepare) Task=`b5bcb168-7b9d-4bc3-b644-1a740cfff9eb`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000836982', 'lastCheck': '3.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:10:46,404::task::595::TaskManager.Task::(_updateState) Task=`b5bcb168-7b9d-4bc3-b644-1a740cfff9eb`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:10:46,404::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:10:46,404::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:10:46,404::task::990::TaskManager.Task::(_decref) Task=`b5bcb168-7b9d-4bc3-b644-1a740cfff9eb`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:10:46,931::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:10:47,009::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0378789 s, 27.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:10:49,021::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:10:49,094::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343737 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:10:51,107::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:10:51,180::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336353 s, 30.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:10:52,937::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:10:52,952::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00682814 s, 600 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:10:52,978::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:10:52,979::task::595::TaskManager.Task::(_updateState) Task=`8ec4a542-3734-4234-9d8f-7e2ee87f145f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:10:52,979::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:10:52,979::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:10:52,980::task::1185::TaskManager.Task::(prepare) Task=`8ec4a542-3734-4234-9d8f-7e2ee87f145f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:10:52,980::task::595::TaskManager.Task::(_updateState) Task=`8ec4a542-3734-4234-9d8f-7e2ee87f145f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:10:52,980::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:10:52,980::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:10:52,980::task::990::TaskManager.Task::(_decref) Task=`8ec4a542-3734-4234-9d8f-7e2ee87f145f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:10:53,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:10:53,267::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035989 s, 28.5 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-24 11:10:53,323::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:10:53,323::task::595::TaskManager.Task::(_updateState) Task=`5a94aa66-e88d-4156-a94b-306caec4c987`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:10:53,324::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:10:53,324::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f817b7f2-7924-4f93-80f6-ec8155e6a703`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:10:53,324::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:10:53,324::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:10:53,325::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f817b7f2-7924-4f93-80f6-ec8155e6a703`::Granted request >Thread-34::DEBUG::2014-07-24 11:10:53,325::task::827::TaskManager.Task::(resourceAcquired) Task=`5a94aa66-e88d-4156-a94b-306caec4c987`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:10:53,325::task::990::TaskManager.Task::(_decref) Task=`5a94aa66-e88d-4156-a94b-306caec4c987`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:10:53,326::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:10:53,326::task::1185::TaskManager.Task::(prepare) Task=`5a94aa66-e88d-4156-a94b-306caec4c987`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:10:53,326::task::595::TaskManager.Task::(_updateState) Task=`5a94aa66-e88d-4156-a94b-306caec4c987`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:10:53,327::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:10:53,327::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:10:53,327::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:10:53,327::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:10:53,327::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:10:53,328::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:10:53,328::task::990::TaskManager.Task::(_decref) Task=`5a94aa66-e88d-4156-a94b-306caec4c987`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:10:55,279::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:10:55,354::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344583 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:10:57,366::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:10:57,440::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347706 s, 29.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:10:58,836::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:10:59,452::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:10:59,526::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342565 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:11:01,538::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:11:01,614::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361093 s, 28.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:11:01,782::task::595::TaskManager.Task::(_updateState) Task=`8f65a08b-3985-4bd6-b926-eca387ca9d80`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:11:01,782::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:11:01,782::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00682814', 'lastCheck': '8.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:11:01,782::task::1185::TaskManager.Task::(prepare) Task=`8f65a08b-3985-4bd6-b926-eca387ca9d80`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00682814', 'lastCheck': '8.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:11:01,782::task::595::TaskManager.Task::(_updateState) Task=`8f65a08b-3985-4bd6-b926-eca387ca9d80`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:11:01,783::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:11:01,783::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:11:01,783::task::990::TaskManager.Task::(_decref) Task=`8f65a08b-3985-4bd6-b926-eca387ca9d80`::ref 0 aborting False >Thread-37::DEBUG::2014-07-24 11:11:02,214::task::595::TaskManager.Task::(_updateState) Task=`807cdd71-62c7-4f31-9dfb-80847edb5ccf`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:11:02,214::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:11:02,214::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:11:02,214::task::1185::TaskManager.Task::(prepare) Task=`807cdd71-62c7-4f31-9dfb-80847edb5ccf`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:11:02,214::task::595::TaskManager.Task::(_updateState) Task=`807cdd71-62c7-4f31-9dfb-80847edb5ccf`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:11:02,215::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:11:02,215::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:11:02,215::task::990::TaskManager.Task::(_decref) Task=`807cdd71-62c7-4f31-9dfb-80847edb5ccf`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:11:02,957::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:11:02,977::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0120893 s, 339 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:11:03,390::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:11:03,391::task::595::TaskManager.Task::(_updateState) Task=`84295a7a-3d5c-4ed4-934b-423af32624ef`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:11:03,391::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:11:03,391::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:11:03,391::task::1185::TaskManager.Task::(prepare) Task=`84295a7a-3d5c-4ed4-934b-423af32624ef`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:11:03,392::task::595::TaskManager.Task::(_updateState) Task=`84295a7a-3d5c-4ed4-934b-423af32624ef`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:11:03,392::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:11:03,392::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:11:03,392::task::990::TaskManager.Task::(_decref) Task=`84295a7a-3d5c-4ed4-934b-423af32624ef`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:11:03,425::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:11:03,425::task::595::TaskManager.Task::(_updateState) Task=`4deaafe9-4beb-46f8-8a76-aecd91970a6e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:11:03,425::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:11:03,425::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1db4781d-fe4b-425b-ab57-2d24254150ba`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:11:03,426::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:11:03,426::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:11:03,426::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1db4781d-fe4b-425b-ab57-2d24254150ba`::Granted request >Thread-34::DEBUG::2014-07-24 11:11:03,426::task::827::TaskManager.Task::(resourceAcquired) Task=`4deaafe9-4beb-46f8-8a76-aecd91970a6e`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:11:03,427::task::990::TaskManager.Task::(_decref) Task=`4deaafe9-4beb-46f8-8a76-aecd91970a6e`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:11:03,427::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:11:03,427::task::1185::TaskManager.Task::(prepare) Task=`4deaafe9-4beb-46f8-8a76-aecd91970a6e`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:11:03,428::task::595::TaskManager.Task::(_updateState) Task=`4deaafe9-4beb-46f8-8a76-aecd91970a6e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:11:03,428::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:11:03,428::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:11:03,428::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:11:03,428::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:11:03,428::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:11:03,429::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:11:03,429::task::990::TaskManager.Task::(_decref) Task=`4deaafe9-4beb-46f8-8a76-aecd91970a6e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:11:03,626::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:11:03,701::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356049 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:11:05,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:11:05,793::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0374789 s, 27.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:11:07,806::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:11:07,879::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345928 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:11:09,892::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:11:09,965::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343409 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:11:11,978::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:11:12,053::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355389 s, 28.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:11:12,981::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 23aa0606-edc3-4882-a4aa-18aa1983458f >Thread-18::DEBUG::2014-07-24 11:11:12,982::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-18::DEBUG::2014-07-24 11:11:12,991::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:11:13,011::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.0117829 s, 174 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:11:13,011::misc::264::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.0117829 s, 174 kB/s'], size: 2048 >Thread-18::DEBUG::2014-07-24 11:11:13,012::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-18::WARNING::2014-07-24 11:11:13,012::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-18::DEBUG::2014-07-24 11:11:13,012::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-18::DEBUG::2014-07-24 11:11:13,012::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 11:11:13,013::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 11:11:13,013::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 11:11:13,013::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 11:11:13,013::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 11:11:13,014::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-18::DEBUG::2014-07-24 11:11:13,365::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:11:13,366::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 11:11:13,367::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'LOCKPOLICY=', 'POOL_DOMAINS=23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'POOL_DESCRIPTION=DS1', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_UUID=637ea13c-81a8-4b44-8cab-961458b01883', 'POOL_SPM_ID=1', '_SHA_CKSUM=a749afdc7119a2d6aad840af5c63c9b28c0b612c', 'POOL_SPM_LVER=0'] >Thread-18::INFO::2014-07-24 11:11:13,368::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_imageNS already registered >Thread-18::INFO::2014-07-24 11:11:13,368::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_volumeNS already registered >Thread-18::INFO::2014-07-24 11:11:13,369::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_lvmActivationNS already registered >Thread-18::DEBUG::2014-07-24 11:11:13,369::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-14::DEBUG::2014-07-24 11:11:13,486::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:11:13,487::task::595::TaskManager.Task::(_updateState) Task=`3e39ee3b-7b6f-451f-8a29-8fa7affa5580`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:11:13,489::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:11:13,489::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:11:13,489::task::1185::TaskManager.Task::(prepare) Task=`3e39ee3b-7b6f-451f-8a29-8fa7affa5580`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:11:13,489::task::595::TaskManager.Task::(_updateState) Task=`3e39ee3b-7b6f-451f-8a29-8fa7affa5580`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:11:13,489::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:11:13,490::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:11:13,490::task::990::TaskManager.Task::(_decref) Task=`3e39ee3b-7b6f-451f-8a29-8fa7affa5580`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:11:13,527::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:11:13,527::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-34::DEBUG::2014-07-24 11:11:13,538::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:11:13,542::task::595::TaskManager.Task::(_updateState) Task=`5919940d-ab64-4df1-873d-5e18e78bc6ea`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:11:13,544::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-18::DEBUG::2014-07-24 11:11:13,545::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00126097 s, 3.2 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-24 11:11:13,549::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c6ded0e3-6947-4e20-a89a-ed6838d497f3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:11:13,551::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:11:13,555::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:11:13,556::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c6ded0e3-6947-4e20-a89a-ed6838d497f3`::Granted request >Thread-34::DEBUG::2014-07-24 11:11:13,561::task::827::TaskManager.Task::(resourceAcquired) Task=`5919940d-ab64-4df1-873d-5e18e78bc6ea`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:11:13,563::task::990::TaskManager.Task::(_decref) Task=`5919940d-ab64-4df1-873d-5e18e78bc6ea`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:11:13,573::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:11:13,575::task::1185::TaskManager.Task::(prepare) Task=`5919940d-ab64-4df1-873d-5e18e78bc6ea`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:11:13,576::task::595::TaskManager.Task::(_updateState) Task=`5919940d-ab64-4df1-873d-5e18e78bc6ea`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:11:13,576::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:11:13,576::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:11:13,577::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:11:13,578::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:11:13,578::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:11:13,578::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:11:13,578::task::990::TaskManager.Task::(_decref) Task=`5919940d-ab64-4df1-873d-5e18e78bc6ea`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:11:14,065::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:11:14,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354567 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:11:16,156::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:11:16,228::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329174 s, 31.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:11:17,178::task::595::TaskManager.Task::(_updateState) Task=`f72c9966-37d4-4182-8383-5aac22ff93cf`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:11:17,178::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:11:17,178::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00126097', 'lastCheck': '3.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:11:17,178::task::1185::TaskManager.Task::(prepare) Task=`f72c9966-37d4-4182-8383-5aac22ff93cf`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00126097', 'lastCheck': '3.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:11:17,178::task::595::TaskManager.Task::(_updateState) Task=`f72c9966-37d4-4182-8383-5aac22ff93cf`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:11:17,179::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:11:17,179::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:11:17,179::task::990::TaskManager.Task::(_decref) Task=`f72c9966-37d4-4182-8383-5aac22ff93cf`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:11:18,240::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:11:18,314::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353198 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:11:20,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:11:20,403::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368273 s, 27.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:11:22,415::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:11:22,487::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332376 s, 30.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:11:23,578::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:11:23,595::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00694843 s, 589 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:11:23,642::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:11:23,642::task::595::TaskManager.Task::(_updateState) Task=`216c68e8-86b3-4809-9fac-806e97ffdb9e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:11:23,643::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:11:23,643::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:11:23,643::task::1185::TaskManager.Task::(prepare) Task=`216c68e8-86b3-4809-9fac-806e97ffdb9e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:11:23,643::task::595::TaskManager.Task::(_updateState) Task=`216c68e8-86b3-4809-9fac-806e97ffdb9e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:11:23,643::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:11:23,644::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:11:23,644::task::990::TaskManager.Task::(_decref) Task=`216c68e8-86b3-4809-9fac-806e97ffdb9e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:11:23,674::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:11:23,675::task::595::TaskManager.Task::(_updateState) Task=`6a0c97b6-8b74-4166-ba8e-13270b8a7333`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:11:23,675::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:11:23,675::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`8ba68a0e-b67e-4031-ac99-bbdd1205e34d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:11:23,676::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:11:23,676::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:11:23,676::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`8ba68a0e-b67e-4031-ac99-bbdd1205e34d`::Granted request >Thread-34::DEBUG::2014-07-24 11:11:23,676::task::827::TaskManager.Task::(resourceAcquired) Task=`6a0c97b6-8b74-4166-ba8e-13270b8a7333`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:11:23,676::task::990::TaskManager.Task::(_decref) Task=`6a0c97b6-8b74-4166-ba8e-13270b8a7333`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:11:23,677::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:11:23,677::task::1185::TaskManager.Task::(prepare) Task=`6a0c97b6-8b74-4166-ba8e-13270b8a7333`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:11:23,678::task::595::TaskManager.Task::(_updateState) Task=`6a0c97b6-8b74-4166-ba8e-13270b8a7333`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:11:23,678::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:11:23,678::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:11:23,678::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:11:23,678::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:11:23,679::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:11:23,679::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:11:23,679::task::990::TaskManager.Task::(_decref) Task=`6a0c97b6-8b74-4166-ba8e-13270b8a7333`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:11:24,500::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:11:24,575::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363237 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:11:26,588::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:11:26,660::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339751 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:11:28,673::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:11:28,746::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327796 s, 31.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:11:28,868::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:11:30,759::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:11:30,830::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032828 s, 31.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:11:32,763::task::595::TaskManager.Task::(_updateState) Task=`9e200a44-1b39-465e-a32c-6e4e7248c14e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:11:32,763::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:11:32,763::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00694843', 'lastCheck': '9.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:11:32,764::task::1185::TaskManager.Task::(prepare) Task=`9e200a44-1b39-465e-a32c-6e4e7248c14e`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00694843', 'lastCheck': '9.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:11:32,764::task::595::TaskManager.Task::(_updateState) Task=`9e200a44-1b39-465e-a32c-6e4e7248c14e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:11:32,764::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:11:32,764::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:11:32,764::task::990::TaskManager.Task::(_decref) Task=`9e200a44-1b39-465e-a32c-6e4e7248c14e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:11:32,842::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:11:32,925::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0434613 s, 23.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:11:33,600::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:11:33,620::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0109341 s, 375 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:11:33,735::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:11:33,735::task::595::TaskManager.Task::(_updateState) Task=`9c6b6a46-a685-469f-8049-a82a981dc13d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:11:33,735::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:11:33,736::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:11:33,736::task::1185::TaskManager.Task::(prepare) Task=`9c6b6a46-a685-469f-8049-a82a981dc13d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:11:33,736::task::595::TaskManager.Task::(_updateState) Task=`9c6b6a46-a685-469f-8049-a82a981dc13d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:11:33,736::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:11:33,736::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:11:33,736::task::990::TaskManager.Task::(_decref) Task=`9c6b6a46-a685-469f-8049-a82a981dc13d`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:11:33,770::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:11:33,770::task::595::TaskManager.Task::(_updateState) Task=`2b111022-0b55-42e3-966a-871d325649a6`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:11:33,771::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:11:33,771::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b201b111-5b32-47bf-a222-5608e8425996`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:11:33,771::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:11:33,771::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:11:33,772::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b201b111-5b32-47bf-a222-5608e8425996`::Granted request >Thread-34::DEBUG::2014-07-24 11:11:33,772::task::827::TaskManager.Task::(resourceAcquired) Task=`2b111022-0b55-42e3-966a-871d325649a6`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:11:33,772::task::990::TaskManager.Task::(_decref) Task=`2b111022-0b55-42e3-966a-871d325649a6`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:11:33,773::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:11:33,773::task::1185::TaskManager.Task::(prepare) Task=`2b111022-0b55-42e3-966a-871d325649a6`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:11:33,773::task::595::TaskManager.Task::(_updateState) Task=`2b111022-0b55-42e3-966a-871d325649a6`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:11:33,773::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:11:33,773::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:11:33,774::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:11:33,774::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:11:33,774::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:11:33,774::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:11:33,774::task::990::TaskManager.Task::(_decref) Task=`2b111022-0b55-42e3-966a-871d325649a6`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:11:34,937::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:11:35,011::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350521 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:11:37,024::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:11:37,096::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332081 s, 30.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:11:39,109::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:11:39,182::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034888 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:11:41,194::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:11:41,274::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0397238 s, 25.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:11:43,286::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:11:43,360::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339119 s, 30.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:11:43,624::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:11:43,645::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0121683 s, 337 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:11:43,892::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:11:43,892::task::595::TaskManager.Task::(_updateState) Task=`886f13e7-1d86-45ef-8bd0-7ee0230efe7c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:11:43,893::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:11:43,893::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:11:43,893::task::1185::TaskManager.Task::(prepare) Task=`886f13e7-1d86-45ef-8bd0-7ee0230efe7c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:11:43,893::task::595::TaskManager.Task::(_updateState) Task=`886f13e7-1d86-45ef-8bd0-7ee0230efe7c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:11:43,893::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:11:43,893::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:11:43,894::task::990::TaskManager.Task::(_decref) Task=`886f13e7-1d86-45ef-8bd0-7ee0230efe7c`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:11:43,927::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:11:43,927::task::595::TaskManager.Task::(_updateState) Task=`23038dc0-8428-42b2-9518-967615e64fbb`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:11:43,927::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:11:43,928::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`375bf739-a69e-442f-a8f6-a8f24ec2c504`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:11:43,928::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:11:43,928::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:11:43,928::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`375bf739-a69e-442f-a8f6-a8f24ec2c504`::Granted request >Thread-34::DEBUG::2014-07-24 11:11:43,929::task::827::TaskManager.Task::(resourceAcquired) Task=`23038dc0-8428-42b2-9518-967615e64fbb`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:11:43,929::task::990::TaskManager.Task::(_decref) Task=`23038dc0-8428-42b2-9518-967615e64fbb`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:11:43,929::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:11:43,930::task::1185::TaskManager.Task::(prepare) Task=`23038dc0-8428-42b2-9518-967615e64fbb`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:11:43,930::task::595::TaskManager.Task::(_updateState) Task=`23038dc0-8428-42b2-9518-967615e64fbb`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:11:43,930::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:11:43,930::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:11:43,930::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:11:43,930::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:11:43,931::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:11:43,931::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:11:43,931::task::990::TaskManager.Task::(_decref) Task=`23038dc0-8428-42b2-9518-967615e64fbb`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:11:45,372::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:11:45,445::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333246 s, 30.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:11:47,457::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:11:47,531::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340892 s, 30.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:11:48,118::task::595::TaskManager.Task::(_updateState) Task=`aafa9956-bc40-4d59-b476-5b9e4d1fc8ef`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:11:48,118::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:11:48,118::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0121683', 'lastCheck': '4.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:11:48,118::task::1185::TaskManager.Task::(prepare) Task=`aafa9956-bc40-4d59-b476-5b9e4d1fc8ef`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0121683', 'lastCheck': '4.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:11:48,118::task::595::TaskManager.Task::(_updateState) Task=`aafa9956-bc40-4d59-b476-5b9e4d1fc8ef`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:11:48,119::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:11:48,119::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:11:48,119::task::990::TaskManager.Task::(_decref) Task=`aafa9956-bc40-4d59-b476-5b9e4d1fc8ef`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:11:49,543::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:11:49,617::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344544 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:11:51,629::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:11:51,717::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335403 s, 30.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:11:53,650::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:11:53,659::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000704791 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:11:53,734::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:11:53,808::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341495 s, 30.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:11:53,988::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:11:53,989::task::595::TaskManager.Task::(_updateState) Task=`30ccac65-298d-42ef-9699-5af599b4b3b9`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:11:53,989::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:11:53,989::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:11:53,990::task::1185::TaskManager.Task::(prepare) Task=`30ccac65-298d-42ef-9699-5af599b4b3b9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:11:53,990::task::595::TaskManager.Task::(_updateState) Task=`30ccac65-298d-42ef-9699-5af599b4b3b9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:11:53,990::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:11:53,990::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:11:53,990::task::990::TaskManager.Task::(_decref) Task=`30ccac65-298d-42ef-9699-5af599b4b3b9`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:11:54,021::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:11:54,021::task::595::TaskManager.Task::(_updateState) Task=`10046a79-0974-43a9-86b5-988fe300f728`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:11:54,021::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:11:54,022::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d4276ebb-14e0-4d64-ba09-de8bba3fd534`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:11:54,022::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:11:54,022::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:11:54,022::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d4276ebb-14e0-4d64-ba09-de8bba3fd534`::Granted request >Thread-34::DEBUG::2014-07-24 11:11:54,023::task::827::TaskManager.Task::(resourceAcquired) Task=`10046a79-0974-43a9-86b5-988fe300f728`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:11:54,023::task::990::TaskManager.Task::(_decref) Task=`10046a79-0974-43a9-86b5-988fe300f728`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:11:54,023::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:11:54,024::task::1185::TaskManager.Task::(prepare) Task=`10046a79-0974-43a9-86b5-988fe300f728`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:11:54,024::task::595::TaskManager.Task::(_updateState) Task=`10046a79-0974-43a9-86b5-988fe300f728`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:11:54,024::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:11:54,024::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:11:54,024::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:11:54,025::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:11:54,025::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:11:54,025::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:11:54,025::task::990::TaskManager.Task::(_decref) Task=`10046a79-0974-43a9-86b5-988fe300f728`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:11:55,820::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:11:55,892::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336271 s, 30.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:11:57,905::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:11:57,978::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328346 s, 31.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:11:58,903::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:11:59,990::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:12:00,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328394 s, 31.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:12:02,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:12:02,148::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355144 s, 28.8 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:12:02,396::task::595::TaskManager.Task::(_updateState) Task=`f83cb90c-d923-4a5d-9655-b618b869d3d6`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:12:02,396::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:12:02,397::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:12:02,397::task::1185::TaskManager.Task::(prepare) Task=`f83cb90c-d923-4a5d-9655-b618b869d3d6`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:12:02,397::task::595::TaskManager.Task::(_updateState) Task=`f83cb90c-d923-4a5d-9655-b618b869d3d6`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:12:02,397::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:12:02,397::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:12:02,398::task::990::TaskManager.Task::(_decref) Task=`f83cb90c-d923-4a5d-9655-b618b869d3d6`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 11:12:03,465::task::595::TaskManager.Task::(_updateState) Task=`e5716ede-d46d-4758-8980-23e3dc3a16f6`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:12:03,465::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:12:03,465::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000704791', 'lastCheck': '9.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:12:03,465::task::1185::TaskManager.Task::(prepare) Task=`e5716ede-d46d-4758-8980-23e3dc3a16f6`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000704791', 'lastCheck': '9.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:12:03,466::task::595::TaskManager.Task::(_updateState) Task=`e5716ede-d46d-4758-8980-23e3dc3a16f6`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:12:03,466::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:12:03,466::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:12:03,466::task::990::TaskManager.Task::(_decref) Task=`e5716ede-d46d-4758-8980-23e3dc3a16f6`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:12:03,664::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:12:03,687::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0148793 s, 275 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:12:04,081::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:12:04,082::task::595::TaskManager.Task::(_updateState) Task=`0ae1aa59-099d-445c-9f81-d98b400fad00`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:12:04,082::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:12:04,082::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:12:04,082::task::1185::TaskManager.Task::(prepare) Task=`0ae1aa59-099d-445c-9f81-d98b400fad00`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:12:04,083::task::595::TaskManager.Task::(_updateState) Task=`0ae1aa59-099d-445c-9f81-d98b400fad00`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:12:04,083::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:12:04,083::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:12:04,083::task::990::TaskManager.Task::(_decref) Task=`0ae1aa59-099d-445c-9f81-d98b400fad00`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:12:04,114::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:12:04,115::task::595::TaskManager.Task::(_updateState) Task=`68a1b08d-dfb6-4ac2-a34b-9093bb20f4c3`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:12:04,115::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:12:04,115::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`dfdae383-d1b3-43a7-8e58-6cac21a0364d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:12:04,116::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:12:04,116::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:12:04,116::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`dfdae383-d1b3-43a7-8e58-6cac21a0364d`::Granted request >Thread-34::DEBUG::2014-07-24 11:12:04,116::task::827::TaskManager.Task::(resourceAcquired) Task=`68a1b08d-dfb6-4ac2-a34b-9093bb20f4c3`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:12:04,116::task::990::TaskManager.Task::(_decref) Task=`68a1b08d-dfb6-4ac2-a34b-9093bb20f4c3`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:12:04,117::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:12:04,117::task::1185::TaskManager.Task::(prepare) Task=`68a1b08d-dfb6-4ac2-a34b-9093bb20f4c3`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:12:04,117::task::595::TaskManager.Task::(_updateState) Task=`68a1b08d-dfb6-4ac2-a34b-9093bb20f4c3`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:12:04,118::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:12:04,118::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:12:04,118::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:12:04,119::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:12:04,120::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:12:04,121::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:12:04,124::task::990::TaskManager.Task::(_decref) Task=`68a1b08d-dfb6-4ac2-a34b-9093bb20f4c3`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:12:04,160::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:12:04,233::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331322 s, 30.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:12:06,246::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:12:06,321::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355497 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:12:08,333::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:12:08,408::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354203 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:12:10,420::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:12:10,495::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355485 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:12:12,507::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:12:12,579::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032847 s, 31.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:12:13,692::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:12:13,712::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0117474 s, 349 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:12:14,183::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:12:14,184::task::595::TaskManager.Task::(_updateState) Task=`e3228606-db98-4e6e-acf9-981e81603d35`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:12:14,184::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:12:14,184::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:12:14,185::task::1185::TaskManager.Task::(prepare) Task=`e3228606-db98-4e6e-acf9-981e81603d35`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:12:14,185::task::595::TaskManager.Task::(_updateState) Task=`e3228606-db98-4e6e-acf9-981e81603d35`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:12:14,185::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:12:14,185::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:12:14,185::task::990::TaskManager.Task::(_decref) Task=`e3228606-db98-4e6e-acf9-981e81603d35`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:12:14,218::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:12:14,219::task::595::TaskManager.Task::(_updateState) Task=`eace0094-6ef2-4a06-a51e-92747b6fa370`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:12:14,219::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:12:14,219::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`6736a2d9-e6bb-4b81-a594-7971a7ef441a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:12:14,219::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:12:14,220::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:12:14,220::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`6736a2d9-e6bb-4b81-a594-7971a7ef441a`::Granted request >Thread-34::DEBUG::2014-07-24 11:12:14,221::task::827::TaskManager.Task::(resourceAcquired) Task=`eace0094-6ef2-4a06-a51e-92747b6fa370`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:12:14,221::task::990::TaskManager.Task::(_decref) Task=`eace0094-6ef2-4a06-a51e-92747b6fa370`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:12:14,222::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:12:14,222::task::1185::TaskManager.Task::(prepare) Task=`eace0094-6ef2-4a06-a51e-92747b6fa370`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:12:14,222::task::595::TaskManager.Task::(_updateState) Task=`eace0094-6ef2-4a06-a51e-92747b6fa370`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:12:14,222::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:12:14,222::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:12:14,223::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:12:14,223::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:12:14,223::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:12:14,223::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:12:14,223::task::990::TaskManager.Task::(_decref) Task=`eace0094-6ef2-4a06-a51e-92747b6fa370`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:12:14,591::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:12:14,664::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332896 s, 30.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:12:16,676::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:12:16,751::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03293 s, 31.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:12:18,764::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:12:18,837::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338973 s, 30.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:12:18,919::task::595::TaskManager.Task::(_updateState) Task=`c176986d-4c53-40b3-809f-2790e40c1e38`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:12:18,920::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:12:18,920::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0117474', 'lastCheck': '5.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:12:18,920::task::1185::TaskManager.Task::(prepare) Task=`c176986d-4c53-40b3-809f-2790e40c1e38`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0117474', 'lastCheck': '5.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:12:18,920::task::595::TaskManager.Task::(_updateState) Task=`c176986d-4c53-40b3-809f-2790e40c1e38`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:12:18,920::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:12:18,921::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:12:18,921::task::990::TaskManager.Task::(_decref) Task=`c176986d-4c53-40b3-809f-2790e40c1e38`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:12:20,849::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:12:20,924::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360763 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:12:22,937::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:12:23,009::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327381 s, 31.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:12:23,717::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:12:23,737::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.011895 s, 344 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:12:24,278::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:12:24,278::task::595::TaskManager.Task::(_updateState) Task=`87b527f2-8c89-48ed-bd78-31439e5200d5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:12:24,278::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:12:24,279::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:12:24,279::task::1185::TaskManager.Task::(prepare) Task=`87b527f2-8c89-48ed-bd78-31439e5200d5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:12:24,279::task::595::TaskManager.Task::(_updateState) Task=`87b527f2-8c89-48ed-bd78-31439e5200d5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:12:24,279::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:12:24,279::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:12:24,280::task::990::TaskManager.Task::(_decref) Task=`87b527f2-8c89-48ed-bd78-31439e5200d5`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:12:24,315::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:12:24,315::task::595::TaskManager.Task::(_updateState) Task=`3c8a3873-530d-48a1-951d-4679e06d9994`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:12:24,316::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:12:24,316::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f3f5c3f3-553e-4765-ac19-955fb0aa365a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:12:24,316::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:12:24,317::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:12:24,317::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f3f5c3f3-553e-4765-ac19-955fb0aa365a`::Granted request >Thread-34::DEBUG::2014-07-24 11:12:24,317::task::827::TaskManager.Task::(resourceAcquired) Task=`3c8a3873-530d-48a1-951d-4679e06d9994`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:12:24,317::task::990::TaskManager.Task::(_decref) Task=`3c8a3873-530d-48a1-951d-4679e06d9994`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:12:24,318::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:12:24,318::task::1185::TaskManager.Task::(prepare) Task=`3c8a3873-530d-48a1-951d-4679e06d9994`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:12:24,318::task::595::TaskManager.Task::(_updateState) Task=`3c8a3873-530d-48a1-951d-4679e06d9994`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:12:24,318::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:12:24,318::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:12:24,319::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:12:24,319::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:12:24,319::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:12:24,319::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:12:24,319::task::990::TaskManager.Task::(_decref) Task=`3c8a3873-530d-48a1-951d-4679e06d9994`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:12:25,021::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:12:25,093::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329428 s, 31.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:12:27,105::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:12:27,179::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351859 s, 29.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:12:28,938::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:12:29,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:12:29,265::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034759 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:12:31,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:12:31,353::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353822 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:12:33,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:12:33,440::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357697 s, 28.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:12:33,742::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:12:33,752::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000732866 s, 5.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:12:34,309::task::595::TaskManager.Task::(_updateState) Task=`a0ebcc43-8dbe-4849-8518-c58c1c019805`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:12:34,309::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:12:34,310::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000732866', 'lastCheck': '0.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:12:34,310::task::1185::TaskManager.Task::(prepare) Task=`a0ebcc43-8dbe-4849-8518-c58c1c019805`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000732866', 'lastCheck': '0.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:12:34,310::task::595::TaskManager.Task::(_updateState) Task=`a0ebcc43-8dbe-4849-8518-c58c1c019805`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:12:34,310::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:12:34,310::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:12:34,310::task::990::TaskManager.Task::(_decref) Task=`a0ebcc43-8dbe-4849-8518-c58c1c019805`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 11:12:34,450::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:12:34,450::task::595::TaskManager.Task::(_updateState) Task=`3661b5cf-ef2b-4343-a32f-39e96c9f6c7b`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:12:34,450::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:12:34,450::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:12:34,450::task::1185::TaskManager.Task::(prepare) Task=`3661b5cf-ef2b-4343-a32f-39e96c9f6c7b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:12:34,451::task::595::TaskManager.Task::(_updateState) Task=`3661b5cf-ef2b-4343-a32f-39e96c9f6c7b`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:12:34,451::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:12:34,451::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:12:34,451::task::990::TaskManager.Task::(_decref) Task=`3661b5cf-ef2b-4343-a32f-39e96c9f6c7b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:12:34,504::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:12:34,504::task::595::TaskManager.Task::(_updateState) Task=`9930a5a2-ad74-4ce7-8bfc-79a253a9b9b0`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:12:34,504::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:12:34,505::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`bfa824e2-8480-4b61-bfd3-02cd2b358052`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:12:34,505::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:12:34,505::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:12:34,505::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`bfa824e2-8480-4b61-bfd3-02cd2b358052`::Granted request >Thread-34::DEBUG::2014-07-24 11:12:34,506::task::827::TaskManager.Task::(resourceAcquired) Task=`9930a5a2-ad74-4ce7-8bfc-79a253a9b9b0`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:12:34,506::task::990::TaskManager.Task::(_decref) Task=`9930a5a2-ad74-4ce7-8bfc-79a253a9b9b0`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:12:34,507::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:12:34,507::task::1185::TaskManager.Task::(prepare) Task=`9930a5a2-ad74-4ce7-8bfc-79a253a9b9b0`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:12:34,507::task::595::TaskManager.Task::(_updateState) Task=`9930a5a2-ad74-4ce7-8bfc-79a253a9b9b0`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:12:34,507::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:12:34,507::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:12:34,507::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:12:34,508::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:12:34,508::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:12:34,508::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:12:34,508::task::990::TaskManager.Task::(_decref) Task=`9930a5a2-ad74-4ce7-8bfc-79a253a9b9b0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:12:35,453::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:12:35,525::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334882 s, 30.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:12:37,538::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:12:37,610::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338575 s, 30.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:12:39,622::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:12:39,694::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0326043 s, 31.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:12:41,706::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:12:41,783::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352203 s, 29.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:12:43,757::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:12:43,766::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000694089 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:12:43,795::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:12:43,869::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350628 s, 29.2 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:12:44,655::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:12:44,656::task::595::TaskManager.Task::(_updateState) Task=`d868fc61-bec8-4656-ae89-926016a56de1`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:12:44,656::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:12:44,657::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:12:44,657::task::1185::TaskManager.Task::(prepare) Task=`d868fc61-bec8-4656-ae89-926016a56de1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:12:44,657::task::595::TaskManager.Task::(_updateState) Task=`d868fc61-bec8-4656-ae89-926016a56de1`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:12:44,657::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:12:44,657::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:12:44,657::task::990::TaskManager.Task::(_decref) Task=`d868fc61-bec8-4656-ae89-926016a56de1`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:12:44,698::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:12:44,698::task::595::TaskManager.Task::(_updateState) Task=`9e577da6-b899-4a8c-890a-6e9c9d53baec`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:12:44,698::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:12:44,698::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`0d5f55a0-b963-4577-b4af-a96171b381f1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:12:44,699::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:12:44,699::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:12:44,699::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`0d5f55a0-b963-4577-b4af-a96171b381f1`::Granted request >Thread-34::DEBUG::2014-07-24 11:12:44,699::task::827::TaskManager.Task::(resourceAcquired) Task=`9e577da6-b899-4a8c-890a-6e9c9d53baec`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:12:44,699::task::990::TaskManager.Task::(_decref) Task=`9e577da6-b899-4a8c-890a-6e9c9d53baec`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:12:44,700::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:12:44,700::task::1185::TaskManager.Task::(prepare) Task=`9e577da6-b899-4a8c-890a-6e9c9d53baec`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:12:44,701::task::595::TaskManager.Task::(_updateState) Task=`9e577da6-b899-4a8c-890a-6e9c9d53baec`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:12:44,701::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:12:44,701::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:12:44,701::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:12:44,701::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:12:44,701::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:12:44,702::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:12:44,702::task::990::TaskManager.Task::(_decref) Task=`9e577da6-b899-4a8c-890a-6e9c9d53baec`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:12:45,901::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:12:45,976::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0326958 s, 31.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:12:47,988::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:12:48,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347275 s, 29.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:12:49,877::task::595::TaskManager.Task::(_updateState) Task=`d0c7f5e1-be46-47c8-b798-fdb584f95bec`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:12:49,877::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:12:49,877::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000694089', 'lastCheck': '6.1', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:12:49,877::task::1185::TaskManager.Task::(prepare) Task=`d0c7f5e1-be46-47c8-b798-fdb584f95bec`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000694089', 'lastCheck': '6.1', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:12:49,877::task::595::TaskManager.Task::(_updateState) Task=`d0c7f5e1-be46-47c8-b798-fdb584f95bec`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:12:49,878::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:12:49,878::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:12:49,878::task::990::TaskManager.Task::(_decref) Task=`d0c7f5e1-be46-47c8-b798-fdb584f95bec`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:12:50,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:12:50,149::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357545 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:12:52,161::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:12:52,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349222 s, 29.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:12:53,772::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:12:53,781::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00068217 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:12:54,247::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:12:54,603::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.315976 s, 3.2 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:12:54,756::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:12:54,757::task::595::TaskManager.Task::(_updateState) Task=`63223ca4-4601-44be-8437-da90cca1e3d3`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:12:54,757::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:12:54,757::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:12:54,758::task::1185::TaskManager.Task::(prepare) Task=`63223ca4-4601-44be-8437-da90cca1e3d3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:12:54,758::task::595::TaskManager.Task::(_updateState) Task=`63223ca4-4601-44be-8437-da90cca1e3d3`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:12:54,758::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:12:54,758::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:12:54,758::task::990::TaskManager.Task::(_decref) Task=`63223ca4-4601-44be-8437-da90cca1e3d3`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:12:54,795::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:12:54,795::task::595::TaskManager.Task::(_updateState) Task=`b3bcb248-a3bd-41d5-94be-4dd33f7710ba`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:12:54,795::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:12:54,796::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`42e27d50-0cf2-48e9-a4b7-f1de16a3defb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:12:54,796::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:12:54,796::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:12:54,796::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`42e27d50-0cf2-48e9-a4b7-f1de16a3defb`::Granted request >Thread-34::DEBUG::2014-07-24 11:12:54,797::task::827::TaskManager.Task::(resourceAcquired) Task=`b3bcb248-a3bd-41d5-94be-4dd33f7710ba`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:12:54,797::task::990::TaskManager.Task::(_decref) Task=`b3bcb248-a3bd-41d5-94be-4dd33f7710ba`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:12:54,798::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:12:54,798::task::1185::TaskManager.Task::(prepare) Task=`b3bcb248-a3bd-41d5-94be-4dd33f7710ba`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:12:54,798::task::595::TaskManager.Task::(_updateState) Task=`b3bcb248-a3bd-41d5-94be-4dd33f7710ba`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:12:54,798::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:12:54,798::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:12:54,798::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:12:54,799::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:12:54,799::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:12:54,799::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:12:54,799::task::990::TaskManager.Task::(_decref) Task=`b3bcb248-a3bd-41d5-94be-4dd33f7710ba`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:12:56,615::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:12:56,687::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328742 s, 31.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:12:58,699::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:12:58,780::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0391606 s, 26.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:12:58,974::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:13:00,792::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:13:00,867::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035227 s, 29.1 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:13:02,561::task::595::TaskManager.Task::(_updateState) Task=`e4699511-cecd-4f5e-bea3-d034c29aa9eb`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:13:02,561::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:13:02,562::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:13:02,562::task::1185::TaskManager.Task::(prepare) Task=`e4699511-cecd-4f5e-bea3-d034c29aa9eb`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:13:02,562::task::595::TaskManager.Task::(_updateState) Task=`e4699511-cecd-4f5e-bea3-d034c29aa9eb`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:13:02,562::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:13:02,562::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:13:02,562::task::990::TaskManager.Task::(_decref) Task=`e4699511-cecd-4f5e-bea3-d034c29aa9eb`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:13:02,879::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:13:02,952::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338255 s, 30.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:13:03,787::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:13:03,813::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0175463 s, 233 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:13:04,861::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:13:04,861::task::595::TaskManager.Task::(_updateState) Task=`43e3680b-b7cb-42b9-82f3-a1cf57041b33`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:13:04,862::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:13:04,862::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:13:04,862::task::1185::TaskManager.Task::(prepare) Task=`43e3680b-b7cb-42b9-82f3-a1cf57041b33`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:13:04,862::task::595::TaskManager.Task::(_updateState) Task=`43e3680b-b7cb-42b9-82f3-a1cf57041b33`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:13:04,862::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:13:04,863::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:13:04,863::task::990::TaskManager.Task::(_decref) Task=`43e3680b-b7cb-42b9-82f3-a1cf57041b33`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:13:04,897::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:13:04,897::task::595::TaskManager.Task::(_updateState) Task=`172de0af-b782-4edc-a078-21673343eef0`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:13:04,897::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:13:04,898::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`6d470dca-8b71-4ba1-9a17-77c5ab65247c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:13:04,898::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:13:04,898::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:13:04,898::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`6d470dca-8b71-4ba1-9a17-77c5ab65247c`::Granted request >Thread-34::DEBUG::2014-07-24 11:13:04,899::task::827::TaskManager.Task::(resourceAcquired) Task=`172de0af-b782-4edc-a078-21673343eef0`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:13:04,899::task::990::TaskManager.Task::(_decref) Task=`172de0af-b782-4edc-a078-21673343eef0`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:13:04,900::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:13:04,900::task::1185::TaskManager.Task::(prepare) Task=`172de0af-b782-4edc-a078-21673343eef0`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:13:04,900::task::595::TaskManager.Task::(_updateState) Task=`172de0af-b782-4edc-a078-21673343eef0`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:13:04,900::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:13:04,900::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:13:04,900::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:13:04,901::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:13:04,901::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:13:04,901::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:13:04,901::task::990::TaskManager.Task::(_decref) Task=`172de0af-b782-4edc-a078-21673343eef0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:13:04,965::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:13:05,039::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337051 s, 30.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:13:05,241::task::595::TaskManager.Task::(_updateState) Task=`215939c0-5924-4915-8f7c-9d28604777db`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:13:05,241::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:13:05,241::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0175463', 'lastCheck': '1.4', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:13:05,241::task::1185::TaskManager.Task::(prepare) Task=`215939c0-5924-4915-8f7c-9d28604777db`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0175463', 'lastCheck': '1.4', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:13:05,241::task::595::TaskManager.Task::(_updateState) Task=`215939c0-5924-4915-8f7c-9d28604777db`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:13:05,242::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:13:05,242::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:13:05,242::task::990::TaskManager.Task::(_decref) Task=`215939c0-5924-4915-8f7c-9d28604777db`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:13:07,051::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:13:07,124::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342777 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:13:09,135::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:13:09,209::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349407 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:13:11,222::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:13:11,294::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339075 s, 30.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:13:13,307::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:13:13,381::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349755 s, 29.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:13:13,818::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:13:13,828::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000825584 s, 5.0 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:13:14,960::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:13:14,960::task::595::TaskManager.Task::(_updateState) Task=`6e8c1be1-c6be-41e0-b54c-42382ed7baa2`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:13:14,961::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:13:14,961::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:13:14,961::task::1185::TaskManager.Task::(prepare) Task=`6e8c1be1-c6be-41e0-b54c-42382ed7baa2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:13:14,961::task::595::TaskManager.Task::(_updateState) Task=`6e8c1be1-c6be-41e0-b54c-42382ed7baa2`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:13:14,961::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:13:14,961::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:13:14,962::task::990::TaskManager.Task::(_decref) Task=`6e8c1be1-c6be-41e0-b54c-42382ed7baa2`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:13:14,996::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:13:14,996::task::595::TaskManager.Task::(_updateState) Task=`7c4feb07-2082-42a8-ae47-5e209094ad49`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:13:14,996::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:13:14,997::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f7741855-953d-47c1-88b1-1550a2ae9744`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:13:14,997::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:13:14,997::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:13:14,997::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f7741855-953d-47c1-88b1-1550a2ae9744`::Granted request >Thread-34::DEBUG::2014-07-24 11:13:14,998::task::827::TaskManager.Task::(resourceAcquired) Task=`7c4feb07-2082-42a8-ae47-5e209094ad49`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:13:14,998::task::990::TaskManager.Task::(_decref) Task=`7c4feb07-2082-42a8-ae47-5e209094ad49`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:13:14,998::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:13:14,999::task::1185::TaskManager.Task::(prepare) Task=`7c4feb07-2082-42a8-ae47-5e209094ad49`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:13:14,999::task::595::TaskManager.Task::(_updateState) Task=`7c4feb07-2082-42a8-ae47-5e209094ad49`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:13:14,999::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:13:14,999::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:13:14,999::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:13:15,000::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:13:15,000::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:13:15,000::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:13:15,000::task::990::TaskManager.Task::(_decref) Task=`7c4feb07-2082-42a8-ae47-5e209094ad49`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:13:15,393::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:13:15,468::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347127 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:13:17,480::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:13:17,553::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337993 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:13:19,565::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:13:19,637::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332649 s, 30.8 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:13:20,665::task::595::TaskManager.Task::(_updateState) Task=`4bdb82cf-070a-4836-ac45-ec24e5cd248e`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:13:20,665::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:13:20,665::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000825584', 'lastCheck': '6.8', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:13:20,666::task::1185::TaskManager.Task::(prepare) Task=`4bdb82cf-070a-4836-ac45-ec24e5cd248e`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000825584', 'lastCheck': '6.8', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:13:20,666::task::595::TaskManager.Task::(_updateState) Task=`4bdb82cf-070a-4836-ac45-ec24e5cd248e`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:13:20,666::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:13:20,666::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:13:20,666::task::990::TaskManager.Task::(_decref) Task=`4bdb82cf-070a-4836-ac45-ec24e5cd248e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:13:21,649::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:13:21,723::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346389 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:13:23,736::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:13:23,810::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034294 s, 29.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:13:23,833::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:13:23,842::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000692553 s, 5.9 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:13:25,063::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:13:25,064::task::595::TaskManager.Task::(_updateState) Task=`564142bd-e168-4d13-9f1a-d2f4abf1e23e`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:13:25,064::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:13:25,064::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:13:25,065::task::1185::TaskManager.Task::(prepare) Task=`564142bd-e168-4d13-9f1a-d2f4abf1e23e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:13:25,065::task::595::TaskManager.Task::(_updateState) Task=`564142bd-e168-4d13-9f1a-d2f4abf1e23e`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:13:25,065::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:13:25,065::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:13:25,065::task::990::TaskManager.Task::(_decref) Task=`564142bd-e168-4d13-9f1a-d2f4abf1e23e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:13:25,099::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:13:25,099::task::595::TaskManager.Task::(_updateState) Task=`32be5ca3-6655-4a47-8492-9fea89d6b7ee`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:13:25,100::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:13:25,101::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`edc4acca-6bfd-40d3-8813-7dcdcf911315`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:13:25,101::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:13:25,101::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:13:25,101::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`edc4acca-6bfd-40d3-8813-7dcdcf911315`::Granted request >Thread-34::DEBUG::2014-07-24 11:13:25,102::task::827::TaskManager.Task::(resourceAcquired) Task=`32be5ca3-6655-4a47-8492-9fea89d6b7ee`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:13:25,102::task::990::TaskManager.Task::(_decref) Task=`32be5ca3-6655-4a47-8492-9fea89d6b7ee`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:13:25,103::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:13:25,103::task::1185::TaskManager.Task::(prepare) Task=`32be5ca3-6655-4a47-8492-9fea89d6b7ee`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:13:25,103::task::595::TaskManager.Task::(_updateState) Task=`32be5ca3-6655-4a47-8492-9fea89d6b7ee`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:13:25,103::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:13:25,103::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:13:25,104::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:13:25,104::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:13:25,104::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:13:25,104::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:13:25,104::task::990::TaskManager.Task::(_decref) Task=`32be5ca3-6655-4a47-8492-9fea89d6b7ee`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:13:25,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:13:25,896::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341354 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:13:27,908::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:13:27,981::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340454 s, 30.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:13:29,008::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:13:29,994::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:13:30,087::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0539012 s, 19.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:13:32,099::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:13:32,173::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354272 s, 28.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:13:33,847::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:13:33,857::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000861525 s, 4.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:13:34,186::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:13:34,259::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337961 s, 30.3 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:13:35,162::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:13:35,162::task::595::TaskManager.Task::(_updateState) Task=`99224c08-8ea5-4789-be54-c9e75fb6b7de`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:13:35,162::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:13:35,163::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:13:35,163::task::1185::TaskManager.Task::(prepare) Task=`99224c08-8ea5-4789-be54-c9e75fb6b7de`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:13:35,163::task::595::TaskManager.Task::(_updateState) Task=`99224c08-8ea5-4789-be54-c9e75fb6b7de`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:13:35,163::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:13:35,163::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:13:35,164::task::990::TaskManager.Task::(_decref) Task=`99224c08-8ea5-4789-be54-c9e75fb6b7de`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:13:35,195::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:13:35,195::task::595::TaskManager.Task::(_updateState) Task=`68e27df5-25dc-4049-a5c4-85df1bfa9fba`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:13:35,195::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:13:35,195::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`61ec06b4-125d-4474-991c-151d140580d4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:13:35,196::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:13:35,196::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:13:35,196::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`61ec06b4-125d-4474-991c-151d140580d4`::Granted request >Thread-34::DEBUG::2014-07-24 11:13:35,196::task::827::TaskManager.Task::(resourceAcquired) Task=`68e27df5-25dc-4049-a5c4-85df1bfa9fba`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:13:35,197::task::990::TaskManager.Task::(_decref) Task=`68e27df5-25dc-4049-a5c4-85df1bfa9fba`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:13:35,197::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:13:35,198::task::1185::TaskManager.Task::(prepare) Task=`68e27df5-25dc-4049-a5c4-85df1bfa9fba`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:13:35,198::task::595::TaskManager.Task::(_updateState) Task=`68e27df5-25dc-4049-a5c4-85df1bfa9fba`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:13:35,198::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:13:35,198::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:13:35,198::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:13:35,199::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:13:35,199::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:13:35,199::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:13:35,199::task::990::TaskManager.Task::(_decref) Task=`68e27df5-25dc-4049-a5c4-85df1bfa9fba`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 11:13:36,057::task::595::TaskManager.Task::(_updateState) Task=`f2557dbe-9058-4c02-a8ca-48d3bf51c7b7`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:13:36,058::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:13:36,060::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000861525', 'lastCheck': '2.2', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:13:36,061::task::1185::TaskManager.Task::(prepare) Task=`f2557dbe-9058-4c02-a8ca-48d3bf51c7b7`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000861525', 'lastCheck': '2.2', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:13:36,062::task::595::TaskManager.Task::(_updateState) Task=`f2557dbe-9058-4c02-a8ca-48d3bf51c7b7`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:13:36,063::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:13:36,063::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:13:36,064::task::990::TaskManager.Task::(_decref) Task=`f2557dbe-9058-4c02-a8ca-48d3bf51c7b7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:13:36,271::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:13:36,345::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341525 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:13:38,357::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:13:38,432::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355472 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:13:40,445::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:13:40,519::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035154 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:13:42,531::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:13:42,613::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0378604 s, 27.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:13:43,861::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:13:43,881::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0109655 s, 374 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:13:44,626::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:13:44,701::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333101 s, 30.7 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:13:45,254::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:13:45,255::task::595::TaskManager.Task::(_updateState) Task=`c5c0ae9b-40a8-421f-b956-cc3c1f769d49`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:13:45,255::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:13:45,255::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:13:45,255::task::1185::TaskManager.Task::(prepare) Task=`c5c0ae9b-40a8-421f-b956-cc3c1f769d49`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:13:45,256::task::595::TaskManager.Task::(_updateState) Task=`c5c0ae9b-40a8-421f-b956-cc3c1f769d49`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:13:45,256::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:13:45,256::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:13:45,256::task::990::TaskManager.Task::(_decref) Task=`c5c0ae9b-40a8-421f-b956-cc3c1f769d49`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:13:45,293::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:13:45,294::task::595::TaskManager.Task::(_updateState) Task=`e73f5c2f-044b-4b01-aba6-921c57b793dc`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:13:45,294::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:13:45,294::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`abd73e1b-66b5-4eaf-856d-f476eaa1ca2f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:13:45,294::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:13:45,295::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:13:45,295::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`abd73e1b-66b5-4eaf-856d-f476eaa1ca2f`::Granted request >Thread-34::DEBUG::2014-07-24 11:13:45,295::task::827::TaskManager.Task::(resourceAcquired) Task=`e73f5c2f-044b-4b01-aba6-921c57b793dc`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:13:45,295::task::990::TaskManager.Task::(_decref) Task=`e73f5c2f-044b-4b01-aba6-921c57b793dc`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:13:45,296::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:13:45,296::task::1185::TaskManager.Task::(prepare) Task=`e73f5c2f-044b-4b01-aba6-921c57b793dc`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:13:45,297::task::595::TaskManager.Task::(_updateState) Task=`e73f5c2f-044b-4b01-aba6-921c57b793dc`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:13:45,297::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:13:45,297::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:13:45,297::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:13:45,297::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:13:45,298::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:13:45,298::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:13:45,298::task::990::TaskManager.Task::(_decref) Task=`e73f5c2f-044b-4b01-aba6-921c57b793dc`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:13:46,713::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:13:46,790::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352434 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:13:48,802::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:13:48,877::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356443 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:13:50,890::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:13:50,964::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352599 s, 29.0 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:13:51,435::task::595::TaskManager.Task::(_updateState) Task=`6fa1f28f-11b1-4f23-84f8-276bb0d515f7`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:13:51,435::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:13:51,435::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0109655', 'lastCheck': '7.6', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:13:51,435::task::1185::TaskManager.Task::(prepare) Task=`6fa1f28f-11b1-4f23-84f8-276bb0d515f7`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0109655', 'lastCheck': '7.6', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:13:51,436::task::595::TaskManager.Task::(_updateState) Task=`6fa1f28f-11b1-4f23-84f8-276bb0d515f7`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:13:51,436::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:13:51,436::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:13:51,436::task::990::TaskManager.Task::(_decref) Task=`6fa1f28f-11b1-4f23-84f8-276bb0d515f7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:13:52,976::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:13:53,050::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341167 s, 30.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:13:53,886::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:13:53,895::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000732437 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:13:55,063::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:13:55,136::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334861 s, 30.6 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:13:55,354::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:13:55,355::task::595::TaskManager.Task::(_updateState) Task=`bd3eefa3-57ce-4240-897a-78d642febc14`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:13:55,355::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:13:55,355::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:13:55,355::task::1185::TaskManager.Task::(prepare) Task=`bd3eefa3-57ce-4240-897a-78d642febc14`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:13:55,356::task::595::TaskManager.Task::(_updateState) Task=`bd3eefa3-57ce-4240-897a-78d642febc14`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:13:55,356::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:13:55,356::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:13:55,356::task::990::TaskManager.Task::(_decref) Task=`bd3eefa3-57ce-4240-897a-78d642febc14`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:13:55,388::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:13:55,388::task::595::TaskManager.Task::(_updateState) Task=`deeeecbf-0fad-4e98-8142-05b5e3b8762f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:13:55,388::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:13:55,389::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`fc2abce5-fef6-4598-b35d-fc098017861f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:13:55,389::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:13:55,389::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:13:55,389::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`fc2abce5-fef6-4598-b35d-fc098017861f`::Granted request >Thread-34::DEBUG::2014-07-24 11:13:55,390::task::827::TaskManager.Task::(resourceAcquired) Task=`deeeecbf-0fad-4e98-8142-05b5e3b8762f`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:13:55,390::task::990::TaskManager.Task::(_decref) Task=`deeeecbf-0fad-4e98-8142-05b5e3b8762f`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:13:55,391::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:13:55,391::task::1185::TaskManager.Task::(prepare) Task=`deeeecbf-0fad-4e98-8142-05b5e3b8762f`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:13:55,391::task::595::TaskManager.Task::(_updateState) Task=`deeeecbf-0fad-4e98-8142-05b5e3b8762f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:13:55,391::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:13:55,391::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:13:55,392::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:13:55,392::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:13:55,392::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:13:55,392::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:13:55,392::task::990::TaskManager.Task::(_decref) Task=`deeeecbf-0fad-4e98-8142-05b5e3b8762f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:13:57,148::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:13:57,223::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356085 s, 28.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:13:59,043::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:13:59,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:13:59,308::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335105 s, 30.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:14:01,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:14:01,394::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345955 s, 29.6 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:14:02,733::task::595::TaskManager.Task::(_updateState) Task=`61f024b3-a7b3-4239-a958-79d0daebcf67`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:14:02,733::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:14:02,734::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:14:02,734::task::1185::TaskManager.Task::(prepare) Task=`61f024b3-a7b3-4239-a958-79d0daebcf67`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:14:02,734::task::595::TaskManager.Task::(_updateState) Task=`61f024b3-a7b3-4239-a958-79d0daebcf67`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:14:02,734::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:14:02,734::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:14:02,734::task::990::TaskManager.Task::(_decref) Task=`61f024b3-a7b3-4239-a958-79d0daebcf67`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:14:03,406::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:14:03,480::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341892 s, 30.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:14:03,900::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:14:03,923::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0145609 s, 281 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:14:05,448::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:14:05,448::task::595::TaskManager.Task::(_updateState) Task=`326783d7-5116-421b-87ab-1b43d1e25b03`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:14:05,448::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:14:05,449::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:14:05,449::task::1185::TaskManager.Task::(prepare) Task=`326783d7-5116-421b-87ab-1b43d1e25b03`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:14:05,449::task::595::TaskManager.Task::(_updateState) Task=`326783d7-5116-421b-87ab-1b43d1e25b03`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:14:05,449::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:14:05,449::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:14:05,449::task::990::TaskManager.Task::(_decref) Task=`326783d7-5116-421b-87ab-1b43d1e25b03`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:14:05,481::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:14:05,481::task::595::TaskManager.Task::(_updateState) Task=`68b58e94-35a5-4f81-8b35-e8257435e486`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:14:05,482::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:14:05,482::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`96c3f44e-6332-4a8a-bee6-d270ad3a3da6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:14:05,482::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:14:05,482::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:14:05,483::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`96c3f44e-6332-4a8a-bee6-d270ad3a3da6`::Granted request >Thread-34::DEBUG::2014-07-24 11:14:05,483::task::827::TaskManager.Task::(resourceAcquired) Task=`68b58e94-35a5-4f81-8b35-e8257435e486`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:14:05,483::task::990::TaskManager.Task::(_decref) Task=`68b58e94-35a5-4f81-8b35-e8257435e486`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:14:05,484::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:14:05,484::task::1185::TaskManager.Task::(prepare) Task=`68b58e94-35a5-4f81-8b35-e8257435e486`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:14:05,484::task::595::TaskManager.Task::(_updateState) Task=`68b58e94-35a5-4f81-8b35-e8257435e486`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:14:05,484::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:14:05,485::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:14:05,485::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:14:05,485::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:14:05,485::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:14:05,485::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:14:05,486::task::990::TaskManager.Task::(_decref) Task=`68b58e94-35a5-4f81-8b35-e8257435e486`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:14:05,492::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:14:05,565::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338574 s, 30.2 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:14:06,787::task::595::TaskManager.Task::(_updateState) Task=`92a5cab1-7908-4b21-a7e0-015375da7651`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:14:06,788::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:14:06,788::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0145609', 'lastCheck': '2.9', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:14:06,788::task::1185::TaskManager.Task::(prepare) Task=`92a5cab1-7908-4b21-a7e0-015375da7651`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0145609', 'lastCheck': '2.9', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:14:06,788::task::595::TaskManager.Task::(_updateState) Task=`92a5cab1-7908-4b21-a7e0-015375da7651`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:14:06,788::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:14:06,789::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:14:06,789::task::990::TaskManager.Task::(_decref) Task=`92a5cab1-7908-4b21-a7e0-015375da7651`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:14:07,578::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:14:07,966::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.349459 s, 2.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:14:09,979::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:14:10,056::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0381015 s, 26.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:14:12,069::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:14:12,141::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332512 s, 30.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:14:13,928::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:14:13,949::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.011135 s, 368 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:14:14,154::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:14:14,250::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0570903 s, 17.9 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:14:15,553::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:14:15,554::task::595::TaskManager.Task::(_updateState) Task=`64610794-7831-4029-8125-3f03337b63df`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:14:15,554::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:14:15,554::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:14:15,554::task::1185::TaskManager.Task::(prepare) Task=`64610794-7831-4029-8125-3f03337b63df`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:14:15,554::task::595::TaskManager.Task::(_updateState) Task=`64610794-7831-4029-8125-3f03337b63df`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:14:15,555::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:14:15,555::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:14:15,555::task::990::TaskManager.Task::(_decref) Task=`64610794-7831-4029-8125-3f03337b63df`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:14:15,624::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:14:15,624::task::595::TaskManager.Task::(_updateState) Task=`8fe7b802-a1f2-425d-a0b0-b38561f6792e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:14:15,624::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:14:15,625::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e1de6ec4-41f3-4ddd-9a0b-881c6ee4522b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:14:15,625::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:14:15,625::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:14:15,625::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e1de6ec4-41f3-4ddd-9a0b-881c6ee4522b`::Granted request >Thread-34::DEBUG::2014-07-24 11:14:15,626::task::827::TaskManager.Task::(resourceAcquired) Task=`8fe7b802-a1f2-425d-a0b0-b38561f6792e`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:14:15,626::task::990::TaskManager.Task::(_decref) Task=`8fe7b802-a1f2-425d-a0b0-b38561f6792e`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:14:15,627::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:14:15,627::task::1185::TaskManager.Task::(prepare) Task=`8fe7b802-a1f2-425d-a0b0-b38561f6792e`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:14:15,627::task::595::TaskManager.Task::(_updateState) Task=`8fe7b802-a1f2-425d-a0b0-b38561f6792e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:14:15,627::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:14:15,627::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:14:15,627::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:14:15,628::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:14:15,628::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:14:15,628::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:14:15,628::task::990::TaskManager.Task::(_decref) Task=`8fe7b802-a1f2-425d-a0b0-b38561f6792e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:14:16,262::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:14:16,337::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354194 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:14:18,349::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:14:18,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346513 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:14:20,436::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:14:20,509::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343446 s, 29.8 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:14:22,149::task::595::TaskManager.Task::(_updateState) Task=`457ed81e-974e-4954-ba32-6774c1093c91`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:14:22,150::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:14:22,150::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.011135', 'lastCheck': '8.2', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:14:22,150::task::1185::TaskManager.Task::(prepare) Task=`457ed81e-974e-4954-ba32-6774c1093c91`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.011135', 'lastCheck': '8.2', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:14:22,150::task::595::TaskManager.Task::(_updateState) Task=`457ed81e-974e-4954-ba32-6774c1093c91`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:14:22,150::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:14:22,150::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:14:22,151::task::990::TaskManager.Task::(_decref) Task=`457ed81e-974e-4954-ba32-6774c1093c91`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:14:22,521::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:14:22,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344755 s, 29.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:14:23,954::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:14:23,963::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000722598 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:14:24,607::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:14:24,681::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344293 s, 29.7 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:14:25,684::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:14:25,684::task::595::TaskManager.Task::(_updateState) Task=`ea93c666-59fc-47d9-b924-1b8c9cb6e22e`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:14:25,685::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:14:25,685::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:14:25,685::task::1185::TaskManager.Task::(prepare) Task=`ea93c666-59fc-47d9-b924-1b8c9cb6e22e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:14:25,685::task::595::TaskManager.Task::(_updateState) Task=`ea93c666-59fc-47d9-b924-1b8c9cb6e22e`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:14:25,685::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:14:25,686::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:14:25,686::task::990::TaskManager.Task::(_decref) Task=`ea93c666-59fc-47d9-b924-1b8c9cb6e22e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:14:25,718::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:14:25,718::task::595::TaskManager.Task::(_updateState) Task=`7ec9f43d-9bab-4f5f-8b99-522703081164`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:14:25,718::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:14:25,719::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`36f2c1d6-907d-449d-88d4-35a53e7a0948`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:14:25,719::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:14:25,719::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:14:25,719::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`36f2c1d6-907d-449d-88d4-35a53e7a0948`::Granted request >Thread-34::DEBUG::2014-07-24 11:14:25,720::task::827::TaskManager.Task::(resourceAcquired) Task=`7ec9f43d-9bab-4f5f-8b99-522703081164`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:14:25,720::task::990::TaskManager.Task::(_decref) Task=`7ec9f43d-9bab-4f5f-8b99-522703081164`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:14:25,721::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:14:25,721::task::1185::TaskManager.Task::(prepare) Task=`7ec9f43d-9bab-4f5f-8b99-522703081164`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:14:25,721::task::595::TaskManager.Task::(_updateState) Task=`7ec9f43d-9bab-4f5f-8b99-522703081164`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:14:25,721::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:14:25,721::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:14:25,721::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:14:25,722::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:14:25,722::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:14:25,722::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:14:25,722::task::990::TaskManager.Task::(_decref) Task=`7ec9f43d-9bab-4f5f-8b99-522703081164`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:14:26,693::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:14:26,765::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0326512 s, 31.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:14:28,777::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:14:28,850::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345722 s, 29.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:14:29,080::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:14:30,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:14:30,936::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341007 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:14:32,949::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:14:33,022::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342185 s, 29.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:14:33,967::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:14:33,977::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000682295 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:14:35,034::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:14:35,108::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345307 s, 29.7 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:14:35,776::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [22918c4c] >Thread-13::DEBUG::2014-07-24 11:14:35,776::task::595::TaskManager.Task::(_updateState) Task=`fc2603fa-b367-4532-b415-10887df06b3d`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:14:35,777::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:14:35,777::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:14:35,777::task::1185::TaskManager.Task::(prepare) Task=`fc2603fa-b367-4532-b415-10887df06b3d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:14:35,777::task::595::TaskManager.Task::(_updateState) Task=`fc2603fa-b367-4532-b415-10887df06b3d`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:14:35,778::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:14:35,778::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:14:35,778::task::990::TaskManager.Task::(_decref) Task=`fc2603fa-b367-4532-b415-10887df06b3d`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:14:35,815::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [22918c4c] >Thread-34::DEBUG::2014-07-24 11:14:35,815::task::595::TaskManager.Task::(_updateState) Task=`e74b521d-9ffe-4fa8-a0a1-9fcfc38127ab`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:14:35,815::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:14:35,815::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d956459a-c786-4b32-ae42-542f64e0c9d6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:14:35,816::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:14:35,816::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:14:35,816::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d956459a-c786-4b32-ae42-542f64e0c9d6`::Granted request >Thread-34::DEBUG::2014-07-24 11:14:35,817::task::827::TaskManager.Task::(resourceAcquired) Task=`e74b521d-9ffe-4fa8-a0a1-9fcfc38127ab`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:14:35,818::task::990::TaskManager.Task::(_decref) Task=`e74b521d-9ffe-4fa8-a0a1-9fcfc38127ab`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:14:35,818::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:14:35,818::task::1185::TaskManager.Task::(prepare) Task=`e74b521d-9ffe-4fa8-a0a1-9fcfc38127ab`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:14:35,819::task::595::TaskManager.Task::(_updateState) Task=`e74b521d-9ffe-4fa8-a0a1-9fcfc38127ab`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:14:35,819::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:14:35,819::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:14:35,819::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:14:35,819::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:14:35,820::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:14:35,820::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:14:35,820::task::990::TaskManager.Task::(_decref) Task=`e74b521d-9ffe-4fa8-a0a1-9fcfc38127ab`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:14:37,121::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:14:37,193::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339536 s, 30.2 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:14:37,523::task::595::TaskManager.Task::(_updateState) Task=`8d927895-dd58-4a0f-98bc-50516c1cc880`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:14:37,524::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:14:37,525::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000682295', 'lastCheck': '3.5', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:14:37,525::task::1185::TaskManager.Task::(prepare) Task=`8d927895-dd58-4a0f-98bc-50516c1cc880`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000682295', 'lastCheck': '3.5', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:14:37,526::task::595::TaskManager.Task::(_updateState) Task=`8d927895-dd58-4a0f-98bc-50516c1cc880`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:14:37,526::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:14:37,526::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:14:37,526::task::990::TaskManager.Task::(_decref) Task=`8d927895-dd58-4a0f-98bc-50516c1cc880`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:14:39,206::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:14:39,279::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335523 s, 30.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:14:41,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:14:41,362::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331516 s, 30.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:14:43,374::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:14:43,449::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358258 s, 28.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:14:43,982::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:14:43,999::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0083042 s, 493 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:14:45,461::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:14:45,536::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355821 s, 28.8 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:14:45,877::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [4376fa5] >Thread-13::DEBUG::2014-07-24 11:14:45,877::task::595::TaskManager.Task::(_updateState) Task=`30308488-b102-4af0-be31-d8301be6e706`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:14:45,878::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:14:45,878::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:14:45,878::task::1185::TaskManager.Task::(prepare) Task=`30308488-b102-4af0-be31-d8301be6e706`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:14:45,879::task::595::TaskManager.Task::(_updateState) Task=`30308488-b102-4af0-be31-d8301be6e706`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:14:45,879::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:14:45,879::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:14:45,879::task::990::TaskManager.Task::(_decref) Task=`30308488-b102-4af0-be31-d8301be6e706`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:14:45,911::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [4376fa5] >Thread-34::DEBUG::2014-07-24 11:14:45,911::task::595::TaskManager.Task::(_updateState) Task=`21ceec17-6922-4497-8398-f4057ecc3698`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:14:45,912::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:14:45,912::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`99cba81e-5e0c-400a-b3e7-9ede327cf5b0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:14:45,912::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:14:45,913::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:14:45,913::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`99cba81e-5e0c-400a-b3e7-9ede327cf5b0`::Granted request >Thread-34::DEBUG::2014-07-24 11:14:45,913::task::827::TaskManager.Task::(resourceAcquired) Task=`21ceec17-6922-4497-8398-f4057ecc3698`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:14:45,914::task::990::TaskManager.Task::(_decref) Task=`21ceec17-6922-4497-8398-f4057ecc3698`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:14:45,914::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:14:45,915::task::1185::TaskManager.Task::(prepare) Task=`21ceec17-6922-4497-8398-f4057ecc3698`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:14:45,915::task::595::TaskManager.Task::(_updateState) Task=`21ceec17-6922-4497-8398-f4057ecc3698`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:14:45,915::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:14:45,915::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:14:45,915::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:14:45,915::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:14:45,916::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:14:45,916::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:14:45,916::task::990::TaskManager.Task::(_decref) Task=`21ceec17-6922-4497-8398-f4057ecc3698`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:14:47,548::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:14:47,621::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339977 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:14:49,634::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:14:49,708::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355166 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:14:51,720::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:14:51,791::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0326308 s, 31.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:14:52,890::task::595::TaskManager.Task::(_updateState) Task=`cc65a130-cfd3-4545-bd44-f59b367ca60e`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:14:52,891::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:14:52,891::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0083042', 'lastCheck': '8.9', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:14:52,891::task::1185::TaskManager.Task::(prepare) Task=`cc65a130-cfd3-4545-bd44-f59b367ca60e`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0083042', 'lastCheck': '8.9', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:14:52,891::task::595::TaskManager.Task::(_updateState) Task=`cc65a130-cfd3-4545-bd44-f59b367ca60e`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:14:52,891::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:14:52,892::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:14:52,892::task::990::TaskManager.Task::(_decref) Task=`cc65a130-cfd3-4545-bd44-f59b367ca60e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:14:53,804::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:14:53,877::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344115 s, 29.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:14:54,004::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:14:54,024::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0116327 s, 352 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:14:55,889::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:14:55,963::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338837 s, 30.2 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:14:55,974::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [3b38bf98] >Thread-13::DEBUG::2014-07-24 11:14:55,975::task::595::TaskManager.Task::(_updateState) Task=`b9de77ab-f924-46f0-9766-705bba2839fc`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:14:55,976::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:14:55,977::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:14:55,977::task::1185::TaskManager.Task::(prepare) Task=`b9de77ab-f924-46f0-9766-705bba2839fc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:14:55,977::task::595::TaskManager.Task::(_updateState) Task=`b9de77ab-f924-46f0-9766-705bba2839fc`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:14:55,977::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:14:55,977::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:14:55,978::task::990::TaskManager.Task::(_decref) Task=`b9de77ab-f924-46f0-9766-705bba2839fc`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:14:56,012::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [3b38bf98] >Thread-34::DEBUG::2014-07-24 11:14:56,013::task::595::TaskManager.Task::(_updateState) Task=`440986d1-7033-4cb7-9ebc-74b5bed336b6`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:14:56,013::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:14:56,013::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`14cfcb15-6e6b-42bd-b8c4-11f3872fa081`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:14:56,014::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:14:56,014::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:14:56,014::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`14cfcb15-6e6b-42bd-b8c4-11f3872fa081`::Granted request >Thread-34::DEBUG::2014-07-24 11:14:56,014::task::827::TaskManager.Task::(resourceAcquired) Task=`440986d1-7033-4cb7-9ebc-74b5bed336b6`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:14:56,014::task::990::TaskManager.Task::(_decref) Task=`440986d1-7033-4cb7-9ebc-74b5bed336b6`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:14:56,015::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:14:56,015::task::1185::TaskManager.Task::(prepare) Task=`440986d1-7033-4cb7-9ebc-74b5bed336b6`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:14:56,016::task::595::TaskManager.Task::(_updateState) Task=`440986d1-7033-4cb7-9ebc-74b5bed336b6`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:14:56,016::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:14:56,016::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:14:56,016::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:14:56,016::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:14:56,016::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:14:56,017::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:14:56,017::task::990::TaskManager.Task::(_decref) Task=`440986d1-7033-4cb7-9ebc-74b5bed336b6`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:14:57,979::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:14:58,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342456 s, 29.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:14:59,116::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:15:00,064::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:15:00,138::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345375 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:15:02,150::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:15:02,223::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339852 s, 30.1 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:15:02,906::task::595::TaskManager.Task::(_updateState) Task=`f4c467ba-c6fd-4d74-9905-133e02f7427b`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:15:02,907::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:15:02,907::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:15:02,907::task::1185::TaskManager.Task::(prepare) Task=`f4c467ba-c6fd-4d74-9905-133e02f7427b`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:15:02,907::task::595::TaskManager.Task::(_updateState) Task=`f4c467ba-c6fd-4d74-9905-133e02f7427b`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:15:02,908::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:15:02,908::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:15:02,908::task::990::TaskManager.Task::(_decref) Task=`f4c467ba-c6fd-4d74-9905-133e02f7427b`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:15:04,029::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:15:04,038::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000669529 s, 6.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:15:04,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:15:04,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379255 s, 27.0 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:15:06,072::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:15:06,072::task::595::TaskManager.Task::(_updateState) Task=`33f5c861-0c57-4d80-8d96-1d14935dc23f`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:15:06,073::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:15:06,073::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:15:06,073::task::1185::TaskManager.Task::(prepare) Task=`33f5c861-0c57-4d80-8d96-1d14935dc23f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:15:06,073::task::595::TaskManager.Task::(_updateState) Task=`33f5c861-0c57-4d80-8d96-1d14935dc23f`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:15:06,073::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:15:06,073::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:15:06,074::task::990::TaskManager.Task::(_decref) Task=`33f5c861-0c57-4d80-8d96-1d14935dc23f`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:15:06,104::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:15:06,104::task::595::TaskManager.Task::(_updateState) Task=`ba6a0f9f-2936-464d-b851-428b99281103`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:15:06,104::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:15:06,105::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f2da3740-bc96-43c9-9092-f0b312d7c89a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:15:06,105::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:15:06,105::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:15:06,105::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f2da3740-bc96-43c9-9092-f0b312d7c89a`::Granted request >Thread-34::DEBUG::2014-07-24 11:15:06,106::task::827::TaskManager.Task::(resourceAcquired) Task=`ba6a0f9f-2936-464d-b851-428b99281103`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:15:06,106::task::990::TaskManager.Task::(_decref) Task=`ba6a0f9f-2936-464d-b851-428b99281103`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:15:06,106::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:15:06,107::task::1185::TaskManager.Task::(prepare) Task=`ba6a0f9f-2936-464d-b851-428b99281103`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:15:06,107::task::595::TaskManager.Task::(_updateState) Task=`ba6a0f9f-2936-464d-b851-428b99281103`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:15:06,107::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:15:06,107::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:15:06,107::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:15:06,108::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:15:06,108::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:15:06,108::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:15:06,108::task::990::TaskManager.Task::(_decref) Task=`ba6a0f9f-2936-464d-b851-428b99281103`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:15:06,325::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:15:06,421::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0570456 s, 18.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:15:08,434::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:15:08,507::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348319 s, 29.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:15:08,522::task::595::TaskManager.Task::(_updateState) Task=`19711d2f-205e-4e31-9a04-667e24b2d680`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:15:08,522::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:15:08,522::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000669529', 'lastCheck': '4.5', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:15:08,522::task::1185::TaskManager.Task::(prepare) Task=`19711d2f-205e-4e31-9a04-667e24b2d680`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000669529', 'lastCheck': '4.5', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:15:08,523::task::595::TaskManager.Task::(_updateState) Task=`19711d2f-205e-4e31-9a04-667e24b2d680`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:15:08,523::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:15:08,523::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:15:08,523::task::990::TaskManager.Task::(_decref) Task=`19711d2f-205e-4e31-9a04-667e24b2d680`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:15:10,519::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:15:10,592::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340457 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:15:12,604::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:15:12,677::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342178 s, 29.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:15:14,043::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:15:14,067::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0151212 s, 271 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:15:14,691::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:15:14,879::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.146567 s, 7.0 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:15:16,164::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:15:16,165::task::595::TaskManager.Task::(_updateState) Task=`d699fe77-7510-48d3-9937-dfeb43059248`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:15:16,165::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:15:16,165::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:15:16,165::task::1185::TaskManager.Task::(prepare) Task=`d699fe77-7510-48d3-9937-dfeb43059248`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:15:16,166::task::595::TaskManager.Task::(_updateState) Task=`d699fe77-7510-48d3-9937-dfeb43059248`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:15:16,166::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:15:16,166::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:15:16,166::task::990::TaskManager.Task::(_decref) Task=`d699fe77-7510-48d3-9937-dfeb43059248`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:15:16,199::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:15:16,199::task::595::TaskManager.Task::(_updateState) Task=`08618dca-2778-41c7-95a0-82ae06e8ebda`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:15:16,199::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:15:16,200::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f5367dbb-6b45-474c-bb0a-0a6c8df3aa4a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:15:16,200::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:15:16,200::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:15:16,200::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f5367dbb-6b45-474c-bb0a-0a6c8df3aa4a`::Granted request >Thread-34::DEBUG::2014-07-24 11:15:16,201::task::827::TaskManager.Task::(resourceAcquired) Task=`08618dca-2778-41c7-95a0-82ae06e8ebda`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:15:16,201::task::990::TaskManager.Task::(_decref) Task=`08618dca-2778-41c7-95a0-82ae06e8ebda`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:15:16,202::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:15:16,202::task::1185::TaskManager.Task::(prepare) Task=`08618dca-2778-41c7-95a0-82ae06e8ebda`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:15:16,202::task::595::TaskManager.Task::(_updateState) Task=`08618dca-2778-41c7-95a0-82ae06e8ebda`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:15:16,202::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:15:16,202::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:15:16,203::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:15:16,203::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:15:16,203::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:15:16,203::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:15:16,203::task::990::TaskManager.Task::(_decref) Task=`08618dca-2778-41c7-95a0-82ae06e8ebda`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:15:16,891::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:15:16,967::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353187 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:15:18,979::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:15:19,051::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330927 s, 30.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:15:21,063::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:15:21,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355789 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:15:23,150::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:15:23,225::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352874 s, 29.0 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:15:23,957::task::595::TaskManager.Task::(_updateState) Task=`3ecaff17-0fb2-4dde-8630-6537efc5bd1f`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:15:23,958::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:15:23,958::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0151212', 'lastCheck': '9.9', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:15:23,958::task::1185::TaskManager.Task::(prepare) Task=`3ecaff17-0fb2-4dde-8630-6537efc5bd1f`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0151212', 'lastCheck': '9.9', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:15:23,958::task::595::TaskManager.Task::(_updateState) Task=`3ecaff17-0fb2-4dde-8630-6537efc5bd1f`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:15:23,958::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:15:23,958::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:15:23,959::task::990::TaskManager.Task::(_decref) Task=`3ecaff17-0fb2-4dde-8630-6537efc5bd1f`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:15:24,071::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:15:24,092::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0122095 s, 335 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:15:25,238::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:15:25,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357942 s, 28.6 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:15:26,267::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:15:26,267::task::595::TaskManager.Task::(_updateState) Task=`0bad9e92-c56a-427a-bb1b-6edb719ab1c2`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:15:26,267::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:15:26,268::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:15:26,268::task::1185::TaskManager.Task::(prepare) Task=`0bad9e92-c56a-427a-bb1b-6edb719ab1c2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:15:26,268::task::595::TaskManager.Task::(_updateState) Task=`0bad9e92-c56a-427a-bb1b-6edb719ab1c2`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:15:26,268::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:15:26,268::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:15:26,269::task::990::TaskManager.Task::(_decref) Task=`0bad9e92-c56a-427a-bb1b-6edb719ab1c2`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:15:26,303::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:15:26,304::task::595::TaskManager.Task::(_updateState) Task=`556d27c9-68d8-4395-bafd-a96a1eb451ee`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:15:26,304::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:15:26,304::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`8ba51d1e-b153-478f-8b55-c7af614c1e24`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:15:26,304::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:15:26,305::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:15:26,305::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`8ba51d1e-b153-478f-8b55-c7af614c1e24`::Granted request >Thread-34::DEBUG::2014-07-24 11:15:26,305::task::827::TaskManager.Task::(resourceAcquired) Task=`556d27c9-68d8-4395-bafd-a96a1eb451ee`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:15:26,305::task::990::TaskManager.Task::(_decref) Task=`556d27c9-68d8-4395-bafd-a96a1eb451ee`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:15:26,306::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:15:26,306::task::1185::TaskManager.Task::(prepare) Task=`556d27c9-68d8-4395-bafd-a96a1eb451ee`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:15:26,306::task::595::TaskManager.Task::(_updateState) Task=`556d27c9-68d8-4395-bafd-a96a1eb451ee`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:15:26,306::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:15:26,307::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:15:26,307::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:15:26,307::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:15:26,307::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:15:26,307::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:15:26,308::task::990::TaskManager.Task::(_decref) Task=`556d27c9-68d8-4395-bafd-a96a1eb451ee`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:15:27,324::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:15:27,399::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355426 s, 28.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:15:29,152::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:15:29,411::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:15:29,485::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342512 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:15:31,497::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:15:31,570::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337399 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:15:33,582::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:15:33,655::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332411 s, 30.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:15:34,097::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:15:34,117::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0113811 s, 360 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:15:35,667::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:15:35,742::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358728 s, 28.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:15:36,363::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:15:36,364::task::595::TaskManager.Task::(_updateState) Task=`47b3f226-65aa-41ad-9067-e1e9d200528a`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:15:36,365::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:15:36,365::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:15:36,365::task::1185::TaskManager.Task::(prepare) Task=`47b3f226-65aa-41ad-9067-e1e9d200528a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:15:36,365::task::595::TaskManager.Task::(_updateState) Task=`47b3f226-65aa-41ad-9067-e1e9d200528a`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:15:36,366::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:15:36,366::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:15:36,366::task::990::TaskManager.Task::(_decref) Task=`47b3f226-65aa-41ad-9067-e1e9d200528a`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:15:36,397::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:15:36,398::task::595::TaskManager.Task::(_updateState) Task=`aa1bf112-9ea8-409c-b462-1b8d578cce89`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:15:36,398::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:15:36,398::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`530702b3-809e-46c9-aeac-9904041cb8d5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:15:36,398::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:15:36,399::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:15:36,399::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`530702b3-809e-46c9-aeac-9904041cb8d5`::Granted request >Thread-34::DEBUG::2014-07-24 11:15:36,399::task::827::TaskManager.Task::(resourceAcquired) Task=`aa1bf112-9ea8-409c-b462-1b8d578cce89`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:15:36,399::task::990::TaskManager.Task::(_decref) Task=`aa1bf112-9ea8-409c-b462-1b8d578cce89`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:15:36,400::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:15:36,400::task::1185::TaskManager.Task::(prepare) Task=`aa1bf112-9ea8-409c-b462-1b8d578cce89`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:15:36,400::task::595::TaskManager.Task::(_updateState) Task=`aa1bf112-9ea8-409c-b462-1b8d578cce89`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:15:36,401::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:15:36,401::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:15:36,401::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:15:36,401::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:15:36,401::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:15:36,401::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:15:36,402::task::990::TaskManager.Task::(_decref) Task=`aa1bf112-9ea8-409c-b462-1b8d578cce89`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:15:37,754::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:15:37,829::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034729 s, 29.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:15:39,329::task::595::TaskManager.Task::(_updateState) Task=`91a3a784-87fb-4be8-9b2b-17bf95f8789d`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:15:39,329::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:15:39,329::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0113811', 'lastCheck': '5.2', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:15:39,330::task::1185::TaskManager.Task::(prepare) Task=`91a3a784-87fb-4be8-9b2b-17bf95f8789d`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0113811', 'lastCheck': '5.2', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:15:39,330::task::595::TaskManager.Task::(_updateState) Task=`91a3a784-87fb-4be8-9b2b-17bf95f8789d`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:15:39,330::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:15:39,330::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:15:39,330::task::990::TaskManager.Task::(_decref) Task=`91a3a784-87fb-4be8-9b2b-17bf95f8789d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:15:39,841::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:15:39,914::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341578 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:15:41,927::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:15:41,999::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330905 s, 30.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:15:44,011::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:15:44,085::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346792 s, 29.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:15:44,122::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:15:44,131::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000564412 s, 7.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:15:46,098::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:15:46,173::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339754 s, 30.1 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:15:46,472::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:15:46,473::task::595::TaskManager.Task::(_updateState) Task=`ed3f0639-6860-4b96-b2d4-8fe6d25e29a3`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:15:46,473::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:15:46,474::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:15:46,474::task::1185::TaskManager.Task::(prepare) Task=`ed3f0639-6860-4b96-b2d4-8fe6d25e29a3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:15:46,474::task::595::TaskManager.Task::(_updateState) Task=`ed3f0639-6860-4b96-b2d4-8fe6d25e29a3`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:15:46,474::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:15:46,474::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:15:46,474::task::990::TaskManager.Task::(_decref) Task=`ed3f0639-6860-4b96-b2d4-8fe6d25e29a3`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:15:46,677::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:15:46,678::task::595::TaskManager.Task::(_updateState) Task=`b9c7f26c-1bd3-4c56-b7ba-33f39095c30e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:15:46,678::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:15:46,678::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`11c89a3f-d7e5-4ce0-a0b4-c69439ebeb31`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:15:46,680::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:15:46,680::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:15:46,680::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`11c89a3f-d7e5-4ce0-a0b4-c69439ebeb31`::Granted request >Thread-34::DEBUG::2014-07-24 11:15:46,680::task::827::TaskManager.Task::(resourceAcquired) Task=`b9c7f26c-1bd3-4c56-b7ba-33f39095c30e`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:15:46,681::task::990::TaskManager.Task::(_decref) Task=`b9c7f26c-1bd3-4c56-b7ba-33f39095c30e`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:15:46,681::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:15:46,681::task::1185::TaskManager.Task::(prepare) Task=`b9c7f26c-1bd3-4c56-b7ba-33f39095c30e`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:15:46,682::task::595::TaskManager.Task::(_updateState) Task=`b9c7f26c-1bd3-4c56-b7ba-33f39095c30e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:15:46,682::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:15:46,682::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:15:46,682::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:15:46,682::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:15:46,682::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:15:46,683::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:15:46,683::task::990::TaskManager.Task::(_decref) Task=`b9c7f26c-1bd3-4c56-b7ba-33f39095c30e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:15:48,186::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:15:48,260::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356388 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:15:50,272::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:15:50,345::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034396 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:15:52,358::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:15:52,430::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332241 s, 30.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:15:54,136::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:15:54,167::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0224482 s, 182 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:15:54,442::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:15:54,538::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345847 s, 29.6 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:15:54,719::task::595::TaskManager.Task::(_updateState) Task=`a4117357-ba34-4aa1-8bb9-d6a0a38bf05b`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:15:54,719::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:15:54,719::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0224482', 'lastCheck': '0.5', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:15:54,719::task::1185::TaskManager.Task::(prepare) Task=`a4117357-ba34-4aa1-8bb9-d6a0a38bf05b`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0224482', 'lastCheck': '0.5', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:15:54,720::task::595::TaskManager.Task::(_updateState) Task=`a4117357-ba34-4aa1-8bb9-d6a0a38bf05b`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:15:54,720::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:15:54,720::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:15:54,720::task::990::TaskManager.Task::(_decref) Task=`a4117357-ba34-4aa1-8bb9-d6a0a38bf05b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:15:56,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:15:56,622::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330333 s, 31.0 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:15:56,774::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:15:56,774::task::595::TaskManager.Task::(_updateState) Task=`eaa2e996-cab8-41ed-b186-6166b83dd7d4`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:15:56,774::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:15:56,775::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:15:56,775::task::1185::TaskManager.Task::(prepare) Task=`eaa2e996-cab8-41ed-b186-6166b83dd7d4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:15:56,775::task::595::TaskManager.Task::(_updateState) Task=`eaa2e996-cab8-41ed-b186-6166b83dd7d4`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:15:56,775::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:15:56,775::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:15:56,776::task::990::TaskManager.Task::(_decref) Task=`eaa2e996-cab8-41ed-b186-6166b83dd7d4`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:15:56,823::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:15:56,824::task::595::TaskManager.Task::(_updateState) Task=`b6dfd85e-3484-4c69-9d43-0e2c2fc8f262`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:15:56,824::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:15:56,824::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f9cb1f94-232e-409d-8557-abb027109bf2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:15:56,824::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:15:56,825::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:15:56,825::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f9cb1f94-232e-409d-8557-abb027109bf2`::Granted request >Thread-34::DEBUG::2014-07-24 11:15:56,825::task::827::TaskManager.Task::(resourceAcquired) Task=`b6dfd85e-3484-4c69-9d43-0e2c2fc8f262`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:15:56,825::task::990::TaskManager.Task::(_decref) Task=`b6dfd85e-3484-4c69-9d43-0e2c2fc8f262`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:15:56,826::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:15:56,826::task::1185::TaskManager.Task::(prepare) Task=`b6dfd85e-3484-4c69-9d43-0e2c2fc8f262`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:15:56,826::task::595::TaskManager.Task::(_updateState) Task=`b6dfd85e-3484-4c69-9d43-0e2c2fc8f262`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:15:56,827::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:15:56,827::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:15:56,827::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:15:56,827::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:15:56,827::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:15:56,827::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:15:56,828::task::990::TaskManager.Task::(_decref) Task=`b6dfd85e-3484-4c69-9d43-0e2c2fc8f262`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:15:58,634::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:15:58,707::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034313 s, 29.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:15:59,189::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:16:00,720::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:16:00,793::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346494 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:16:02,805::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:16:02,879::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354447 s, 28.9 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:16:03,068::task::595::TaskManager.Task::(_updateState) Task=`760492d8-a3cb-461d-8551-7df7a71b63da`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:16:03,069::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:16:03,069::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:16:03,069::task::1185::TaskManager.Task::(prepare) Task=`760492d8-a3cb-461d-8551-7df7a71b63da`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:16:03,069::task::595::TaskManager.Task::(_updateState) Task=`760492d8-a3cb-461d-8551-7df7a71b63da`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:16:03,069::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:16:03,070::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:16:03,070::task::990::TaskManager.Task::(_decref) Task=`760492d8-a3cb-461d-8551-7df7a71b63da`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:16:04,172::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:16:04,187::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000748954 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:16:04,892::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:16:05,023::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033993 s, 30.1 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:16:06,915::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:16:06,915::task::595::TaskManager.Task::(_updateState) Task=`83e77863-f3b4-491f-ae55-bcd012aec651`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:16:06,915::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:16:06,916::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:16:06,916::task::1185::TaskManager.Task::(prepare) Task=`83e77863-f3b4-491f-ae55-bcd012aec651`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:16:06,916::task::595::TaskManager.Task::(_updateState) Task=`83e77863-f3b4-491f-ae55-bcd012aec651`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:16:06,916::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:16:06,916::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:16:06,916::task::990::TaskManager.Task::(_decref) Task=`83e77863-f3b4-491f-ae55-bcd012aec651`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:16:06,949::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:16:06,949::task::595::TaskManager.Task::(_updateState) Task=`b84cd0a6-98ff-4be3-a8d0-becd07faa930`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:16:06,950::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:16:06,950::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c2bb6dd3-2a20-4209-b6b9-bc7449dea07d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:16:06,950::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:16:06,950::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:16:06,950::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c2bb6dd3-2a20-4209-b6b9-bc7449dea07d`::Granted request >Thread-34::DEBUG::2014-07-24 11:16:06,951::task::827::TaskManager.Task::(resourceAcquired) Task=`b84cd0a6-98ff-4be3-a8d0-becd07faa930`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:16:06,951::task::990::TaskManager.Task::(_decref) Task=`b84cd0a6-98ff-4be3-a8d0-becd07faa930`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:16:06,952::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:16:06,952::task::1185::TaskManager.Task::(prepare) Task=`b84cd0a6-98ff-4be3-a8d0-becd07faa930`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:16:06,952::task::595::TaskManager.Task::(_updateState) Task=`b84cd0a6-98ff-4be3-a8d0-becd07faa930`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:16:06,952::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:16:06,952::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:16:06,953::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:16:06,953::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:16:06,953::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:16:06,953::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:16:06,953::task::990::TaskManager.Task::(_decref) Task=`b84cd0a6-98ff-4be3-a8d0-becd07faa930`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:16:07,190::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:16:07,266::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346675 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:16:09,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:16:09,352::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348755 s, 29.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:16:10,623::task::595::TaskManager.Task::(_updateState) Task=`2ab1d4a6-6a31-4fcf-bcf8-1e631a022bac`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:16:10,623::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:16:10,623::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000748954', 'lastCheck': '6.4', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:16:10,624::task::1185::TaskManager.Task::(prepare) Task=`2ab1d4a6-6a31-4fcf-bcf8-1e631a022bac`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000748954', 'lastCheck': '6.4', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:16:10,624::task::595::TaskManager.Task::(_updateState) Task=`2ab1d4a6-6a31-4fcf-bcf8-1e631a022bac`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:16:10,624::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:16:10,624::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:16:10,624::task::990::TaskManager.Task::(_decref) Task=`2ab1d4a6-6a31-4fcf-bcf8-1e631a022bac`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:16:11,364::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:16:11,442::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379523 s, 27.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:16:13,455::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:16:13,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332558 s, 30.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:16:14,194::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 23aa0606-edc3-4882-a4aa-18aa1983458f >Thread-18::DEBUG::2014-07-24 11:16:14,194::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-18::DEBUG::2014-07-24 11:16:14,195::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:16:14,218::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.0149863 s, 137 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:16:14,219::misc::264::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.0149863 s, 137 kB/s'], size: 2048 >Thread-18::DEBUG::2014-07-24 11:16:14,219::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-18::WARNING::2014-07-24 11:16:14,219::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-18::DEBUG::2014-07-24 11:16:14,219::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-18::DEBUG::2014-07-24 11:16:14,219::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 11:16:14,220::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 11:16:14,220::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 11:16:14,220::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 11:16:14,220::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 11:16:14,221::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-18::DEBUG::2014-07-24 11:16:14,483::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:16:14,484::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 11:16:14,484::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'LOCKPOLICY=', 'POOL_DOMAINS=23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'POOL_DESCRIPTION=DS1', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_UUID=637ea13c-81a8-4b44-8cab-961458b01883', 'POOL_SPM_ID=1', '_SHA_CKSUM=a749afdc7119a2d6aad840af5c63c9b28c0b612c', 'POOL_SPM_LVER=0'] >Thread-18::INFO::2014-07-24 11:16:14,485::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_imageNS already registered >Thread-18::INFO::2014-07-24 11:16:14,485::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_volumeNS already registered >Thread-18::INFO::2014-07-24 11:16:14,486::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_lvmActivationNS already registered >Thread-18::DEBUG::2014-07-24 11:16:14,486::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-18::DEBUG::2014-07-24 11:16:14,641::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:16:14,642::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:16:14,651::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000765706 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:16:15,539::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:16:15,613::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343759 s, 29.8 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:16:17,018::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:16:17,019::task::595::TaskManager.Task::(_updateState) Task=`82c5dd19-33fb-4c5f-871b-ed6e3ec32951`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:16:17,019::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:16:17,020::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:16:17,020::task::1185::TaskManager.Task::(prepare) Task=`82c5dd19-33fb-4c5f-871b-ed6e3ec32951`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:16:17,020::task::595::TaskManager.Task::(_updateState) Task=`82c5dd19-33fb-4c5f-871b-ed6e3ec32951`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:16:17,020::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:16:17,020::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:16:17,020::task::990::TaskManager.Task::(_decref) Task=`82c5dd19-33fb-4c5f-871b-ed6e3ec32951`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:16:17,055::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:16:17,055::task::595::TaskManager.Task::(_updateState) Task=`1071e9c0-9f46-4a16-8295-ec68ea6372f5`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:16:17,056::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:16:17,056::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e577af1c-f16c-4c3e-84cc-585c3459aeef`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:16:17,056::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:16:17,056::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:16:17,057::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e577af1c-f16c-4c3e-84cc-585c3459aeef`::Granted request >Thread-34::DEBUG::2014-07-24 11:16:17,057::task::827::TaskManager.Task::(resourceAcquired) Task=`1071e9c0-9f46-4a16-8295-ec68ea6372f5`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:16:17,057::task::990::TaskManager.Task::(_decref) Task=`1071e9c0-9f46-4a16-8295-ec68ea6372f5`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:16:17,058::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:16:17,058::task::1185::TaskManager.Task::(prepare) Task=`1071e9c0-9f46-4a16-8295-ec68ea6372f5`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:16:17,058::task::595::TaskManager.Task::(_updateState) Task=`1071e9c0-9f46-4a16-8295-ec68ea6372f5`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:16:17,058::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:16:17,059::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:16:17,059::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:16:17,059::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:16:17,059::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:16:17,059::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:16:17,059::task::990::TaskManager.Task::(_decref) Task=`1071e9c0-9f46-4a16-8295-ec68ea6372f5`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:16:17,626::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:16:17,704::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0385577 s, 26.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:16:19,717::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:16:19,792::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353063 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:16:21,806::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:16:22,158::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.312869 s, 3.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:16:24,170::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:16:24,243::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337413 s, 30.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:16:24,656::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:16:24,666::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00072413 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:16:26,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-13::DEBUG::2014-07-24 11:16:26,304::task::595::TaskManager.Task::(_updateState) Task=`5efa7fbb-9e25-4c88-aceb-abe0c1ce82b0`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:16:26,306::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:16:26,308::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00072413', 'lastCheck': '1.6', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:16:26,309::task::1185::TaskManager.Task::(prepare) Task=`5efa7fbb-9e25-4c88-aceb-abe0c1ce82b0`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00072413', 'lastCheck': '1.6', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:16:26,310::task::595::TaskManager.Task::(_updateState) Task=`5efa7fbb-9e25-4c88-aceb-abe0c1ce82b0`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:16:26,311::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:16:26,312::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:16:26,313::task::990::TaskManager.Task::(_decref) Task=`5efa7fbb-9e25-4c88-aceb-abe0c1ce82b0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:16:26,359::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03357 s, 30.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:16:27,177::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:16:27,177::task::595::TaskManager.Task::(_updateState) Task=`890c37f2-21cc-4455-843f-6a0d192375ac`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:16:27,178::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:16:27,178::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:16:27,178::task::1185::TaskManager.Task::(prepare) Task=`890c37f2-21cc-4455-843f-6a0d192375ac`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:16:27,178::task::595::TaskManager.Task::(_updateState) Task=`890c37f2-21cc-4455-843f-6a0d192375ac`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:16:27,178::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:16:27,179::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:16:27,179::task::990::TaskManager.Task::(_decref) Task=`890c37f2-21cc-4455-843f-6a0d192375ac`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:16:27,212::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:16:27,213::task::595::TaskManager.Task::(_updateState) Task=`efa00f2e-6523-4fb0-9a4a-3aa043ec9689`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:16:27,213::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:16:27,213::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`59a0fa2e-3027-4f72-8776-835e8fc6bae4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:16:27,213::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:16:27,214::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:16:27,214::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`59a0fa2e-3027-4f72-8776-835e8fc6bae4`::Granted request >Thread-34::DEBUG::2014-07-24 11:16:27,214::task::827::TaskManager.Task::(resourceAcquired) Task=`efa00f2e-6523-4fb0-9a4a-3aa043ec9689`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:16:27,214::task::990::TaskManager.Task::(_decref) Task=`efa00f2e-6523-4fb0-9a4a-3aa043ec9689`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:16:27,215::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:16:27,215::task::1185::TaskManager.Task::(prepare) Task=`efa00f2e-6523-4fb0-9a4a-3aa043ec9689`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:16:27,215::task::595::TaskManager.Task::(_updateState) Task=`efa00f2e-6523-4fb0-9a4a-3aa043ec9689`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:16:27,216::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:16:27,216::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:16:27,216::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:16:27,216::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:16:27,216::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:16:27,216::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:16:27,217::task::990::TaskManager.Task::(_decref) Task=`efa00f2e-6523-4fb0-9a4a-3aa043ec9689`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:16:28,371::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:16:28,444::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034487 s, 29.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:16:29,226::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:16:30,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:16:30,531::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356663 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:16:32,543::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:16:32,618::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356756 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:16:34,642::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-24 11:16:34,673::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:16:34,698::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0103155 s, 397 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:16:34,764::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0823181 s, 12.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:16:36,777::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:16:36,850::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336176 s, 30.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:16:37,272::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:16:37,273::task::595::TaskManager.Task::(_updateState) Task=`1424f5e8-ff5e-4cef-b09c-e3de89e3dc0e`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:16:37,273::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:16:37,273::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:16:37,273::task::1185::TaskManager.Task::(prepare) Task=`1424f5e8-ff5e-4cef-b09c-e3de89e3dc0e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:16:37,274::task::595::TaskManager.Task::(_updateState) Task=`1424f5e8-ff5e-4cef-b09c-e3de89e3dc0e`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:16:37,274::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:16:37,274::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:16:37,274::task::990::TaskManager.Task::(_decref) Task=`1424f5e8-ff5e-4cef-b09c-e3de89e3dc0e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:16:37,310::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:16:37,310::task::595::TaskManager.Task::(_updateState) Task=`80dbe44f-16c4-4596-b48a-18ccffcaea3c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:16:37,311::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:16:37,311::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`bfee0c61-8b4e-4dff-8900-a2301d016e56`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:16:37,311::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:16:37,311::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:16:37,312::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`bfee0c61-8b4e-4dff-8900-a2301d016e56`::Granted request >Thread-34::DEBUG::2014-07-24 11:16:37,312::task::827::TaskManager.Task::(resourceAcquired) Task=`80dbe44f-16c4-4596-b48a-18ccffcaea3c`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:16:37,312::task::990::TaskManager.Task::(_decref) Task=`80dbe44f-16c4-4596-b48a-18ccffcaea3c`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:16:37,313::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:16:37,313::task::1185::TaskManager.Task::(prepare) Task=`80dbe44f-16c4-4596-b48a-18ccffcaea3c`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:16:37,313::task::595::TaskManager.Task::(_updateState) Task=`80dbe44f-16c4-4596-b48a-18ccffcaea3c`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:16:37,314::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:16:37,314::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:16:37,314::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:16:37,314::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:16:37,314::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:16:37,314::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:16:37,315::task::990::TaskManager.Task::(_decref) Task=`80dbe44f-16c4-4596-b48a-18ccffcaea3c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:16:38,862::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:16:38,935::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335977 s, 30.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:16:40,947::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:16:41,020::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332368 s, 30.8 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:16:41,745::task::595::TaskManager.Task::(_updateState) Task=`06f456ba-a8d6-4834-aad9-0ab321a19601`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:16:41,745::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:16:41,746::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0103155', 'lastCheck': '7.0', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:16:41,746::task::1185::TaskManager.Task::(prepare) Task=`06f456ba-a8d6-4834-aad9-0ab321a19601`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0103155', 'lastCheck': '7.0', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:16:41,746::task::595::TaskManager.Task::(_updateState) Task=`06f456ba-a8d6-4834-aad9-0ab321a19601`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:16:41,746::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:16:41,746::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:16:41,747::task::990::TaskManager.Task::(_decref) Task=`06f456ba-a8d6-4834-aad9-0ab321a19601`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:16:43,032::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:16:43,104::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328663 s, 31.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:16:44,728::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:16:44,737::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0007356 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:16:45,117::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:16:45,193::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353521 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:16:47,205::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:16:47,279::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328963 s, 31.1 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:16:47,387::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:16:47,388::task::595::TaskManager.Task::(_updateState) Task=`502784db-b4a5-4242-8086-3ebc03e0e0ee`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:16:47,388::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:16:47,389::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:16:47,389::task::1185::TaskManager.Task::(prepare) Task=`502784db-b4a5-4242-8086-3ebc03e0e0ee`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:16:47,389::task::595::TaskManager.Task::(_updateState) Task=`502784db-b4a5-4242-8086-3ebc03e0e0ee`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:16:47,389::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:16:47,389::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:16:47,389::task::990::TaskManager.Task::(_decref) Task=`502784db-b4a5-4242-8086-3ebc03e0e0ee`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:16:47,425::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:16:47,426::task::595::TaskManager.Task::(_updateState) Task=`67afe480-2a03-4588-a5a4-932524301b39`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:16:47,426::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:16:47,426::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d5686cd8-6679-49e0-beff-f092856a9438`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:16:47,427::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:16:47,427::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:16:47,427::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d5686cd8-6679-49e0-beff-f092856a9438`::Granted request >Thread-34::DEBUG::2014-07-24 11:16:47,427::task::827::TaskManager.Task::(resourceAcquired) Task=`67afe480-2a03-4588-a5a4-932524301b39`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:16:47,427::task::990::TaskManager.Task::(_decref) Task=`67afe480-2a03-4588-a5a4-932524301b39`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:16:47,428::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:16:47,428::task::1185::TaskManager.Task::(prepare) Task=`67afe480-2a03-4588-a5a4-932524301b39`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:16:47,429::task::595::TaskManager.Task::(_updateState) Task=`67afe480-2a03-4588-a5a4-932524301b39`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:16:47,429::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:16:47,429::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:16:47,429::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:16:47,429::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:16:47,430::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:16:47,430::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:16:47,430::task::990::TaskManager.Task::(_decref) Task=`67afe480-2a03-4588-a5a4-932524301b39`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:16:49,291::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:16:49,363::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336585 s, 30.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:16:51,376::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:16:51,449::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330669 s, 31.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:16:53,461::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:16:53,534::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348052 s, 29.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:16:54,742::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:16:54,760::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0100064 s, 409 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:16:55,547::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:16:55,620::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339924 s, 30.1 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:16:57,116::task::595::TaskManager.Task::(_updateState) Task=`a5ed3341-a41d-4335-93be-851a41fa8454`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:16:57,117::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:16:57,117::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0100064', 'lastCheck': '2.4', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:16:57,117::task::1185::TaskManager.Task::(prepare) Task=`a5ed3341-a41d-4335-93be-851a41fa8454`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0100064', 'lastCheck': '2.4', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:16:57,117::task::595::TaskManager.Task::(_updateState) Task=`a5ed3341-a41d-4335-93be-851a41fa8454`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:16:57,117::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:16:57,118::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:16:57,118::task::990::TaskManager.Task::(_decref) Task=`a5ed3341-a41d-4335-93be-851a41fa8454`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 11:16:57,500::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:16:57,500::task::595::TaskManager.Task::(_updateState) Task=`4c16ecea-6e3c-4050-8bd8-b425d4651a20`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:16:57,500::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:16:57,501::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:16:57,501::task::1185::TaskManager.Task::(prepare) Task=`4c16ecea-6e3c-4050-8bd8-b425d4651a20`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:16:57,501::task::595::TaskManager.Task::(_updateState) Task=`4c16ecea-6e3c-4050-8bd8-b425d4651a20`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:16:57,501::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:16:57,501::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:16:57,502::task::990::TaskManager.Task::(_decref) Task=`4c16ecea-6e3c-4050-8bd8-b425d4651a20`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:16:57,531::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:16:57,531::task::595::TaskManager.Task::(_updateState) Task=`36d4543c-3799-4453-b034-198800bb7650`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:16:57,531::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:16:57,533::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4eebc0cd-3413-43bf-ba90-a8e600449f39`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:16:57,533::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:16:57,533::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:16:57,533::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4eebc0cd-3413-43bf-ba90-a8e600449f39`::Granted request >Thread-34::DEBUG::2014-07-24 11:16:57,534::task::827::TaskManager.Task::(resourceAcquired) Task=`36d4543c-3799-4453-b034-198800bb7650`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:16:57,534::task::990::TaskManager.Task::(_decref) Task=`36d4543c-3799-4453-b034-198800bb7650`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:16:57,534::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:16:57,535::task::1185::TaskManager.Task::(prepare) Task=`36d4543c-3799-4453-b034-198800bb7650`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:16:57,535::task::595::TaskManager.Task::(_updateState) Task=`36d4543c-3799-4453-b034-198800bb7650`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:16:57,535::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:16:57,535::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:16:57,535::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:16:57,536::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:16:57,536::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:16:57,536::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:16:57,536::task::990::TaskManager.Task::(_decref) Task=`36d4543c-3799-4453-b034-198800bb7650`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:16:57,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:16:57,710::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352069 s, 29.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:16:59,262::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:16:59,722::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:16:59,796::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344775 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:17:01,808::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:17:01,885::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035172 s, 29.1 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:17:03,223::task::595::TaskManager.Task::(_updateState) Task=`849ded08-8e8c-4524-96d1-8e04be176dfb`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:17:03,223::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:17:03,223::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:17:03,224::task::1185::TaskManager.Task::(prepare) Task=`849ded08-8e8c-4524-96d1-8e04be176dfb`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:17:03,224::task::595::TaskManager.Task::(_updateState) Task=`849ded08-8e8c-4524-96d1-8e04be176dfb`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:17:03,224::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:17:03,224::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:17:03,224::task::990::TaskManager.Task::(_decref) Task=`849ded08-8e8c-4524-96d1-8e04be176dfb`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:17:03,898::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:17:03,973::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346382 s, 29.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:17:04,765::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:17:04,775::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000675862 s, 6.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:17:05,985::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:17:06,059::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347505 s, 29.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:17:07,593::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:17:07,593::task::595::TaskManager.Task::(_updateState) Task=`a1582716-7140-4e2a-b4ee-c41f530b4f43`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:17:07,593::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:17:07,594::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:17:07,594::task::1185::TaskManager.Task::(prepare) Task=`a1582716-7140-4e2a-b4ee-c41f530b4f43`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:17:07,594::task::595::TaskManager.Task::(_updateState) Task=`a1582716-7140-4e2a-b4ee-c41f530b4f43`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:17:07,594::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:17:07,594::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:17:07,595::task::990::TaskManager.Task::(_decref) Task=`a1582716-7140-4e2a-b4ee-c41f530b4f43`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:17:07,634::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:17:07,634::task::595::TaskManager.Task::(_updateState) Task=`86734793-1d60-4b22-979e-6a5e8235e2f6`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:17:07,634::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:17:07,634::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`61daeb60-eb93-4c28-a623-469835898035`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:17:07,635::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:17:07,635::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:17:07,635::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`61daeb60-eb93-4c28-a623-469835898035`::Granted request >Thread-34::DEBUG::2014-07-24 11:17:07,635::task::827::TaskManager.Task::(resourceAcquired) Task=`86734793-1d60-4b22-979e-6a5e8235e2f6`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:17:07,635::task::990::TaskManager.Task::(_decref) Task=`86734793-1d60-4b22-979e-6a5e8235e2f6`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:17:07,636::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:17:07,636::task::1185::TaskManager.Task::(prepare) Task=`86734793-1d60-4b22-979e-6a5e8235e2f6`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:17:07,637::task::595::TaskManager.Task::(_updateState) Task=`86734793-1d60-4b22-979e-6a5e8235e2f6`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:17:07,637::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:17:07,637::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:17:07,637::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:17:07,637::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:17:07,637::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:17:07,638::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:17:07,638::task::990::TaskManager.Task::(_decref) Task=`86734793-1d60-4b22-979e-6a5e8235e2f6`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:17:08,071::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:17:08,145::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344298 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:17:10,157::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:17:10,230::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338882 s, 30.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:17:12,242::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:17:12,317::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349356 s, 29.3 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:17:12,625::task::595::TaskManager.Task::(_updateState) Task=`0d973af0-915c-4735-b180-79a2678c3e29`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:17:12,626::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:17:12,626::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000675862', 'lastCheck': '7.8', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:17:12,626::task::1185::TaskManager.Task::(prepare) Task=`0d973af0-915c-4735-b180-79a2678c3e29`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000675862', 'lastCheck': '7.8', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:17:12,626::task::595::TaskManager.Task::(_updateState) Task=`0d973af0-915c-4735-b180-79a2678c3e29`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:17:12,626::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:17:12,626::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:17:12,627::task::990::TaskManager.Task::(_decref) Task=`0d973af0-915c-4735-b180-79a2678c3e29`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:17:14,329::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:17:14,402::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340768 s, 30.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:17:14,782::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:17:14,793::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000699663 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:17:16,415::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:17:16,488::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341722 s, 30.0 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:17:17,773::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:17:17,773::task::595::TaskManager.Task::(_updateState) Task=`20b2ebff-0636-42c3-8adc-3886d065372a`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:17:17,774::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:17:17,774::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:17:17,774::task::1185::TaskManager.Task::(prepare) Task=`20b2ebff-0636-42c3-8adc-3886d065372a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:17:17,774::task::595::TaskManager.Task::(_updateState) Task=`20b2ebff-0636-42c3-8adc-3886d065372a`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:17:17,774::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:17:17,774::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:17:17,775::task::990::TaskManager.Task::(_decref) Task=`20b2ebff-0636-42c3-8adc-3886d065372a`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:17:17,814::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:17:17,814::task::595::TaskManager.Task::(_updateState) Task=`bb01f852-4746-45a1-a31a-b973fa194dd9`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:17:17,815::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:17:17,815::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`adfd03b2-ff4b-4485-b518-6bb4fee2515b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:17:17,815::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:17:17,815::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:17:17,816::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`adfd03b2-ff4b-4485-b518-6bb4fee2515b`::Granted request >Thread-34::DEBUG::2014-07-24 11:17:17,816::task::827::TaskManager.Task::(resourceAcquired) Task=`bb01f852-4746-45a1-a31a-b973fa194dd9`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:17:17,816::task::990::TaskManager.Task::(_decref) Task=`bb01f852-4746-45a1-a31a-b973fa194dd9`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:17:17,817::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:17:17,817::task::1185::TaskManager.Task::(prepare) Task=`bb01f852-4746-45a1-a31a-b973fa194dd9`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:17:17,817::task::595::TaskManager.Task::(_updateState) Task=`bb01f852-4746-45a1-a31a-b973fa194dd9`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:17:17,817::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:17:17,818::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:17:17,818::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:17:17,818::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:17:17,818::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:17:17,818::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:17:17,819::task::990::TaskManager.Task::(_decref) Task=`bb01f852-4746-45a1-a31a-b973fa194dd9`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:17:18,500::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:17:18,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353525 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:17:20,586::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:17:20,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337999 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:17:22,671::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:17:22,749::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342272 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:17:24,762::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-24 11:17:24,801::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:17:24,838::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0167917 s, 244 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:17:24,906::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.103896 s, 9.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:17:26,918::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:17:26,992::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352988 s, 29.0 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:17:27,908::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:17:27,909::task::595::TaskManager.Task::(_updateState) Task=`f2b0b300-9086-4adf-bb3a-9e7e6afcd9c0`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:17:27,909::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:17:27,909::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:17:27,910::task::1185::TaskManager.Task::(prepare) Task=`f2b0b300-9086-4adf-bb3a-9e7e6afcd9c0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:17:27,910::task::595::TaskManager.Task::(_updateState) Task=`f2b0b300-9086-4adf-bb3a-9e7e6afcd9c0`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:17:27,910::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:17:27,910::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:17:27,910::task::990::TaskManager.Task::(_decref) Task=`f2b0b300-9086-4adf-bb3a-9e7e6afcd9c0`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:17:27,948::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:17:27,948::task::595::TaskManager.Task::(_updateState) Task=`16ead8cd-0f4b-4f43-adc0-850ef58d9641`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:17:27,948::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:17:27,949::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`56bb416f-f1b4-42f3-8c69-df99c2f027fb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:17:27,949::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:17:27,949::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:17:27,949::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`56bb416f-f1b4-42f3-8c69-df99c2f027fb`::Granted request >Thread-34::DEBUG::2014-07-24 11:17:27,950::task::827::TaskManager.Task::(resourceAcquired) Task=`16ead8cd-0f4b-4f43-adc0-850ef58d9641`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:17:27,950::task::990::TaskManager.Task::(_decref) Task=`16ead8cd-0f4b-4f43-adc0-850ef58d9641`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:17:27,951::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:17:27,951::task::1185::TaskManager.Task::(prepare) Task=`16ead8cd-0f4b-4f43-adc0-850ef58d9641`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:17:27,951::task::595::TaskManager.Task::(_updateState) Task=`16ead8cd-0f4b-4f43-adc0-850ef58d9641`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:17:27,951::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:17:27,951::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:17:27,951::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:17:27,952::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:17:27,952::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:17:27,952::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:17:27,952::task::990::TaskManager.Task::(_decref) Task=`16ead8cd-0f4b-4f43-adc0-850ef58d9641`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 11:17:27,998::task::595::TaskManager.Task::(_updateState) Task=`993e53db-9184-47be-aee6-1c38cc819b49`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:17:27,998::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:17:27,999::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0167917', 'lastCheck': '3.1', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:17:27,999::task::1185::TaskManager.Task::(prepare) Task=`993e53db-9184-47be-aee6-1c38cc819b49`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0167917', 'lastCheck': '3.1', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:17:27,999::task::595::TaskManager.Task::(_updateState) Task=`993e53db-9184-47be-aee6-1c38cc819b49`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:17:27,999::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:17:27,999::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:17:27,999::task::990::TaskManager.Task::(_decref) Task=`993e53db-9184-47be-aee6-1c38cc819b49`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:17:29,005::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:17:29,078::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337756 s, 30.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:17:29,298::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:17:31,090::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:17:31,451::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.321986 s, 3.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:17:33,464::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:17:33,537::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338024 s, 30.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:17:34,873::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:17:34,895::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0132197 s, 310 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:17:35,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:17:35,623::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033998 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:17:37,635::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:17:37,710::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354643 s, 28.9 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:17:38,034::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:17:38,035::task::595::TaskManager.Task::(_updateState) Task=`9023dc92-b62f-4d36-943e-6ae1344430c6`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:17:38,035::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:17:38,035::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:17:38,036::task::1185::TaskManager.Task::(prepare) Task=`9023dc92-b62f-4d36-943e-6ae1344430c6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:17:38,036::task::595::TaskManager.Task::(_updateState) Task=`9023dc92-b62f-4d36-943e-6ae1344430c6`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:17:38,036::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:17:38,036::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:17:38,036::task::990::TaskManager.Task::(_decref) Task=`9023dc92-b62f-4d36-943e-6ae1344430c6`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:17:38,089::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:17:38,089::task::595::TaskManager.Task::(_updateState) Task=`dbed3420-9230-4707-8081-d547f2b75b85`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:17:38,090::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:17:38,090::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f1515215-29f9-4637-8cff-c1c1f190613f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:17:38,090::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:17:38,090::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:17:38,091::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f1515215-29f9-4637-8cff-c1c1f190613f`::Granted request >Thread-34::DEBUG::2014-07-24 11:17:38,091::task::827::TaskManager.Task::(resourceAcquired) Task=`dbed3420-9230-4707-8081-d547f2b75b85`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:17:38,091::task::990::TaskManager.Task::(_decref) Task=`dbed3420-9230-4707-8081-d547f2b75b85`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:17:38,092::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:17:38,092::task::1185::TaskManager.Task::(prepare) Task=`dbed3420-9230-4707-8081-d547f2b75b85`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:17:38,092::task::595::TaskManager.Task::(_updateState) Task=`dbed3420-9230-4707-8081-d547f2b75b85`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:17:38,092::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:17:38,093::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:17:38,093::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:17:38,093::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:17:38,093::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:17:38,093::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:17:38,093::task::990::TaskManager.Task::(_decref) Task=`dbed3420-9230-4707-8081-d547f2b75b85`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:17:39,722::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:17:39,794::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334351 s, 30.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:17:41,807::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:17:41,882::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359293 s, 28.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:17:43,411::task::595::TaskManager.Task::(_updateState) Task=`68fc2f09-26e7-4aff-a880-d483237b54c7`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:17:43,411::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:17:43,411::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0132197', 'lastCheck': '8.5', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:17:43,411::task::1185::TaskManager.Task::(prepare) Task=`68fc2f09-26e7-4aff-a880-d483237b54c7`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0132197', 'lastCheck': '8.5', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:17:43,411::task::595::TaskManager.Task::(_updateState) Task=`68fc2f09-26e7-4aff-a880-d483237b54c7`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:17:43,412::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:17:43,412::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:17:43,412::task::990::TaskManager.Task::(_decref) Task=`68fc2f09-26e7-4aff-a880-d483237b54c7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:17:43,894::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:17:43,967::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335482 s, 30.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:17:44,900::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:17:44,915::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000620241 s, 6.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:17:45,980::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:17:46,053::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338318 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:17:48,065::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:17:48,138::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347579 s, 29.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:17:48,190::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:17:48,191::task::595::TaskManager.Task::(_updateState) Task=`a29edcd5-fbf0-454a-8df5-6378783e04c6`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:17:48,191::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:17:48,192::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:17:48,192::task::1185::TaskManager.Task::(prepare) Task=`a29edcd5-fbf0-454a-8df5-6378783e04c6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:17:48,192::task::595::TaskManager.Task::(_updateState) Task=`a29edcd5-fbf0-454a-8df5-6378783e04c6`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:17:48,192::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:17:48,192::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:17:48,192::task::990::TaskManager.Task::(_decref) Task=`a29edcd5-fbf0-454a-8df5-6378783e04c6`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:17:48,228::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:17:48,229::task::595::TaskManager.Task::(_updateState) Task=`a7386c7f-781d-4b0e-b8da-b1df5b07741f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:17:48,229::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:17:48,229::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`09ed93de-87eb-4b7c-92cc-5c354a86a5d3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:17:48,229::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:17:48,230::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:17:48,230::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`09ed93de-87eb-4b7c-92cc-5c354a86a5d3`::Granted request >Thread-34::DEBUG::2014-07-24 11:17:48,230::task::827::TaskManager.Task::(resourceAcquired) Task=`a7386c7f-781d-4b0e-b8da-b1df5b07741f`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:17:48,230::task::990::TaskManager.Task::(_decref) Task=`a7386c7f-781d-4b0e-b8da-b1df5b07741f`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:17:48,231::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:17:48,231::task::1185::TaskManager.Task::(prepare) Task=`a7386c7f-781d-4b0e-b8da-b1df5b07741f`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:17:48,231::task::595::TaskManager.Task::(_updateState) Task=`a7386c7f-781d-4b0e-b8da-b1df5b07741f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:17:48,232::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:17:48,232::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:17:48,232::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:17:48,232::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:17:48,232::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:17:48,232::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:17:48,233::task::990::TaskManager.Task::(_decref) Task=`a7386c7f-781d-4b0e-b8da-b1df5b07741f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:17:50,150::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:17:50,225::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356695 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:17:52,238::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:17:52,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354971 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:17:54,324::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:17:54,397::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332043 s, 30.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:17:54,944::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:17:54,962::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00963056 s, 425 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:17:56,410::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:17:56,483::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342203 s, 29.9 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:17:58,302::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:17:58,302::task::595::TaskManager.Task::(_updateState) Task=`8cc76e30-9ef1-4f86-be9f-de62b16a4d30`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:17:58,302::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:17:58,303::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:17:58,303::task::1185::TaskManager.Task::(prepare) Task=`8cc76e30-9ef1-4f86-be9f-de62b16a4d30`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:17:58,303::task::595::TaskManager.Task::(_updateState) Task=`8cc76e30-9ef1-4f86-be9f-de62b16a4d30`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:17:58,303::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:17:58,303::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:17:58,304::task::990::TaskManager.Task::(_decref) Task=`8cc76e30-9ef1-4f86-be9f-de62b16a4d30`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:17:58,340::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:17:58,340::task::595::TaskManager.Task::(_updateState) Task=`7a93f365-d962-49dc-9e34-bf5c31baa876`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:17:58,340::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:17:58,341::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c7b7ed9e-f14b-4e30-8cfb-df338090e9b1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:17:58,341::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:17:58,341::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:17:58,341::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c7b7ed9e-f14b-4e30-8cfb-df338090e9b1`::Granted request >Thread-34::DEBUG::2014-07-24 11:17:58,341::task::827::TaskManager.Task::(resourceAcquired) Task=`7a93f365-d962-49dc-9e34-bf5c31baa876`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:17:58,342::task::990::TaskManager.Task::(_decref) Task=`7a93f365-d962-49dc-9e34-bf5c31baa876`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:17:58,342::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:17:58,342::task::1185::TaskManager.Task::(prepare) Task=`7a93f365-d962-49dc-9e34-bf5c31baa876`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:17:58,343::task::595::TaskManager.Task::(_updateState) Task=`7a93f365-d962-49dc-9e34-bf5c31baa876`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:17:58,343::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:17:58,343::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:17:58,343::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:17:58,343::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:17:58,344::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:17:58,344::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:17:58,344::task::990::TaskManager.Task::(_decref) Task=`7a93f365-d962-49dc-9e34-bf5c31baa876`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:17:58,495::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:17:58,567::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332611 s, 30.8 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:17:58,935::task::595::TaskManager.Task::(_updateState) Task=`5082b0dc-c0f7-4624-a51d-aece4e1b1a04`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:17:58,935::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:17:58,935::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00963056', 'lastCheck': '4.0', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:17:58,935::task::1185::TaskManager.Task::(prepare) Task=`5082b0dc-c0f7-4624-a51d-aece4e1b1a04`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00963056', 'lastCheck': '4.0', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:17:58,936::task::595::TaskManager.Task::(_updateState) Task=`5082b0dc-c0f7-4624-a51d-aece4e1b1a04`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:17:58,936::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:17:58,936::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:17:58,936::task::990::TaskManager.Task::(_decref) Task=`5082b0dc-c0f7-4624-a51d-aece4e1b1a04`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-07-24 11:17:59,338::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:18:00,579::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:18:00,652::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337983 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:18:02,664::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:18:02,737::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338991 s, 30.2 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:18:03,396::task::595::TaskManager.Task::(_updateState) Task=`b52202d6-428c-4d86-ae0c-4b186192f730`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:18:03,396::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:18:03,396::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:18:03,396::task::1185::TaskManager.Task::(prepare) Task=`b52202d6-428c-4d86-ae0c-4b186192f730`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:18:03,396::task::595::TaskManager.Task::(_updateState) Task=`b52202d6-428c-4d86-ae0c-4b186192f730`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:18:03,397::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:18:03,397::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:18:03,397::task::990::TaskManager.Task::(_decref) Task=`b52202d6-428c-4d86-ae0c-4b186192f730`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:18:04,750::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:18:04,827::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363282 s, 28.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:18:04,968::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:18:04,987::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0110176 s, 372 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:18:06,839::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:18:06,914::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354432 s, 28.9 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:18:08,403::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:18:08,404::task::595::TaskManager.Task::(_updateState) Task=`fb33d157-32ef-467c-a0ee-65a79deaf62c`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:18:08,404::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:18:08,404::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:18:08,404::task::1185::TaskManager.Task::(prepare) Task=`fb33d157-32ef-467c-a0ee-65a79deaf62c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:18:08,405::task::595::TaskManager.Task::(_updateState) Task=`fb33d157-32ef-467c-a0ee-65a79deaf62c`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:18:08,405::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:18:08,405::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:18:08,405::task::990::TaskManager.Task::(_decref) Task=`fb33d157-32ef-467c-a0ee-65a79deaf62c`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:18:08,436::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:18:08,437::task::595::TaskManager.Task::(_updateState) Task=`24b5386c-fd27-4b09-a359-8851e274f589`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:18:08,437::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:18:08,437::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`daad912b-6a7f-4771-baca-e7dd9b10ad25`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:18:08,437::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:18:08,438::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:18:08,438::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`daad912b-6a7f-4771-baca-e7dd9b10ad25`::Granted request >Thread-34::DEBUG::2014-07-24 11:18:08,439::task::827::TaskManager.Task::(resourceAcquired) Task=`24b5386c-fd27-4b09-a359-8851e274f589`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:18:08,439::task::990::TaskManager.Task::(_decref) Task=`24b5386c-fd27-4b09-a359-8851e274f589`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:18:08,440::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:18:08,440::task::1185::TaskManager.Task::(prepare) Task=`24b5386c-fd27-4b09-a359-8851e274f589`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:18:08,440::task::595::TaskManager.Task::(_updateState) Task=`24b5386c-fd27-4b09-a359-8851e274f589`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:18:08,441::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:18:08,441::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:18:08,441::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:18:08,441::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:18:08,441::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:18:08,441::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:18:08,442::task::990::TaskManager.Task::(_decref) Task=`24b5386c-fd27-4b09-a359-8851e274f589`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:18:08,926::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:18:09,122::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.156058 s, 6.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:18:11,134::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:18:11,208::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346455 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:18:13,221::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:18:13,296::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355728 s, 28.8 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:18:14,362::task::595::TaskManager.Task::(_updateState) Task=`f219daea-8060-4838-a4fc-c237775e65b4`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:18:14,362::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:18:14,363::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0110176', 'lastCheck': '9.4', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:18:14,363::task::1185::TaskManager.Task::(prepare) Task=`f219daea-8060-4838-a4fc-c237775e65b4`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0110176', 'lastCheck': '9.4', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:18:14,363::task::595::TaskManager.Task::(_updateState) Task=`f219daea-8060-4838-a4fc-c237775e65b4`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:18:14,363::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:18:14,363::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:18:14,363::task::990::TaskManager.Task::(_decref) Task=`f219daea-8060-4838-a4fc-c237775e65b4`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:18:14,992::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:18:15,001::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000653894 s, 6.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:18:15,308::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:18:15,383::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343152 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:18:17,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:18:17,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333992 s, 30.7 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:18:18,505::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:18:18,506::task::595::TaskManager.Task::(_updateState) Task=`528668a7-cd60-404c-ba82-a4dd8c453ca0`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:18:18,506::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:18:18,506::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:18:18,507::task::1185::TaskManager.Task::(prepare) Task=`528668a7-cd60-404c-ba82-a4dd8c453ca0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:18:18,507::task::595::TaskManager.Task::(_updateState) Task=`528668a7-cd60-404c-ba82-a4dd8c453ca0`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:18:18,507::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:18:18,507::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:18:18,507::task::990::TaskManager.Task::(_decref) Task=`528668a7-cd60-404c-ba82-a4dd8c453ca0`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:18:18,538::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:18:18,539::task::595::TaskManager.Task::(_updateState) Task=`26b33cec-11c2-43a1-9357-519531f383e8`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:18:18,539::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:18:18,539::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`abfafa26-86b4-4875-8435-53503d4a9035`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:18:18,540::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:18:18,540::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:18:18,540::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`abfafa26-86b4-4875-8435-53503d4a9035`::Granted request >Thread-34::DEBUG::2014-07-24 11:18:18,540::task::827::TaskManager.Task::(resourceAcquired) Task=`26b33cec-11c2-43a1-9357-519531f383e8`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:18:18,540::task::990::TaskManager.Task::(_decref) Task=`26b33cec-11c2-43a1-9357-519531f383e8`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:18:18,541::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:18:18,541::task::1185::TaskManager.Task::(prepare) Task=`26b33cec-11c2-43a1-9357-519531f383e8`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:18:18,541::task::595::TaskManager.Task::(_updateState) Task=`26b33cec-11c2-43a1-9357-519531f383e8`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:18:18,542::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:18:18,542::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:18:18,542::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:18:18,542::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:18:18,542::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:18:18,543::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:18:18,543::task::990::TaskManager.Task::(_decref) Task=`26b33cec-11c2-43a1-9357-519531f383e8`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:18:19,482::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:18:19,556::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348816 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:18:21,568::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:18:21,641::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344377 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:18:23,653::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:18:23,727::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034461 s, 29.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:18:25,006::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:18:25,015::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000690605 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:18:25,739::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:18:25,821::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03461 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:18:27,837::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:18:27,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356099 s, 28.8 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:18:28,613::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [22918c4c] >Thread-13::DEBUG::2014-07-24 11:18:28,625::task::595::TaskManager.Task::(_updateState) Task=`e89b1b42-bab9-49b5-a96c-4e027e77134c`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:18:28,625::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:18:28,625::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:18:28,625::task::1185::TaskManager.Task::(prepare) Task=`e89b1b42-bab9-49b5-a96c-4e027e77134c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:18:28,626::task::595::TaskManager.Task::(_updateState) Task=`e89b1b42-bab9-49b5-a96c-4e027e77134c`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:18:28,626::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:18:28,626::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:18:28,626::task::990::TaskManager.Task::(_decref) Task=`e89b1b42-bab9-49b5-a96c-4e027e77134c`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:18:28,664::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [22918c4c] >Thread-34::DEBUG::2014-07-24 11:18:28,664::task::595::TaskManager.Task::(_updateState) Task=`b259be6d-0d50-4157-a5a7-d53e366be4e6`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:18:28,665::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:18:28,665::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`287042ad-02ff-466c-bd89-f718fff6bbb8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:18:28,665::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:18:28,665::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:18:28,666::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`287042ad-02ff-466c-bd89-f718fff6bbb8`::Granted request >Thread-34::DEBUG::2014-07-24 11:18:28,666::task::827::TaskManager.Task::(resourceAcquired) Task=`b259be6d-0d50-4157-a5a7-d53e366be4e6`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:18:28,666::task::990::TaskManager.Task::(_decref) Task=`b259be6d-0d50-4157-a5a7-d53e366be4e6`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:18:28,667::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:18:28,667::task::1185::TaskManager.Task::(prepare) Task=`b259be6d-0d50-4157-a5a7-d53e366be4e6`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:18:28,667::task::595::TaskManager.Task::(_updateState) Task=`b259be6d-0d50-4157-a5a7-d53e366be4e6`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:18:28,667::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:18:28,668::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:18:28,668::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:18:28,668::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:18:28,668::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:18:28,668::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:18:28,668::task::990::TaskManager.Task::(_decref) Task=`b259be6d-0d50-4157-a5a7-d53e366be4e6`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-07-24 11:18:29,374::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-13::DEBUG::2014-07-24 11:18:29,728::task::595::TaskManager.Task::(_updateState) Task=`846fae74-4c9d-46b1-82be-ac97a0eae8d2`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:18:29,728::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:18:29,728::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000690605', 'lastCheck': '4.7', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:18:29,728::task::1185::TaskManager.Task::(prepare) Task=`846fae74-4c9d-46b1-82be-ac97a0eae8d2`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000690605', 'lastCheck': '4.7', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:18:29,728::task::595::TaskManager.Task::(_updateState) Task=`846fae74-4c9d-46b1-82be-ac97a0eae8d2`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:18:29,729::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:18:29,729::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:18:29,729::task::990::TaskManager.Task::(_decref) Task=`846fae74-4c9d-46b1-82be-ac97a0eae8d2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:18:29,925::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:18:30,000::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361641 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:18:32,012::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:18:32,085::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333351 s, 30.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:18:34,097::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:18:34,169::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330168 s, 31.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:18:35,020::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:18:35,030::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000658055 s, 6.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:18:36,181::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:18:36,255::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341113 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:18:38,267::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:18:38,339::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330649 s, 31.0 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:18:38,728::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:18:38,728::task::595::TaskManager.Task::(_updateState) Task=`266fa2ac-02bc-4a2c-a329-7c8811669ac3`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:18:38,729::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:18:38,729::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:18:38,729::task::1185::TaskManager.Task::(prepare) Task=`266fa2ac-02bc-4a2c-a329-7c8811669ac3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:18:38,729::task::595::TaskManager.Task::(_updateState) Task=`266fa2ac-02bc-4a2c-a329-7c8811669ac3`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:18:38,730::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:18:38,730::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:18:38,730::task::990::TaskManager.Task::(_decref) Task=`266fa2ac-02bc-4a2c-a329-7c8811669ac3`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:18:38,761::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:18:38,761::task::595::TaskManager.Task::(_updateState) Task=`30b66590-b56e-4ccf-9687-b1171b5625bb`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:18:38,762::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:18:38,762::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`61a24402-b9e2-4ce7-a725-128f6d855819`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:18:38,762::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:18:38,762::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:18:38,763::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`61a24402-b9e2-4ce7-a725-128f6d855819`::Granted request >Thread-34::DEBUG::2014-07-24 11:18:38,763::task::827::TaskManager.Task::(resourceAcquired) Task=`30b66590-b56e-4ccf-9687-b1171b5625bb`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:18:38,763::task::990::TaskManager.Task::(_decref) Task=`30b66590-b56e-4ccf-9687-b1171b5625bb`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:18:38,764::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:18:38,764::task::1185::TaskManager.Task::(prepare) Task=`30b66590-b56e-4ccf-9687-b1171b5625bb`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:18:38,764::task::595::TaskManager.Task::(_updateState) Task=`30b66590-b56e-4ccf-9687-b1171b5625bb`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:18:38,764::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:18:38,764::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:18:38,765::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:18:38,765::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:18:38,765::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:18:38,765::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:18:38,765::task::990::TaskManager.Task::(_decref) Task=`30b66590-b56e-4ccf-9687-b1171b5625bb`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:18:40,352::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:18:40,425::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034037 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:18:42,438::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:18:42,512::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350694 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:18:44,525::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:18:44,600::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358097 s, 28.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:18:45,035::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:18:45,044::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000633056 s, 6.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:18:45,094::task::595::TaskManager.Task::(_updateState) Task=`ecaf477c-5603-4fa6-9310-dc192c23c498`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:18:45,095::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:18:45,095::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000633056', 'lastCheck': '0.0', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:18:45,095::task::1185::TaskManager.Task::(prepare) Task=`ecaf477c-5603-4fa6-9310-dc192c23c498`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000633056', 'lastCheck': '0.0', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:18:45,095::task::595::TaskManager.Task::(_updateState) Task=`ecaf477c-5603-4fa6-9310-dc192c23c498`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:18:45,095::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:18:45,096::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:18:45,096::task::990::TaskManager.Task::(_decref) Task=`ecaf477c-5603-4fa6-9310-dc192c23c498`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:18:46,612::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:18:46,685::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344451 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:18:48,697::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:18:48,770::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339665 s, 30.1 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:18:48,822::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [3b38bf98] >Thread-13::DEBUG::2014-07-24 11:18:48,823::task::595::TaskManager.Task::(_updateState) Task=`e4dc5954-59aa-401b-b9e7-b4086b55bb2f`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:18:48,823::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:18:48,824::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:18:48,824::task::1185::TaskManager.Task::(prepare) Task=`e4dc5954-59aa-401b-b9e7-b4086b55bb2f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:18:48,824::task::595::TaskManager.Task::(_updateState) Task=`e4dc5954-59aa-401b-b9e7-b4086b55bb2f`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:18:48,824::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:18:48,824::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:18:48,824::task::990::TaskManager.Task::(_decref) Task=`e4dc5954-59aa-401b-b9e7-b4086b55bb2f`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:18:48,856::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [3b38bf98] >Thread-34::DEBUG::2014-07-24 11:18:48,856::task::595::TaskManager.Task::(_updateState) Task=`57b9b582-bf67-4e90-a751-08a7d3583ae0`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:18:48,857::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:18:48,857::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`44eb28dd-343e-46bc-a195-355c0d403f7f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:18:48,857::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:18:48,857::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:18:48,858::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`44eb28dd-343e-46bc-a195-355c0d403f7f`::Granted request >Thread-34::DEBUG::2014-07-24 11:18:48,858::task::827::TaskManager.Task::(resourceAcquired) Task=`57b9b582-bf67-4e90-a751-08a7d3583ae0`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:18:48,858::task::990::TaskManager.Task::(_decref) Task=`57b9b582-bf67-4e90-a751-08a7d3583ae0`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:18:48,859::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:18:48,859::task::1185::TaskManager.Task::(prepare) Task=`57b9b582-bf67-4e90-a751-08a7d3583ae0`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:18:48,859::task::595::TaskManager.Task::(_updateState) Task=`57b9b582-bf67-4e90-a751-08a7d3583ae0`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:18:48,859::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:18:48,859::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:18:48,860::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:18:48,860::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:18:48,860::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:18:48,860::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:18:48,860::task::990::TaskManager.Task::(_decref) Task=`57b9b582-bf67-4e90-a751-08a7d3583ae0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:18:50,783::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:18:50,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346534 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:18:52,869::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:18:53,225::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.316838 s, 3.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:18:55,049::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:18:55,058::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000659199 s, 6.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:18:55,237::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:18:55,310::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328865 s, 31.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:18:57,322::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:18:57,396::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338818 s, 30.2 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:18:58,916::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:18:58,916::task::595::TaskManager.Task::(_updateState) Task=`b292da73-6c2a-4ebc-b8de-ef2576689f7f`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:18:58,916::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:18:58,917::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:18:58,917::task::1185::TaskManager.Task::(prepare) Task=`b292da73-6c2a-4ebc-b8de-ef2576689f7f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:18:58,917::task::595::TaskManager.Task::(_updateState) Task=`b292da73-6c2a-4ebc-b8de-ef2576689f7f`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:18:58,917::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:18:58,917::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:18:58,917::task::990::TaskManager.Task::(_decref) Task=`b292da73-6c2a-4ebc-b8de-ef2576689f7f`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:18:58,982::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:18:58,982::task::595::TaskManager.Task::(_updateState) Task=`de6e31ca-c502-45af-9944-8c235818be0a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:18:58,982::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:18:58,983::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c584c9d2-a237-414d-8ea9-3ba90be77ae1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:18:58,983::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:18:58,983::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:18:58,983::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c584c9d2-a237-414d-8ea9-3ba90be77ae1`::Granted request >Thread-34::DEBUG::2014-07-24 11:18:58,984::task::827::TaskManager.Task::(resourceAcquired) Task=`de6e31ca-c502-45af-9944-8c235818be0a`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:18:58,984::task::990::TaskManager.Task::(_decref) Task=`de6e31ca-c502-45af-9944-8c235818be0a`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:18:58,984::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:18:58,985::task::1185::TaskManager.Task::(prepare) Task=`de6e31ca-c502-45af-9944-8c235818be0a`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:18:58,985::task::595::TaskManager.Task::(_updateState) Task=`de6e31ca-c502-45af-9944-8c235818be0a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:18:58,985::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:18:58,985::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:18:58,985::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:18:58,986::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:18:58,986::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:18:58,986::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:18:58,986::task::990::TaskManager.Task::(_decref) Task=`de6e31ca-c502-45af-9944-8c235818be0a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:18:59,408::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >VM Channels Listener::DEBUG::2014-07-24 11:18:59,416::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:18:59,481::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341712 s, 30.0 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:19:00,501::task::595::TaskManager.Task::(_updateState) Task=`cf9336d4-31cc-488e-afb2-5f2f2676c792`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:19:00,501::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:19:00,502::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000659199', 'lastCheck': '5.4', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:19:00,502::task::1185::TaskManager.Task::(prepare) Task=`cf9336d4-31cc-488e-afb2-5f2f2676c792`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000659199', 'lastCheck': '5.4', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:19:00,502::task::595::TaskManager.Task::(_updateState) Task=`cf9336d4-31cc-488e-afb2-5f2f2676c792`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:19:00,502::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:19:00,502::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:19:00,502::task::990::TaskManager.Task::(_decref) Task=`cf9336d4-31cc-488e-afb2-5f2f2676c792`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:19:01,493::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:19:01,569::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339102 s, 30.2 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:19:03,550::task::595::TaskManager.Task::(_updateState) Task=`18d9228b-ecc4-4962-acc5-ef10a5505165`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:19:03,550::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:19:03,551::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:19:03,551::task::1185::TaskManager.Task::(prepare) Task=`18d9228b-ecc4-4962-acc5-ef10a5505165`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:19:03,551::task::595::TaskManager.Task::(_updateState) Task=`18d9228b-ecc4-4962-acc5-ef10a5505165`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:19:03,551::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:19:03,551::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:19:03,552::task::990::TaskManager.Task::(_decref) Task=`18d9228b-ecc4-4962-acc5-ef10a5505165`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:19:03,581::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:19:03,655::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344548 s, 29.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:19:05,063::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:19:05,073::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000731128 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:19:05,667::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:19:05,979::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359938 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:19:07,991::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:19:08,343::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.31278 s, 3.3 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:19:09,053::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:19:09,054::task::595::TaskManager.Task::(_updateState) Task=`79be1c2d-933d-47dc-be82-b3a14248228e`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:19:09,054::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:19:09,054::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:19:09,055::task::1185::TaskManager.Task::(prepare) Task=`79be1c2d-933d-47dc-be82-b3a14248228e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:19:09,055::task::595::TaskManager.Task::(_updateState) Task=`79be1c2d-933d-47dc-be82-b3a14248228e`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:19:09,055::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:19:09,055::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:19:09,055::task::990::TaskManager.Task::(_decref) Task=`79be1c2d-933d-47dc-be82-b3a14248228e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:19:09,099::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:19:09,099::task::595::TaskManager.Task::(_updateState) Task=`ffbd265b-2f2b-48fe-b4b1-f166673bf7a0`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:19:09,099::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:19:09,100::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`bf2e712a-c073-4cef-919d-4da7381e0efb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:19:09,100::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:19:09,100::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:19:09,100::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`bf2e712a-c073-4cef-919d-4da7381e0efb`::Granted request >Thread-34::DEBUG::2014-07-24 11:19:09,101::task::827::TaskManager.Task::(resourceAcquired) Task=`ffbd265b-2f2b-48fe-b4b1-f166673bf7a0`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:19:09,101::task::990::TaskManager.Task::(_decref) Task=`ffbd265b-2f2b-48fe-b4b1-f166673bf7a0`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:19:09,102::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:19:09,102::task::1185::TaskManager.Task::(prepare) Task=`ffbd265b-2f2b-48fe-b4b1-f166673bf7a0`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:19:09,102::task::595::TaskManager.Task::(_updateState) Task=`ffbd265b-2f2b-48fe-b4b1-f166673bf7a0`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:19:09,102::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:19:09,103::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:19:09,103::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:19:09,103::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:19:09,103::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:19:09,103::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:19:09,104::task::990::TaskManager.Task::(_decref) Task=`ffbd265b-2f2b-48fe-b4b1-f166673bf7a0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:19:10,355::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:19:10,430::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357318 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:19:12,443::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:19:12,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0409516 s, 25.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:19:14,536::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:19:14,612::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372958 s, 27.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:19:15,078::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:19:15,105::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0184747 s, 222 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:19:15,906::task::595::TaskManager.Task::(_updateState) Task=`262e9720-ed50-4fdc-9434-cec5e942c6d1`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:19:15,906::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:19:15,907::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0184747', 'lastCheck': '0.8', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:19:15,907::task::1185::TaskManager.Task::(prepare) Task=`262e9720-ed50-4fdc-9434-cec5e942c6d1`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0184747', 'lastCheck': '0.8', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:19:15,907::task::595::TaskManager.Task::(_updateState) Task=`262e9720-ed50-4fdc-9434-cec5e942c6d1`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:19:15,907::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:19:15,907::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:19:15,907::task::990::TaskManager.Task::(_decref) Task=`262e9720-ed50-4fdc-9434-cec5e942c6d1`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:19:16,625::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:19:16,700::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364774 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:19:18,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:19:18,786::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345658 s, 29.6 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:19:19,169::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:19:19,170::task::595::TaskManager.Task::(_updateState) Task=`e4dc0b02-2ab0-4016-a3f3-20704721412b`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:19:19,170::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:19:19,171::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:19:19,171::task::1185::TaskManager.Task::(prepare) Task=`e4dc0b02-2ab0-4016-a3f3-20704721412b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:19:19,171::task::595::TaskManager.Task::(_updateState) Task=`e4dc0b02-2ab0-4016-a3f3-20704721412b`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:19:19,171::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:19:19,171::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:19:19,171::task::990::TaskManager.Task::(_decref) Task=`e4dc0b02-2ab0-4016-a3f3-20704721412b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:19:19,233::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:19:19,234::task::595::TaskManager.Task::(_updateState) Task=`c72d4b57-4c53-4aec-8000-44901982fbcd`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:19:19,234::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:19:19,234::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`bcdf284e-4f38-4df6-a0bc-eac5db8118d4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:19:19,234::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:19:19,235::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:19:19,235::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`bcdf284e-4f38-4df6-a0bc-eac5db8118d4`::Granted request >Thread-34::DEBUG::2014-07-24 11:19:19,235::task::827::TaskManager.Task::(resourceAcquired) Task=`c72d4b57-4c53-4aec-8000-44901982fbcd`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:19:19,235::task::990::TaskManager.Task::(_decref) Task=`c72d4b57-4c53-4aec-8000-44901982fbcd`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:19:19,236::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:19:19,236::task::1185::TaskManager.Task::(prepare) Task=`c72d4b57-4c53-4aec-8000-44901982fbcd`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:19:19,237::task::595::TaskManager.Task::(_updateState) Task=`c72d4b57-4c53-4aec-8000-44901982fbcd`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:19:19,237::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:19:19,237::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:19:19,237::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:19:19,237::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:19:19,238::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:19:19,238::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:19:19,238::task::990::TaskManager.Task::(_decref) Task=`c72d4b57-4c53-4aec-8000-44901982fbcd`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:19:20,798::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:19:21,154::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.317374 s, 3.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:19:23,167::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:19:23,255::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339169 s, 30.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:19:25,110::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:19:25,120::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000707941 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:19:25,267::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:19:25,345::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0390491 s, 26.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:19:27,358::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:19:27,433::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344144 s, 29.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:19:29,292::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [12b68a95] >Thread-14::DEBUG::2014-07-24 11:19:29,293::task::595::TaskManager.Task::(_updateState) Task=`b55b7477-2292-41eb-bed4-d6a2508da174`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:19:29,293::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:19:29,293::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:19:29,294::task::1185::TaskManager.Task::(prepare) Task=`b55b7477-2292-41eb-bed4-d6a2508da174`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:19:29,294::task::595::TaskManager.Task::(_updateState) Task=`b55b7477-2292-41eb-bed4-d6a2508da174`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:19:29,294::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:19:29,294::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:19:29,294::task::990::TaskManager.Task::(_decref) Task=`b55b7477-2292-41eb-bed4-d6a2508da174`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:19:29,328::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [12b68a95] >Thread-34::DEBUG::2014-07-24 11:19:29,328::task::595::TaskManager.Task::(_updateState) Task=`1c481bd2-386b-4065-b101-15bc1822ff75`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:19:29,329::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:19:29,329::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`5a1df321-428e-46b1-9065-46292bba7f1b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:19:29,329::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:19:29,329::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:19:29,330::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`5a1df321-428e-46b1-9065-46292bba7f1b`::Granted request >Thread-34::DEBUG::2014-07-24 11:19:29,330::task::827::TaskManager.Task::(resourceAcquired) Task=`1c481bd2-386b-4065-b101-15bc1822ff75`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:19:29,330::task::990::TaskManager.Task::(_decref) Task=`1c481bd2-386b-4065-b101-15bc1822ff75`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:19:29,331::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:19:29,331::task::1185::TaskManager.Task::(prepare) Task=`1c481bd2-386b-4065-b101-15bc1822ff75`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:19:29,331::task::595::TaskManager.Task::(_updateState) Task=`1c481bd2-386b-4065-b101-15bc1822ff75`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:19:29,331::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:19:29,331::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:19:29,332::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:19:29,332::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:19:29,332::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:19:29,332::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:19:29,332::task::990::TaskManager.Task::(_decref) Task=`1c481bd2-386b-4065-b101-15bc1822ff75`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:19:29,446::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >VM Channels Listener::DEBUG::2014-07-24 11:19:29,454::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:19:29,520::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351233 s, 29.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:19:31,369::task::595::TaskManager.Task::(_updateState) Task=`3db89ed3-dbdf-4ff3-9932-097a60b9f352`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:19:31,370::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:19:31,370::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000707941', 'lastCheck': '6.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:19:31,370::task::1185::TaskManager.Task::(prepare) Task=`3db89ed3-dbdf-4ff3-9932-097a60b9f352`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000707941', 'lastCheck': '6.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:19:31,370::task::595::TaskManager.Task::(_updateState) Task=`3db89ed3-dbdf-4ff3-9932-097a60b9f352`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:19:31,370::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:19:31,371::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:19:31,371::task::990::TaskManager.Task::(_decref) Task=`3db89ed3-dbdf-4ff3-9932-097a60b9f352`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:19:31,532::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:19:31,614::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0407654 s, 25.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:19:33,626::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:19:33,703::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0374331 s, 27.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:19:35,125::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:19:35,139::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00502944 s, 814 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:19:35,715::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:19:35,788::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339032 s, 30.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:19:37,801::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:19:37,878::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372202 s, 27.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:19:39,391::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:19:39,392::task::595::TaskManager.Task::(_updateState) Task=`dacb1352-c929-4e67-b3eb-b461f7e243c1`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:19:39,392::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:19:39,392::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:19:39,393::task::1185::TaskManager.Task::(prepare) Task=`dacb1352-c929-4e67-b3eb-b461f7e243c1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:19:39,393::task::595::TaskManager.Task::(_updateState) Task=`dacb1352-c929-4e67-b3eb-b461f7e243c1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:19:39,393::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:19:39,393::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:19:39,393::task::990::TaskManager.Task::(_decref) Task=`dacb1352-c929-4e67-b3eb-b461f7e243c1`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:19:39,426::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:19:39,426::task::595::TaskManager.Task::(_updateState) Task=`cfc6ce1b-4dfc-4e74-9267-420dc2da9009`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:19:39,427::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:19:39,427::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`fd27c2dd-2206-4c9d-af4d-728dfe378e59`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:19:39,427::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:19:39,427::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:19:39,428::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`fd27c2dd-2206-4c9d-af4d-728dfe378e59`::Granted request >Thread-34::DEBUG::2014-07-24 11:19:39,428::task::827::TaskManager.Task::(resourceAcquired) Task=`cfc6ce1b-4dfc-4e74-9267-420dc2da9009`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:19:39,428::task::990::TaskManager.Task::(_decref) Task=`cfc6ce1b-4dfc-4e74-9267-420dc2da9009`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:19:39,429::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:19:39,429::task::1185::TaskManager.Task::(prepare) Task=`cfc6ce1b-4dfc-4e74-9267-420dc2da9009`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:19:39,429::task::595::TaskManager.Task::(_updateState) Task=`cfc6ce1b-4dfc-4e74-9267-420dc2da9009`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:19:39,430::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:19:39,430::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:19:39,430::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:19:39,430::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:19:39,430::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:19:39,430::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:19:39,431::task::990::TaskManager.Task::(_decref) Task=`cfc6ce1b-4dfc-4e74-9267-420dc2da9009`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:19:39,890::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:19:39,964::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343556 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:19:41,977::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:19:42,051::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354354 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:19:44,063::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:19:44,136::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337704 s, 30.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:19:45,144::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:19:45,153::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000673202 s, 6.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:19:46,148::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:19:46,221::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333137 s, 30.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:19:46,736::task::595::TaskManager.Task::(_updateState) Task=`812ed910-d049-4dd8-9009-28df798f3984`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:19:46,737::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:19:46,737::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000673202', 'lastCheck': '1.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:19:46,737::task::1185::TaskManager.Task::(prepare) Task=`812ed910-d049-4dd8-9009-28df798f3984`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000673202', 'lastCheck': '1.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:19:46,737::task::595::TaskManager.Task::(_updateState) Task=`812ed910-d049-4dd8-9009-28df798f3984`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:19:46,737::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:19:46,737::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:19:46,738::task::990::TaskManager.Task::(_decref) Task=`812ed910-d049-4dd8-9009-28df798f3984`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:19:48,233::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:19:48,309::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355295 s, 28.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:19:49,497::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [21656b69] >Thread-14::DEBUG::2014-07-24 11:19:49,497::task::595::TaskManager.Task::(_updateState) Task=`d73352a5-9e95-4ff2-8255-4c52e62f712b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:19:49,497::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:19:49,498::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:19:49,498::task::1185::TaskManager.Task::(prepare) Task=`d73352a5-9e95-4ff2-8255-4c52e62f712b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:19:49,498::task::595::TaskManager.Task::(_updateState) Task=`d73352a5-9e95-4ff2-8255-4c52e62f712b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:19:49,498::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:19:49,498::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:19:49,498::task::990::TaskManager.Task::(_decref) Task=`d73352a5-9e95-4ff2-8255-4c52e62f712b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:19:49,541::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [21656b69] >Thread-34::DEBUG::2014-07-24 11:19:49,541::task::595::TaskManager.Task::(_updateState) Task=`77d8c061-f31a-48a2-907a-f6460ae49972`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:19:49,541::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:19:49,541::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`3f3e3ccc-f254-49b5-9063-cbfbe21f0eb1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:19:49,542::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:19:49,542::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:19:49,542::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`3f3e3ccc-f254-49b5-9063-cbfbe21f0eb1`::Granted request >Thread-34::DEBUG::2014-07-24 11:19:49,542::task::827::TaskManager.Task::(resourceAcquired) Task=`77d8c061-f31a-48a2-907a-f6460ae49972`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:19:49,543::task::990::TaskManager.Task::(_decref) Task=`77d8c061-f31a-48a2-907a-f6460ae49972`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:19:49,543::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:19:49,543::task::1185::TaskManager.Task::(prepare) Task=`77d8c061-f31a-48a2-907a-f6460ae49972`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:19:49,544::task::595::TaskManager.Task::(_updateState) Task=`77d8c061-f31a-48a2-907a-f6460ae49972`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:19:49,544::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:19:49,544::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:19:49,544::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:19:49,544::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:19:49,545::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:19:49,545::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:19:49,545::task::990::TaskManager.Task::(_decref) Task=`77d8c061-f31a-48a2-907a-f6460ae49972`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:19:50,321::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:19:50,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352709 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:19:52,407::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:19:52,480::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340025 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:19:54,493::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:19:54,565::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332615 s, 30.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:19:55,158::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:19:55,173::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00587164 s, 698 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:19:56,577::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:19:56,651::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345566 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:19:58,664::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:19:58,737::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341666 s, 30.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:19:59,491::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-14::DEBUG::2014-07-24 11:19:59,614::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:19:59,615::task::595::TaskManager.Task::(_updateState) Task=`e581e5be-4b1d-4804-b525-3e4d6609a7dd`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:19:59,615::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:19:59,615::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:19:59,615::task::1185::TaskManager.Task::(prepare) Task=`e581e5be-4b1d-4804-b525-3e4d6609a7dd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:19:59,616::task::595::TaskManager.Task::(_updateState) Task=`e581e5be-4b1d-4804-b525-3e4d6609a7dd`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:19:59,616::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:19:59,616::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:19:59,616::task::990::TaskManager.Task::(_decref) Task=`e581e5be-4b1d-4804-b525-3e4d6609a7dd`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:19:59,656::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:19:59,657::task::595::TaskManager.Task::(_updateState) Task=`214148d0-921c-4ec1-8f66-509e0fc9c52e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:19:59,657::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:19:59,657::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d885b5fd-a958-485c-91c7-f79549387585`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:19:59,657::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:19:59,658::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:19:59,658::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d885b5fd-a958-485c-91c7-f79549387585`::Granted request >Thread-34::DEBUG::2014-07-24 11:19:59,658::task::827::TaskManager.Task::(resourceAcquired) Task=`214148d0-921c-4ec1-8f66-509e0fc9c52e`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:19:59,658::task::990::TaskManager.Task::(_decref) Task=`214148d0-921c-4ec1-8f66-509e0fc9c52e`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:19:59,659::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:19:59,659::task::1185::TaskManager.Task::(prepare) Task=`214148d0-921c-4ec1-8f66-509e0fc9c52e`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:19:59,659::task::595::TaskManager.Task::(_updateState) Task=`214148d0-921c-4ec1-8f66-509e0fc9c52e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:19:59,660::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:19:59,660::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:19:59,660::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:19:59,660::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:19:59,660::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:19:59,661::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:19:59,661::task::990::TaskManager.Task::(_decref) Task=`214148d0-921c-4ec1-8f66-509e0fc9c52e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:20:00,749::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:20:00,823::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343598 s, 29.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:20:02,208::task::595::TaskManager.Task::(_updateState) Task=`39bd9ed1-2894-4707-a71b-7436792299b3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:20:02,209::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:20:02,209::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00587164', 'lastCheck': '7.0', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:20:02,209::task::1185::TaskManager.Task::(prepare) Task=`39bd9ed1-2894-4707-a71b-7436792299b3`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00587164', 'lastCheck': '7.0', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:20:02,209::task::595::TaskManager.Task::(_updateState) Task=`39bd9ed1-2894-4707-a71b-7436792299b3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:20:02,209::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:20:02,210::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:20:02,210::task::990::TaskManager.Task::(_decref) Task=`39bd9ed1-2894-4707-a71b-7436792299b3`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:20:02,836::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:20:02,909::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341927 s, 29.9 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:20:03,734::task::595::TaskManager.Task::(_updateState) Task=`e85aa4ca-3be2-437c-984b-dc84b5499ace`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:20:03,735::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:20:03,735::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:20:03,735::task::1185::TaskManager.Task::(prepare) Task=`e85aa4ca-3be2-437c-984b-dc84b5499ace`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:20:03,735::task::595::TaskManager.Task::(_updateState) Task=`e85aa4ca-3be2-437c-984b-dc84b5499ace`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:20:03,736::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:20:03,736::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:20:03,736::task::990::TaskManager.Task::(_decref) Task=`e85aa4ca-3be2-437c-984b-dc84b5499ace`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:20:04,921::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:20:04,996::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342736 s, 29.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:20:05,178::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:20:05,188::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000738524 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:20:07,008::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:20:07,082::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348753 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:20:09,095::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:20:09,169::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348259 s, 29.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:20:09,728::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:20:09,728::task::595::TaskManager.Task::(_updateState) Task=`bfc01dbc-2358-4a57-a290-77d09693a44f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:20:09,729::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:20:09,729::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:20:09,729::task::1185::TaskManager.Task::(prepare) Task=`bfc01dbc-2358-4a57-a290-77d09693a44f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:20:09,729::task::595::TaskManager.Task::(_updateState) Task=`bfc01dbc-2358-4a57-a290-77d09693a44f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:20:09,730::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:20:09,730::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:20:09,730::task::990::TaskManager.Task::(_decref) Task=`bfc01dbc-2358-4a57-a290-77d09693a44f`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:20:09,763::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:20:09,763::task::595::TaskManager.Task::(_updateState) Task=`0f8ccd70-fb42-4c88-9333-773b6174e10a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:20:09,764::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:20:09,764::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1a2f4227-8ca9-460b-93d7-573cf66141a4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:20:09,764::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:20:09,764::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:20:09,764::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1a2f4227-8ca9-460b-93d7-573cf66141a4`::Granted request >Thread-34::DEBUG::2014-07-24 11:20:09,765::task::827::TaskManager.Task::(resourceAcquired) Task=`0f8ccd70-fb42-4c88-9333-773b6174e10a`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:20:09,765::task::990::TaskManager.Task::(_decref) Task=`0f8ccd70-fb42-4c88-9333-773b6174e10a`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:20:09,766::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:20:09,766::task::1185::TaskManager.Task::(prepare) Task=`0f8ccd70-fb42-4c88-9333-773b6174e10a`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:20:09,766::task::595::TaskManager.Task::(_updateState) Task=`0f8ccd70-fb42-4c88-9333-773b6174e10a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:20:09,766::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:20:09,766::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:20:09,767::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:20:09,767::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:20:09,767::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:20:09,767::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:20:09,767::task::990::TaskManager.Task::(_decref) Task=`0f8ccd70-fb42-4c88-9333-773b6174e10a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:20:11,181::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:20:11,257::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357161 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:20:13,269::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:20:13,345::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361005 s, 28.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:20:15,192::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:20:15,202::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000690312 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:20:15,357::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:20:15,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343441 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:20:17,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:20:17,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0404936 s, 25.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:20:17,579::task::595::TaskManager.Task::(_updateState) Task=`ead6fabe-09fe-448e-b214-0645db059690`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:20:17,579::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:20:17,579::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000690312', 'lastCheck': '2.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:20:17,580::task::1185::TaskManager.Task::(prepare) Task=`ead6fabe-09fe-448e-b214-0645db059690`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000690312', 'lastCheck': '2.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:20:17,580::task::595::TaskManager.Task::(_updateState) Task=`ead6fabe-09fe-448e-b214-0645db059690`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:20:17,580::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:20:17,580::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:20:17,580::task::990::TaskManager.Task::(_decref) Task=`ead6fabe-09fe-448e-b214-0645db059690`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:20:19,562::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:20:19,634::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337195 s, 30.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:20:19,860::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:20:19,861::task::595::TaskManager.Task::(_updateState) Task=`0e74c5a1-2162-4a28-bf2b-e5d291424a63`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:20:19,861::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:20:19,862::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:20:19,862::task::1185::TaskManager.Task::(prepare) Task=`0e74c5a1-2162-4a28-bf2b-e5d291424a63`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:20:19,862::task::595::TaskManager.Task::(_updateState) Task=`0e74c5a1-2162-4a28-bf2b-e5d291424a63`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:20:19,862::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:20:19,862::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:20:19,862::task::990::TaskManager.Task::(_decref) Task=`0e74c5a1-2162-4a28-bf2b-e5d291424a63`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:20:19,909::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:20:19,909::task::595::TaskManager.Task::(_updateState) Task=`baf94894-0246-49a8-9226-ddc85f51ad00`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:20:19,910::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:20:19,910::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`2bc003b9-2e18-4629-a317-5dccc5f595b8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:20:19,910::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:20:19,910::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:20:19,911::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`2bc003b9-2e18-4629-a317-5dccc5f595b8`::Granted request >Thread-34::DEBUG::2014-07-24 11:20:19,911::task::827::TaskManager.Task::(resourceAcquired) Task=`baf94894-0246-49a8-9226-ddc85f51ad00`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:20:19,911::task::990::TaskManager.Task::(_decref) Task=`baf94894-0246-49a8-9226-ddc85f51ad00`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:20:19,912::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:20:19,912::task::1185::TaskManager.Task::(prepare) Task=`baf94894-0246-49a8-9226-ddc85f51ad00`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:20:19,912::task::595::TaskManager.Task::(_updateState) Task=`baf94894-0246-49a8-9226-ddc85f51ad00`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:20:19,912::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:20:19,912::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:20:19,913::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:20:19,913::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:20:19,913::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:20:19,913::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:20:19,913::task::990::TaskManager.Task::(_decref) Task=`baf94894-0246-49a8-9226-ddc85f51ad00`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:20:21,647::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:20:21,719::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331213 s, 30.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:20:23,731::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:20:23,805::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339243 s, 30.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:20:25,208::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:20:25,217::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000750701 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:20:25,826::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:20:26,476::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.36649 s, 2.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:20:28,488::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:20:28,561::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334563 s, 30.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:20:29,527::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-14::DEBUG::2014-07-24 11:20:29,992::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:20:29,993::task::595::TaskManager.Task::(_updateState) Task=`9b78c399-1e97-4075-beab-d2c495a19bcb`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:20:29,993::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:20:29,993::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:20:29,993::task::1185::TaskManager.Task::(prepare) Task=`9b78c399-1e97-4075-beab-d2c495a19bcb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:20:29,994::task::595::TaskManager.Task::(_updateState) Task=`9b78c399-1e97-4075-beab-d2c495a19bcb`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:20:29,994::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:20:29,994::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:20:29,994::task::990::TaskManager.Task::(_decref) Task=`9b78c399-1e97-4075-beab-d2c495a19bcb`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:20:30,031::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:20:30,031::task::595::TaskManager.Task::(_updateState) Task=`f0b968c7-bd8a-42bb-883a-869867775e18`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:20:30,031::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:20:30,032::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`261a0cd3-5509-48b7-8614-1b52044b715f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:20:30,032::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:20:30,032::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:20:30,032::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`261a0cd3-5509-48b7-8614-1b52044b715f`::Granted request >Thread-34::DEBUG::2014-07-24 11:20:30,033::task::827::TaskManager.Task::(resourceAcquired) Task=`f0b968c7-bd8a-42bb-883a-869867775e18`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:20:30,033::task::990::TaskManager.Task::(_decref) Task=`f0b968c7-bd8a-42bb-883a-869867775e18`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:20:30,034::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:20:30,034::task::1185::TaskManager.Task::(prepare) Task=`f0b968c7-bd8a-42bb-883a-869867775e18`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:20:30,034::task::595::TaskManager.Task::(_updateState) Task=`f0b968c7-bd8a-42bb-883a-869867775e18`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:20:30,034::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:20:30,034::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:20:30,035::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:20:30,035::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:20:30,035::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:20:30,035::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:20:30,035::task::990::TaskManager.Task::(_decref) Task=`f0b968c7-bd8a-42bb-883a-869867775e18`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:20:30,573::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:20:30,645::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329616 s, 31.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:20:32,657::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:20:32,882::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.186497 s, 5.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:20:33,120::task::595::TaskManager.Task::(_updateState) Task=`2da738dc-ac64-4bce-958e-c38b93ecb17d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:20:33,120::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:20:33,121::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000750701', 'lastCheck': '7.9', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:20:33,121::task::1185::TaskManager.Task::(prepare) Task=`2da738dc-ac64-4bce-958e-c38b93ecb17d`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000750701', 'lastCheck': '7.9', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:20:33,121::task::595::TaskManager.Task::(_updateState) Task=`2da738dc-ac64-4bce-958e-c38b93ecb17d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:20:33,121::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:20:33,121::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:20:33,122::task::990::TaskManager.Task::(_decref) Task=`2da738dc-ac64-4bce-958e-c38b93ecb17d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:20:34,895::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:20:34,968::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332105 s, 30.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:20:35,222::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:20:35,241::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.010659 s, 384 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:20:36,980::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:20:37,053::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342708 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:20:39,066::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:20:39,139::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342181 s, 29.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:20:40,127::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:20:40,128::task::595::TaskManager.Task::(_updateState) Task=`baec4c52-4eab-4db3-b498-3deeed1f84f2`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:20:40,128::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:20:40,128::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:20:40,128::task::1185::TaskManager.Task::(prepare) Task=`baec4c52-4eab-4db3-b498-3deeed1f84f2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:20:40,129::task::595::TaskManager.Task::(_updateState) Task=`baec4c52-4eab-4db3-b498-3deeed1f84f2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:20:40,129::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:20:40,129::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:20:40,129::task::990::TaskManager.Task::(_decref) Task=`baec4c52-4eab-4db3-b498-3deeed1f84f2`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:20:40,173::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:20:40,173::task::595::TaskManager.Task::(_updateState) Task=`959b60f7-e31a-4c90-8d56-142a4797543c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:20:40,173::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:20:40,174::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`94ac21ee-b11f-4eed-8413-7c341fa93cc6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:20:40,174::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:20:40,174::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:20:40,174::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`94ac21ee-b11f-4eed-8413-7c341fa93cc6`::Granted request >Thread-34::DEBUG::2014-07-24 11:20:40,174::task::827::TaskManager.Task::(resourceAcquired) Task=`959b60f7-e31a-4c90-8d56-142a4797543c`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:20:40,175::task::990::TaskManager.Task::(_decref) Task=`959b60f7-e31a-4c90-8d56-142a4797543c`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:20:40,175::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:20:40,176::task::1185::TaskManager.Task::(prepare) Task=`959b60f7-e31a-4c90-8d56-142a4797543c`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:20:40,176::task::595::TaskManager.Task::(_updateState) Task=`959b60f7-e31a-4c90-8d56-142a4797543c`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:20:40,176::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:20:40,176::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:20:40,176::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:20:40,176::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:20:40,177::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:20:40,177::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:20:40,177::task::990::TaskManager.Task::(_decref) Task=`959b60f7-e31a-4c90-8d56-142a4797543c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:20:41,152::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:20:41,227::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363803 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:20:43,239::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:20:43,313::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341343 s, 30.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:20:45,245::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:20:45,255::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000703169 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:20:45,325::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:20:45,398::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332898 s, 30.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:20:47,411::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:20:47,495::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0416403 s, 24.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:20:48,583::task::595::TaskManager.Task::(_updateState) Task=`55312322-4e23-4680-a300-2dea4195ebec`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:20:48,583::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:20:48,584::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000703169', 'lastCheck': '3.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:20:48,584::task::1185::TaskManager.Task::(prepare) Task=`55312322-4e23-4680-a300-2dea4195ebec`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000703169', 'lastCheck': '3.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:20:48,584::task::595::TaskManager.Task::(_updateState) Task=`55312322-4e23-4680-a300-2dea4195ebec`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:20:48,584::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:20:48,584::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:20:48,585::task::990::TaskManager.Task::(_decref) Task=`55312322-4e23-4680-a300-2dea4195ebec`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:20:49,507::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:20:49,581::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334801 s, 30.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:20:50,296::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:20:50,308::task::595::TaskManager.Task::(_updateState) Task=`f3e806eb-ec67-4b1e-a3f8-0d0e804bbffe`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:20:50,309::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:20:50,309::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:20:50,309::task::1185::TaskManager.Task::(prepare) Task=`f3e806eb-ec67-4b1e-a3f8-0d0e804bbffe`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:20:50,309::task::595::TaskManager.Task::(_updateState) Task=`f3e806eb-ec67-4b1e-a3f8-0d0e804bbffe`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:20:50,310::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:20:50,310::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:20:50,310::task::990::TaskManager.Task::(_decref) Task=`f3e806eb-ec67-4b1e-a3f8-0d0e804bbffe`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:20:50,388::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:20:50,389::task::595::TaskManager.Task::(_updateState) Task=`769740a2-459a-4fee-8b98-d52bb41e732e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:20:50,389::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:20:50,389::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f8d3a4d7-7cca-408d-97d8-0ceafcef2c98`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:20:50,389::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:20:50,390::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:20:50,390::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f8d3a4d7-7cca-408d-97d8-0ceafcef2c98`::Granted request >Thread-34::DEBUG::2014-07-24 11:20:50,390::task::827::TaskManager.Task::(resourceAcquired) Task=`769740a2-459a-4fee-8b98-d52bb41e732e`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:20:50,390::task::990::TaskManager.Task::(_decref) Task=`769740a2-459a-4fee-8b98-d52bb41e732e`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:20:50,391::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:20:50,391::task::1185::TaskManager.Task::(prepare) Task=`769740a2-459a-4fee-8b98-d52bb41e732e`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:20:50,391::task::595::TaskManager.Task::(_updateState) Task=`769740a2-459a-4fee-8b98-d52bb41e732e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:20:50,392::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:20:50,392::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:20:50,392::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:20:50,392::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:20:50,392::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:20:50,392::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:20:50,393::task::990::TaskManager.Task::(_decref) Task=`769740a2-459a-4fee-8b98-d52bb41e732e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:20:51,593::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:20:51,667::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340246 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:20:53,679::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:20:53,752::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033842 s, 30.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:20:55,260::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:20:55,275::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00577801 s, 709 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:20:55,765::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:20:55,841::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349466 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:20:57,853::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:20:57,928::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358462 s, 28.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:20:59,561::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:20:59,941::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:21:00,013::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331298 s, 30.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:21:00,532::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [4376fa5] >Thread-14::DEBUG::2014-07-24 11:21:00,532::task::595::TaskManager.Task::(_updateState) Task=`5296c096-0d45-4fe2-ac4f-769fb1f645d2`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:21:00,533::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:21:00,533::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:21:00,533::task::1185::TaskManager.Task::(prepare) Task=`5296c096-0d45-4fe2-ac4f-769fb1f645d2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:21:00,533::task::595::TaskManager.Task::(_updateState) Task=`5296c096-0d45-4fe2-ac4f-769fb1f645d2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:21:00,534::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:21:00,534::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:21:00,534::task::990::TaskManager.Task::(_decref) Task=`5296c096-0d45-4fe2-ac4f-769fb1f645d2`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:21:00,594::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [4376fa5] >Thread-34::DEBUG::2014-07-24 11:21:00,594::task::595::TaskManager.Task::(_updateState) Task=`7cc04f65-5a19-46ce-984f-6b91200d0805`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:21:00,594::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:21:00,595::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`a83ac9fa-bbaa-450a-b8ee-52ccb6025a49`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:21:00,595::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:21:00,595::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:21:00,595::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`a83ac9fa-bbaa-450a-b8ee-52ccb6025a49`::Granted request >Thread-34::DEBUG::2014-07-24 11:21:00,596::task::827::TaskManager.Task::(resourceAcquired) Task=`7cc04f65-5a19-46ce-984f-6b91200d0805`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:21:00,596::task::990::TaskManager.Task::(_decref) Task=`7cc04f65-5a19-46ce-984f-6b91200d0805`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:21:00,597::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:21:00,597::task::1185::TaskManager.Task::(prepare) Task=`7cc04f65-5a19-46ce-984f-6b91200d0805`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:21:00,597::task::595::TaskManager.Task::(_updateState) Task=`7cc04f65-5a19-46ce-984f-6b91200d0805`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:21:00,597::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:21:00,597::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:21:00,597::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:21:00,598::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:21:00,598::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:21:00,598::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:21:00,598::task::990::TaskManager.Task::(_decref) Task=`7cc04f65-5a19-46ce-984f-6b91200d0805`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:21:02,026::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:21:02,100::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352777 s, 29.0 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:21:03,894::task::595::TaskManager.Task::(_updateState) Task=`dcbf4570-4184-402b-88c8-3d52084e9d62`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:21:03,894::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:21:03,895::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:21:03,895::task::1185::TaskManager.Task::(prepare) Task=`dcbf4570-4184-402b-88c8-3d52084e9d62`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:21:03,895::task::595::TaskManager.Task::(_updateState) Task=`dcbf4570-4184-402b-88c8-3d52084e9d62`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:21:03,895::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:21:03,895::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:21:03,896::task::990::TaskManager.Task::(_decref) Task=`dcbf4570-4184-402b-88c8-3d52084e9d62`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:21:04,112::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:21:04,187::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354185 s, 28.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:21:04,478::task::595::TaskManager.Task::(_updateState) Task=`3a0172d4-d773-41e8-a8ae-f93d376b2571`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:21:04,478::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:21:04,478::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00577801', 'lastCheck': '9.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:21:04,478::task::1185::TaskManager.Task::(prepare) Task=`3a0172d4-d773-41e8-a8ae-f93d376b2571`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00577801', 'lastCheck': '9.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:21:04,478::task::595::TaskManager.Task::(_updateState) Task=`3a0172d4-d773-41e8-a8ae-f93d376b2571`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:21:04,479::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:21:04,479::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:21:04,479::task::990::TaskManager.Task::(_decref) Task=`3a0172d4-d773-41e8-a8ae-f93d376b2571`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:21:05,279::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:21:05,288::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000719493 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:21:06,199::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:21:06,273::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346481 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:21:08,286::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:21:08,359::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343654 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:21:10,371::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:21:10,445::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341981 s, 29.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:21:10,704::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:21:10,704::task::595::TaskManager.Task::(_updateState) Task=`395c3fd3-d117-4b3a-b3dc-1154b6dd5f9a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:21:10,705::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:21:10,705::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:21:10,705::task::1185::TaskManager.Task::(prepare) Task=`395c3fd3-d117-4b3a-b3dc-1154b6dd5f9a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:21:10,705::task::595::TaskManager.Task::(_updateState) Task=`395c3fd3-d117-4b3a-b3dc-1154b6dd5f9a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:21:10,706::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:21:10,706::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:21:10,706::task::990::TaskManager.Task::(_decref) Task=`395c3fd3-d117-4b3a-b3dc-1154b6dd5f9a`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:21:10,765::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:21:10,765::task::595::TaskManager.Task::(_updateState) Task=`6698eddb-52f0-4a13-a310-8879443183eb`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:21:10,765::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:21:10,766::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`47f900f7-ed12-45f1-a208-f4722f61398a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:21:10,766::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:21:10,766::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:21:10,766::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`47f900f7-ed12-45f1-a208-f4722f61398a`::Granted request >Thread-34::DEBUG::2014-07-24 11:21:10,767::task::827::TaskManager.Task::(resourceAcquired) Task=`6698eddb-52f0-4a13-a310-8879443183eb`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:21:10,767::task::990::TaskManager.Task::(_decref) Task=`6698eddb-52f0-4a13-a310-8879443183eb`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:21:10,768::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:21:10,768::task::1185::TaskManager.Task::(prepare) Task=`6698eddb-52f0-4a13-a310-8879443183eb`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:21:10,768::task::595::TaskManager.Task::(_updateState) Task=`6698eddb-52f0-4a13-a310-8879443183eb`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:21:10,768::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:21:10,768::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:21:10,769::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:21:10,769::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:21:10,769::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:21:10,769::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:21:10,769::task::990::TaskManager.Task::(_decref) Task=`6698eddb-52f0-4a13-a310-8879443183eb`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:21:12,457::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:21:12,532::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348533 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:21:14,544::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:21:14,619::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357017 s, 28.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:21:15,293::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 23aa0606-edc3-4882-a4aa-18aa1983458f >Thread-18::DEBUG::2014-07-24 11:21:15,293::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-18::DEBUG::2014-07-24 11:21:15,294::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:21:15,309::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.0063905 s, 320 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:21:15,309::misc::264::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.0063905 s, 320 kB/s'], size: 2048 >Thread-18::DEBUG::2014-07-24 11:21:15,309::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-18::WARNING::2014-07-24 11:21:15,309::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-18::DEBUG::2014-07-24 11:21:15,310::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-18::DEBUG::2014-07-24 11:21:15,310::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 11:21:15,310::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 11:21:15,311::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 11:21:15,311::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 11:21:15,311::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 11:21:15,312::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-18::DEBUG::2014-07-24 11:21:15,538::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:21:15,540::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 11:21:15,540::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'LOCKPOLICY=', 'POOL_DOMAINS=23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'POOL_DESCRIPTION=DS1', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_UUID=637ea13c-81a8-4b44-8cab-961458b01883', 'POOL_SPM_ID=1', '_SHA_CKSUM=a749afdc7119a2d6aad840af5c63c9b28c0b612c', 'POOL_SPM_LVER=0'] >Thread-18::INFO::2014-07-24 11:21:15,541::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_imageNS already registered >Thread-18::INFO::2014-07-24 11:21:15,541::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_volumeNS already registered >Thread-18::INFO::2014-07-24 11:21:15,541::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_lvmActivationNS already registered >Thread-18::DEBUG::2014-07-24 11:21:15,542::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-18::DEBUG::2014-07-24 11:21:15,701::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:21:15,701::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:21:15,711::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000785135 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:21:16,631::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:21:16,705::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349203 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:21:18,718::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:21:18,790::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033272 s, 30.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:21:20,074::task::595::TaskManager.Task::(_updateState) Task=`15a67fc9-34ab-4b93-a582-a4bd1c6e353f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:21:20,074::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:21:20,074::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000785135', 'lastCheck': '4.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:21:20,074::task::1185::TaskManager.Task::(prepare) Task=`15a67fc9-34ab-4b93-a582-a4bd1c6e353f`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000785135', 'lastCheck': '4.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:21:20,075::task::595::TaskManager.Task::(_updateState) Task=`15a67fc9-34ab-4b93-a582-a4bd1c6e353f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:21:20,075::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:21:20,075::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:21:20,075::task::990::TaskManager.Task::(_decref) Task=`15a67fc9-34ab-4b93-a582-a4bd1c6e353f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:21:20,802::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-24 11:21:20,860::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:21:20,862::task::595::TaskManager.Task::(_updateState) Task=`23f241bf-15b2-42ce-a71b-425af7604fb5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:21:20,863::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:21:20,864::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:21:20,865::task::1185::TaskManager.Task::(prepare) Task=`23f241bf-15b2-42ce-a71b-425af7604fb5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:21:20,866::task::595::TaskManager.Task::(_updateState) Task=`23f241bf-15b2-42ce-a71b-425af7604fb5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:21:20,866::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:21:20,867::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:21:20,868::task::990::TaskManager.Task::(_decref) Task=`23f241bf-15b2-42ce-a71b-425af7604fb5`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:21:20,886::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335041 s, 30.6 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-24 11:21:20,928::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:21:20,929::task::595::TaskManager.Task::(_updateState) Task=`95865f94-ffa3-49bf-b744-4a6e87999271`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:21:20,929::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:21:20,929::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c8267ffa-ec15-43cc-afc1-daea93039768`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:21:20,929::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:21:20,930::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:21:20,930::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c8267ffa-ec15-43cc-afc1-daea93039768`::Granted request >Thread-34::DEBUG::2014-07-24 11:21:20,930::task::827::TaskManager.Task::(resourceAcquired) Task=`95865f94-ffa3-49bf-b744-4a6e87999271`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:21:20,930::task::990::TaskManager.Task::(_decref) Task=`95865f94-ffa3-49bf-b744-4a6e87999271`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:21:20,931::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:21:20,931::task::1185::TaskManager.Task::(prepare) Task=`95865f94-ffa3-49bf-b744-4a6e87999271`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:21:20,931::task::595::TaskManager.Task::(_updateState) Task=`95865f94-ffa3-49bf-b744-4a6e87999271`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:21:20,932::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:21:20,932::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:21:20,932::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:21:20,932::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:21:20,932::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:21:20,932::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:21:20,933::task::990::TaskManager.Task::(_decref) Task=`95865f94-ffa3-49bf-b744-4a6e87999271`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:21:22,898::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:21:22,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344333 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:21:24,984::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:21:25,056::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335458 s, 30.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:21:25,716::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:21:25,725::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000800797 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:21:27,069::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:21:27,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347623 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:21:29,156::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:21:29,229::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033543 s, 30.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:21:29,599::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-14::DEBUG::2014-07-24 11:21:31,020::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:21:31,020::task::595::TaskManager.Task::(_updateState) Task=`c497b4e5-4dc7-4a2f-a937-7c11f5e21630`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:21:31,020::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:21:31,021::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:21:31,021::task::1185::TaskManager.Task::(prepare) Task=`c497b4e5-4dc7-4a2f-a937-7c11f5e21630`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:21:31,021::task::595::TaskManager.Task::(_updateState) Task=`c497b4e5-4dc7-4a2f-a937-7c11f5e21630`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:21:31,021::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:21:31,021::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:21:31,022::task::990::TaskManager.Task::(_decref) Task=`c497b4e5-4dc7-4a2f-a937-7c11f5e21630`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:21:31,078::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:21:31,078::task::595::TaskManager.Task::(_updateState) Task=`186f3f7b-2289-462b-9baa-5157b735a881`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:21:31,078::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:21:31,079::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`dc40d2b5-f15f-45eb-8560-82245caf5e7c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:21:31,079::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:21:31,079::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:21:31,080::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`dc40d2b5-f15f-45eb-8560-82245caf5e7c`::Granted request >Thread-34::DEBUG::2014-07-24 11:21:31,080::task::827::TaskManager.Task::(resourceAcquired) Task=`186f3f7b-2289-462b-9baa-5157b735a881`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:21:31,080::task::990::TaskManager.Task::(_decref) Task=`186f3f7b-2289-462b-9baa-5157b735a881`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:21:31,081::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:21:31,081::task::1185::TaskManager.Task::(prepare) Task=`186f3f7b-2289-462b-9baa-5157b735a881`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:21:31,081::task::595::TaskManager.Task::(_updateState) Task=`186f3f7b-2289-462b-9baa-5157b735a881`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:21:31,081::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:21:31,082::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:21:31,082::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:21:31,082::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:21:31,082::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:21:31,082::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:21:31,083::task::990::TaskManager.Task::(_decref) Task=`186f3f7b-2289-462b-9baa-5157b735a881`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:21:31,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:21:31,315::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340873 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:21:33,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:21:33,402::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034946 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:21:35,414::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:21:35,490::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356571 s, 28.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:21:35,730::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:21:35,739::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000734359 s, 5.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:21:35,870::task::595::TaskManager.Task::(_updateState) Task=`26dcfa5e-2c53-4ab6-a23a-9678e1fa1726`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:21:35,870::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:21:35,870::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000734359', 'lastCheck': '0.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:21:35,870::task::1185::TaskManager.Task::(prepare) Task=`26dcfa5e-2c53-4ab6-a23a-9678e1fa1726`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000734359', 'lastCheck': '0.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:21:35,870::task::595::TaskManager.Task::(_updateState) Task=`26dcfa5e-2c53-4ab6-a23a-9678e1fa1726`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:21:35,871::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:21:35,871::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:21:35,871::task::990::TaskManager.Task::(_decref) Task=`26dcfa5e-2c53-4ab6-a23a-9678e1fa1726`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:21:37,502::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:21:37,578::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036047 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:21:39,590::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:21:39,663::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034361 s, 29.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:21:41,157::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:21:41,157::task::595::TaskManager.Task::(_updateState) Task=`431de270-ad19-4139-b2a6-5014b1caf681`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:21:41,157::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:21:41,158::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:21:41,158::task::1185::TaskManager.Task::(prepare) Task=`431de270-ad19-4139-b2a6-5014b1caf681`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:21:41,158::task::595::TaskManager.Task::(_updateState) Task=`431de270-ad19-4139-b2a6-5014b1caf681`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:21:41,158::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:21:41,158::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:21:41,159::task::990::TaskManager.Task::(_decref) Task=`431de270-ad19-4139-b2a6-5014b1caf681`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:21:41,192::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:21:41,193::task::595::TaskManager.Task::(_updateState) Task=`0d27b823-4986-49ff-be96-adbde777f6f9`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:21:41,193::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:21:41,193::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`0f2e0b19-eb5f-4a71-bca5-90df1ecbc915`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:21:41,194::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:21:41,194::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:21:41,194::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`0f2e0b19-eb5f-4a71-bca5-90df1ecbc915`::Granted request >Thread-34::DEBUG::2014-07-24 11:21:41,194::task::827::TaskManager.Task::(resourceAcquired) Task=`0d27b823-4986-49ff-be96-adbde777f6f9`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:21:41,194::task::990::TaskManager.Task::(_decref) Task=`0d27b823-4986-49ff-be96-adbde777f6f9`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:21:41,195::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:21:41,195::task::1185::TaskManager.Task::(prepare) Task=`0d27b823-4986-49ff-be96-adbde777f6f9`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:21:41,196::task::595::TaskManager.Task::(_updateState) Task=`0d27b823-4986-49ff-be96-adbde777f6f9`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:21:41,196::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:21:41,196::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:21:41,196::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:21:41,196::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:21:41,197::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:21:41,197::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:21:41,197::task::990::TaskManager.Task::(_decref) Task=`0d27b823-4986-49ff-be96-adbde777f6f9`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:21:41,676::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:21:41,750::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338585 s, 30.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:21:43,762::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:21:44,132::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.330611 s, 3.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:21:45,744::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:21:45,753::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000722597 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:21:46,144::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:21:46,217::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334282 s, 30.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:21:48,229::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:21:48,309::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356279 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:21:50,321::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:21:50,393::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332884 s, 30.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:21:51,254::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:21:51,254::task::595::TaskManager.Task::(_updateState) Task=`02d0a22b-5bf9-4421-9376-1ef77a75ff27`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:21:51,254::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:21:51,255::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:21:51,255::task::1185::TaskManager.Task::(prepare) Task=`02d0a22b-5bf9-4421-9376-1ef77a75ff27`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:21:51,255::task::595::TaskManager.Task::(_updateState) Task=`02d0a22b-5bf9-4421-9376-1ef77a75ff27`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:21:51,255::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:21:51,255::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:21:51,256::task::990::TaskManager.Task::(_decref) Task=`02d0a22b-5bf9-4421-9376-1ef77a75ff27`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:21:51,291::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:21:51,291::task::595::TaskManager.Task::(_updateState) Task=`c61ddf9a-ed6f-4fb7-a8ea-660becec3e63`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:21:51,291::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:21:51,292::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`6d017b93-0bd9-4d68-9fe7-419aabcc0129`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:21:51,292::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:21:51,292::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:21:51,293::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`6d017b93-0bd9-4d68-9fe7-419aabcc0129`::Granted request >Thread-34::DEBUG::2014-07-24 11:21:51,293::task::827::TaskManager.Task::(resourceAcquired) Task=`c61ddf9a-ed6f-4fb7-a8ea-660becec3e63`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:21:51,293::task::990::TaskManager.Task::(_decref) Task=`c61ddf9a-ed6f-4fb7-a8ea-660becec3e63`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:21:51,294::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:21:51,294::task::1185::TaskManager.Task::(prepare) Task=`c61ddf9a-ed6f-4fb7-a8ea-660becec3e63`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:21:51,294::task::595::TaskManager.Task::(_updateState) Task=`c61ddf9a-ed6f-4fb7-a8ea-660becec3e63`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:21:51,294::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:21:51,295::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:21:51,295::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:21:51,295::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:21:51,295::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:21:51,295::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:21:51,296::task::990::TaskManager.Task::(_decref) Task=`c61ddf9a-ed6f-4fb7-a8ea-660becec3e63`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 11:21:51,346::task::595::TaskManager.Task::(_updateState) Task=`db33c9a6-f588-4eb9-80d1-ff805a8b9979`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:21:51,346::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:21:51,346::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000722597', 'lastCheck': '5.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:21:51,346::task::1185::TaskManager.Task::(prepare) Task=`db33c9a6-f588-4eb9-80d1-ff805a8b9979`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000722597', 'lastCheck': '5.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:21:51,346::task::595::TaskManager.Task::(_updateState) Task=`db33c9a6-f588-4eb9-80d1-ff805a8b9979`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:21:51,346::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:21:51,347::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:21:51,347::task::990::TaskManager.Task::(_decref) Task=`db33c9a6-f588-4eb9-80d1-ff805a8b9979`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:21:52,406::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:21:52,480::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352854 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:21:54,492::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:21:54,565::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335871 s, 30.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:21:55,758::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:21:55,767::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000655327 s, 6.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:21:56,577::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:21:56,651::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344249 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:21:58,664::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:21:58,737::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340897 s, 30.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:21:59,634::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:22:00,749::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:22:00,824::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357288 s, 28.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:22:01,360::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:22:01,361::task::595::TaskManager.Task::(_updateState) Task=`4d4b76b0-d62e-4398-96df-89e2edb77314`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:22:01,361::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:22:01,361::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:22:01,362::task::1185::TaskManager.Task::(prepare) Task=`4d4b76b0-d62e-4398-96df-89e2edb77314`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:22:01,362::task::595::TaskManager.Task::(_updateState) Task=`4d4b76b0-d62e-4398-96df-89e2edb77314`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:22:01,362::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:22:01,362::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:22:01,362::task::990::TaskManager.Task::(_decref) Task=`4d4b76b0-d62e-4398-96df-89e2edb77314`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:22:01,408::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:22:01,409::task::595::TaskManager.Task::(_updateState) Task=`3a870204-6f6b-4684-a692-f293754080d4`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:22:01,409::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:22:01,409::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`48e1c1ef-dca3-49d5-a23b-6dc674f83a1e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:22:01,410::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:22:01,410::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:22:01,410::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`48e1c1ef-dca3-49d5-a23b-6dc674f83a1e`::Granted request >Thread-34::DEBUG::2014-07-24 11:22:01,410::task::827::TaskManager.Task::(resourceAcquired) Task=`3a870204-6f6b-4684-a692-f293754080d4`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:22:01,410::task::990::TaskManager.Task::(_decref) Task=`3a870204-6f6b-4684-a692-f293754080d4`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:22:01,411::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:22:01,411::task::1185::TaskManager.Task::(prepare) Task=`3a870204-6f6b-4684-a692-f293754080d4`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:22:01,412::task::595::TaskManager.Task::(_updateState) Task=`3a870204-6f6b-4684-a692-f293754080d4`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:22:01,412::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:22:01,412::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:22:01,412::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:22:01,412::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:22:01,413::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:22:01,413::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:22:01,413::task::990::TaskManager.Task::(_decref) Task=`3a870204-6f6b-4684-a692-f293754080d4`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:22:02,836::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:22:02,911::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352789 s, 29.0 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:22:04,050::task::595::TaskManager.Task::(_updateState) Task=`649c51fa-c3fb-4cc9-a476-01d271b86193`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:22:04,050::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:22:04,050::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:22:04,051::task::1185::TaskManager.Task::(prepare) Task=`649c51fa-c3fb-4cc9-a476-01d271b86193`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:22:04,051::task::595::TaskManager.Task::(_updateState) Task=`649c51fa-c3fb-4cc9-a476-01d271b86193`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:22:04,051::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:22:04,051::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:22:04,051::task::990::TaskManager.Task::(_decref) Task=`649c51fa-c3fb-4cc9-a476-01d271b86193`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:22:04,923::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:22:04,998::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346512 s, 29.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:22:05,772::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:22:05,781::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000759808 s, 5.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:22:06,758::task::595::TaskManager.Task::(_updateState) Task=`32de2626-e433-4c2b-92b6-eb245e8cb3d2`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:22:06,760::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:22:06,761::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000759808', 'lastCheck': '1.0', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:22:06,763::task::1185::TaskManager.Task::(prepare) Task=`32de2626-e433-4c2b-92b6-eb245e8cb3d2`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000759808', 'lastCheck': '1.0', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:22:06,764::task::595::TaskManager.Task::(_updateState) Task=`32de2626-e433-4c2b-92b6-eb245e8cb3d2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:22:06,765::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:22:06,766::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:22:06,767::task::990::TaskManager.Task::(_decref) Task=`32de2626-e433-4c2b-92b6-eb245e8cb3d2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:22:07,010::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:22:07,084::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344411 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:22:09,096::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:22:09,169::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339336 s, 30.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:22:11,181::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:22:11,254::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336197 s, 30.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:22:11,482::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:22:11,483::task::595::TaskManager.Task::(_updateState) Task=`bb7339ce-0d45-40fe-a770-118db6b355ab`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:22:11,483::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:22:11,483::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:22:11,484::task::1185::TaskManager.Task::(prepare) Task=`bb7339ce-0d45-40fe-a770-118db6b355ab`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:22:11,484::task::595::TaskManager.Task::(_updateState) Task=`bb7339ce-0d45-40fe-a770-118db6b355ab`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:22:11,484::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:22:11,484::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:22:11,484::task::990::TaskManager.Task::(_decref) Task=`bb7339ce-0d45-40fe-a770-118db6b355ab`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:22:11,529::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:22:11,529::task::595::TaskManager.Task::(_updateState) Task=`54eb44b6-bc2d-4bee-b84f-f9cb33f94860`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:22:11,529::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:22:11,530::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f49bf702-b0ce-48b6-ad21-e694478a4928`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:22:11,530::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:22:11,530::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:22:11,530::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f49bf702-b0ce-48b6-ad21-e694478a4928`::Granted request >Thread-34::DEBUG::2014-07-24 11:22:11,531::task::827::TaskManager.Task::(resourceAcquired) Task=`54eb44b6-bc2d-4bee-b84f-f9cb33f94860`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:22:11,531::task::990::TaskManager.Task::(_decref) Task=`54eb44b6-bc2d-4bee-b84f-f9cb33f94860`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:22:11,532::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:22:11,532::task::1185::TaskManager.Task::(prepare) Task=`54eb44b6-bc2d-4bee-b84f-f9cb33f94860`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:22:11,532::task::595::TaskManager.Task::(_updateState) Task=`54eb44b6-bc2d-4bee-b84f-f9cb33f94860`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:22:11,532::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:22:11,532::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:22:11,533::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:22:11,533::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:22:11,533::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:22:11,533::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:22:11,533::task::990::TaskManager.Task::(_decref) Task=`54eb44b6-bc2d-4bee-b84f-f9cb33f94860`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:22:13,266::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:22:13,341::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345424 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:22:15,353::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:22:15,426::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331314 s, 30.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:22:15,789::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:22:15,805::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000617797 s, 6.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:22:17,439::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:22:17,513::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033814 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:22:19,525::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:22:19,600::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342446 s, 29.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:22:21,610::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:22:21,610::task::595::TaskManager.Task::(_updateState) Task=`064e6d7e-888e-4bd5-bceb-f0977ca90a28`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:22:21,611::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:22:21,611::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:22:21,611::task::1185::TaskManager.Task::(prepare) Task=`064e6d7e-888e-4bd5-bceb-f0977ca90a28`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:22:21,611::task::595::TaskManager.Task::(_updateState) Task=`064e6d7e-888e-4bd5-bceb-f0977ca90a28`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:22:21,611::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:22:21,612::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:22:21,612::task::990::TaskManager.Task::(_decref) Task=`064e6d7e-888e-4bd5-bceb-f0977ca90a28`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:22:21,613::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-34::DEBUG::2014-07-24 11:22:21,664::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:22:21,666::task::595::TaskManager.Task::(_updateState) Task=`aac6694e-859c-4584-b9cd-8825f4500ec8`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:22:21,668::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:22:21,670::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1c7ac80b-0d1a-4d33-bace-02f14376e3c1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:22:21,671::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:22:21,672::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:22:21,673::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1c7ac80b-0d1a-4d33-bace-02f14376e3c1`::Granted request >Thread-34::DEBUG::2014-07-24 11:22:21,674::task::827::TaskManager.Task::(resourceAcquired) Task=`aac6694e-859c-4584-b9cd-8825f4500ec8`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:22:21,675::task::990::TaskManager.Task::(_decref) Task=`aac6694e-859c-4584-b9cd-8825f4500ec8`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:22:21,679::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:22:21,679::task::1185::TaskManager.Task::(prepare) Task=`aac6694e-859c-4584-b9cd-8825f4500ec8`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:22:21,680::task::595::TaskManager.Task::(_updateState) Task=`aac6694e-859c-4584-b9cd-8825f4500ec8`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:22:21,681::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:22:21,681::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:22:21,683::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:22:21,684::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:22:21,684::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:22:21,685::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:22:21,686::task::990::TaskManager.Task::(_decref) Task=`aac6694e-859c-4584-b9cd-8825f4500ec8`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:22:21,714::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354804 s, 28.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:22:22,149::task::595::TaskManager.Task::(_updateState) Task=`f0f42fa5-f751-44fe-ad52-97df336e6275`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:22:22,149::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:22:22,149::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617797', 'lastCheck': '6.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:22:22,149::task::1185::TaskManager.Task::(prepare) Task=`f0f42fa5-f751-44fe-ad52-97df336e6275`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000617797', 'lastCheck': '6.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:22:22,149::task::595::TaskManager.Task::(_updateState) Task=`f0f42fa5-f751-44fe-ad52-97df336e6275`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:22:22,149::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:22:22,150::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:22:22,150::task::990::TaskManager.Task::(_decref) Task=`f0f42fa5-f751-44fe-ad52-97df336e6275`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:22:23,726::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:22:23,800::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350376 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:22:25,813::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-24 11:22:25,825::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:22:25,847::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000529976 s, 7.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:22:25,959::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.10659 s, 9.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:22:27,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:22:28,054::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351544 s, 29.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:22:29,670::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:22:30,066::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:22:30,140::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344098 s, 29.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:22:31,748::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:22:31,748::task::595::TaskManager.Task::(_updateState) Task=`9417c55d-9900-4ad8-a726-a91541006443`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:22:31,748::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:22:31,749::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:22:31,749::task::1185::TaskManager.Task::(prepare) Task=`9417c55d-9900-4ad8-a726-a91541006443`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:22:31,749::task::595::TaskManager.Task::(_updateState) Task=`9417c55d-9900-4ad8-a726-a91541006443`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:22:31,749::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:22:31,749::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:22:31,750::task::990::TaskManager.Task::(_decref) Task=`9417c55d-9900-4ad8-a726-a91541006443`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:22:31,783::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:22:31,783::task::595::TaskManager.Task::(_updateState) Task=`dbf7ca88-f4d8-4759-8530-3d1857cec75c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:22:31,783::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:22:31,783::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`3a748367-f4d5-45f0-b182-b887fcf15511`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:22:31,784::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:22:31,784::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:22:31,784::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`3a748367-f4d5-45f0-b182-b887fcf15511`::Granted request >Thread-34::DEBUG::2014-07-24 11:22:31,784::task::827::TaskManager.Task::(resourceAcquired) Task=`dbf7ca88-f4d8-4759-8530-3d1857cec75c`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:22:31,785::task::990::TaskManager.Task::(_decref) Task=`dbf7ca88-f4d8-4759-8530-3d1857cec75c`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:22:31,785::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:22:31,785::task::1185::TaskManager.Task::(prepare) Task=`dbf7ca88-f4d8-4759-8530-3d1857cec75c`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:22:31,786::task::595::TaskManager.Task::(_updateState) Task=`dbf7ca88-f4d8-4759-8530-3d1857cec75c`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:22:31,786::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:22:31,786::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:22:31,786::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:22:31,786::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:22:31,787::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:22:31,787::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:22:31,787::task::990::TaskManager.Task::(_decref) Task=`dbf7ca88-f4d8-4759-8530-3d1857cec75c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:22:32,153::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:22:32,226::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337018 s, 30.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:22:34,238::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:22:34,313::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354463 s, 28.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:22:35,905::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:22:35,927::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0137883 s, 297 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:22:36,325::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:22:36,398::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033178 s, 30.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:22:37,650::task::595::TaskManager.Task::(_updateState) Task=`50ca1515-ad86-4767-ac9f-238a0996dc6a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:22:37,650::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:22:37,650::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0137883', 'lastCheck': '1.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:22:37,650::task::1185::TaskManager.Task::(prepare) Task=`50ca1515-ad86-4767-ac9f-238a0996dc6a`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0137883', 'lastCheck': '1.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:22:37,651::task::595::TaskManager.Task::(_updateState) Task=`50ca1515-ad86-4767-ac9f-238a0996dc6a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:22:37,651::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:22:37,651::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:22:37,651::task::990::TaskManager.Task::(_decref) Task=`50ca1515-ad86-4767-ac9f-238a0996dc6a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:22:38,410::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:22:38,485::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353523 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:22:40,498::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:22:40,571::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339828 s, 30.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:22:41,845::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:22:41,845::task::595::TaskManager.Task::(_updateState) Task=`516f1614-ace6-4e85-939d-c21fcc4f285b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:22:41,846::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:22:41,846::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:22:41,846::task::1185::TaskManager.Task::(prepare) Task=`516f1614-ace6-4e85-939d-c21fcc4f285b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:22:41,846::task::595::TaskManager.Task::(_updateState) Task=`516f1614-ace6-4e85-939d-c21fcc4f285b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:22:41,846::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:22:41,847::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:22:41,847::task::990::TaskManager.Task::(_decref) Task=`516f1614-ace6-4e85-939d-c21fcc4f285b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:22:41,926::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:22:41,926::task::595::TaskManager.Task::(_updateState) Task=`da0a7d28-65ce-4833-ae28-05558d441e12`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:22:41,927::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:22:41,927::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c6c142bb-1c8c-4c43-adce-490673e66718`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:22:41,927::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:22:41,927::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:22:41,928::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c6c142bb-1c8c-4c43-adce-490673e66718`::Granted request >Thread-34::DEBUG::2014-07-24 11:22:41,928::task::827::TaskManager.Task::(resourceAcquired) Task=`da0a7d28-65ce-4833-ae28-05558d441e12`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:22:41,928::task::990::TaskManager.Task::(_decref) Task=`da0a7d28-65ce-4833-ae28-05558d441e12`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:22:41,929::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:22:41,929::task::1185::TaskManager.Task::(prepare) Task=`da0a7d28-65ce-4833-ae28-05558d441e12`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:22:41,929::task::595::TaskManager.Task::(_updateState) Task=`da0a7d28-65ce-4833-ae28-05558d441e12`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:22:41,930::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:22:41,930::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:22:41,930::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:22:41,930::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:22:41,930::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:22:41,930::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:22:41,931::task::990::TaskManager.Task::(_decref) Task=`da0a7d28-65ce-4833-ae28-05558d441e12`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:22:42,583::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:22:42,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.325083 s, 3.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:22:44,961::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:22:45,069::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.069529 s, 14.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:22:45,932::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:22:45,944::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00358692 s, 1.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:22:47,081::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:22:47,157::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353486 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:22:49,170::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:22:49,244::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342931 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:22:51,257::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:22:51,329::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330054 s, 31.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:22:52,001::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:22:52,001::task::595::TaskManager.Task::(_updateState) Task=`49dee828-0fdb-4290-9ce3-0373461a0eb4`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:22:52,002::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:22:52,002::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:22:52,002::task::1185::TaskManager.Task::(prepare) Task=`49dee828-0fdb-4290-9ce3-0373461a0eb4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:22:52,002::task::595::TaskManager.Task::(_updateState) Task=`49dee828-0fdb-4290-9ce3-0373461a0eb4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:22:52,003::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:22:52,003::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:22:52,003::task::990::TaskManager.Task::(_decref) Task=`49dee828-0fdb-4290-9ce3-0373461a0eb4`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:22:52,046::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:22:52,046::task::595::TaskManager.Task::(_updateState) Task=`4a54f663-faf1-459e-98b1-1adf856ff66d`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:22:52,046::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:22:52,047::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`34287cba-a5ec-4d5d-a4b7-2918159f323d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:22:52,047::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:22:52,047::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:22:52,047::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`34287cba-a5ec-4d5d-a4b7-2918159f323d`::Granted request >Thread-34::DEBUG::2014-07-24 11:22:52,048::task::827::TaskManager.Task::(resourceAcquired) Task=`4a54f663-faf1-459e-98b1-1adf856ff66d`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:22:52,048::task::990::TaskManager.Task::(_decref) Task=`4a54f663-faf1-459e-98b1-1adf856ff66d`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:22:52,048::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:22:52,049::task::1185::TaskManager.Task::(prepare) Task=`4a54f663-faf1-459e-98b1-1adf856ff66d`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:22:52,049::task::595::TaskManager.Task::(_updateState) Task=`4a54f663-faf1-459e-98b1-1adf856ff66d`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:22:52,049::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:22:52,049::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:22:52,049::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:22:52,050::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:22:52,050::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:22:52,050::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:22:52,050::task::990::TaskManager.Task::(_decref) Task=`4a54f663-faf1-459e-98b1-1adf856ff66d`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 11:22:53,108::task::595::TaskManager.Task::(_updateState) Task=`34fdfada-5ff8-429d-9722-6a4456283bdd`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:22:53,108::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:22:53,108::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00358692', 'lastCheck': '7.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:22:53,109::task::1185::TaskManager.Task::(prepare) Task=`34fdfada-5ff8-429d-9722-6a4456283bdd`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00358692', 'lastCheck': '7.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:22:53,109::task::595::TaskManager.Task::(_updateState) Task=`34fdfada-5ff8-429d-9722-6a4456283bdd`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:22:53,109::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:22:53,109::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:22:53,109::task::990::TaskManager.Task::(_decref) Task=`34fdfada-5ff8-429d-9722-6a4456283bdd`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:22:53,342::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:22:53,415::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335381 s, 30.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:22:55,427::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:22:55,500::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033873 s, 30.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:22:55,963::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:22:55,977::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00566047 s, 724 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:22:57,513::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:22:57,587::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341345 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:22:59,599::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:22:59,673::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342957 s, 29.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:22:59,704::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:23:01,685::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:23:01,760::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353357 s, 29.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:23:02,110::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:23:02,110::task::595::TaskManager.Task::(_updateState) Task=`e28d0e6e-460b-42a8-b2f0-ca261315a660`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:23:02,111::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:23:02,111::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:23:02,111::task::1185::TaskManager.Task::(prepare) Task=`e28d0e6e-460b-42a8-b2f0-ca261315a660`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:23:02,111::task::595::TaskManager.Task::(_updateState) Task=`e28d0e6e-460b-42a8-b2f0-ca261315a660`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:23:02,112::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:23:02,112::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:23:02,112::task::990::TaskManager.Task::(_decref) Task=`e28d0e6e-460b-42a8-b2f0-ca261315a660`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:23:02,144::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:23:02,145::task::595::TaskManager.Task::(_updateState) Task=`fd0d9a6f-a124-407a-a85c-62151da32dc3`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:23:02,145::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:23:02,145::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`2719fb11-7702-4e80-b582-0e7b5be62ddb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:23:02,145::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:23:02,146::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:23:02,146::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`2719fb11-7702-4e80-b582-0e7b5be62ddb`::Granted request >Thread-34::DEBUG::2014-07-24 11:23:02,146::task::827::TaskManager.Task::(resourceAcquired) Task=`fd0d9a6f-a124-407a-a85c-62151da32dc3`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:23:02,146::task::990::TaskManager.Task::(_decref) Task=`fd0d9a6f-a124-407a-a85c-62151da32dc3`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:23:02,147::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:23:02,147::task::1185::TaskManager.Task::(prepare) Task=`fd0d9a6f-a124-407a-a85c-62151da32dc3`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:23:02,147::task::595::TaskManager.Task::(_updateState) Task=`fd0d9a6f-a124-407a-a85c-62151da32dc3`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:23:02,147::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:23:02,148::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:23:02,148::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:23:02,148::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:23:02,148::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:23:02,148::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:23:02,149::task::990::TaskManager.Task::(_decref) Task=`fd0d9a6f-a124-407a-a85c-62151da32dc3`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:23:03,773::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:23:03,847::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034685 s, 29.5 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:23:04,208::task::595::TaskManager.Task::(_updateState) Task=`2fd37cc1-af7f-4594-a315-ef6ff21f4396`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:23:04,209::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:23:04,209::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:23:04,209::task::1185::TaskManager.Task::(prepare) Task=`2fd37cc1-af7f-4594-a315-ef6ff21f4396`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:23:04,209::task::595::TaskManager.Task::(_updateState) Task=`2fd37cc1-af7f-4594-a315-ef6ff21f4396`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:23:04,210::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:23:04,210::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:23:04,210::task::990::TaskManager.Task::(_decref) Task=`2fd37cc1-af7f-4594-a315-ef6ff21f4396`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:23:05,859::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:23:05,932::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338409 s, 30.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:23:05,982::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:23:06,003::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0115713 s, 354 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:23:07,945::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:23:08,021::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365844 s, 28.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:23:08,577::task::595::TaskManager.Task::(_updateState) Task=`302700d8-c0c3-48ea-b911-35e6ba3847c0`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:23:08,577::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:23:08,578::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0115713', 'lastCheck': '2.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:23:08,578::task::1185::TaskManager.Task::(prepare) Task=`302700d8-c0c3-48ea-b911-35e6ba3847c0`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0115713', 'lastCheck': '2.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:23:08,578::task::595::TaskManager.Task::(_updateState) Task=`302700d8-c0c3-48ea-b911-35e6ba3847c0`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:23:08,578::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:23:08,578::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:23:08,578::task::990::TaskManager.Task::(_decref) Task=`302700d8-c0c3-48ea-b911-35e6ba3847c0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:23:10,046::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:23:10,121::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343126 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:23:12,133::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-24 11:23:12,206::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:23:12,208::task::595::TaskManager.Task::(_updateState) Task=`8c972308-fbdb-4d35-8233-416308616458`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:23:12,209::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:23:12,210::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:23:12,211::task::1185::TaskManager.Task::(prepare) Task=`8c972308-fbdb-4d35-8233-416308616458`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:23:12,212::task::595::TaskManager.Task::(_updateState) Task=`8c972308-fbdb-4d35-8233-416308616458`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:23:12,213::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:23:12,214::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:23:12,215::task::990::TaskManager.Task::(_decref) Task=`8c972308-fbdb-4d35-8233-416308616458`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:23:12,219::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340255 s, 30.1 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-24 11:23:12,249::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:23:12,251::task::595::TaskManager.Task::(_updateState) Task=`6a6a9ad6-153a-452d-b26f-3bc9621a45bd`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:23:12,251::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:23:12,251::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`519c60bc-eec3-479a-9a5a-be80bb52c6ac`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:23:12,251::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:23:12,252::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:23:12,252::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`519c60bc-eec3-479a-9a5a-be80bb52c6ac`::Granted request >Thread-34::DEBUG::2014-07-24 11:23:12,252::task::827::TaskManager.Task::(resourceAcquired) Task=`6a6a9ad6-153a-452d-b26f-3bc9621a45bd`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:23:12,252::task::990::TaskManager.Task::(_decref) Task=`6a6a9ad6-153a-452d-b26f-3bc9621a45bd`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:23:12,253::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:23:12,254::task::1185::TaskManager.Task::(prepare) Task=`6a6a9ad6-153a-452d-b26f-3bc9621a45bd`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:23:12,254::task::595::TaskManager.Task::(_updateState) Task=`6a6a9ad6-153a-452d-b26f-3bc9621a45bd`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:23:12,254::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:23:12,254::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:23:12,255::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:23:12,255::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:23:12,255::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:23:12,255::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:23:12,255::task::990::TaskManager.Task::(_decref) Task=`6a6a9ad6-153a-452d-b26f-3bc9621a45bd`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:23:14,231::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:23:14,306::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354545 s, 28.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:23:16,007::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:23:16,028::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0122198 s, 335 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:23:16,318::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:23:16,391::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340946 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:23:18,404::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:23:18,478::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337016 s, 30.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:23:20,490::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:23:20,562::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329702 s, 31.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:23:22,318::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:23:22,319::task::595::TaskManager.Task::(_updateState) Task=`34b4beac-47b7-4d39-bb31-8d982d8ec6cf`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:23:22,319::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:23:22,319::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:23:22,319::task::1185::TaskManager.Task::(prepare) Task=`34b4beac-47b7-4d39-bb31-8d982d8ec6cf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:23:22,319::task::595::TaskManager.Task::(_updateState) Task=`34b4beac-47b7-4d39-bb31-8d982d8ec6cf`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:23:22,320::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:23:22,320::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:23:22,320::task::990::TaskManager.Task::(_decref) Task=`34b4beac-47b7-4d39-bb31-8d982d8ec6cf`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:23:22,353::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:23:22,353::task::595::TaskManager.Task::(_updateState) Task=`bb96f59b-26fa-474a-9bac-f6e3905a224a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:23:22,354::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:23:22,354::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`93a52610-9133-485a-b4f6-c9715af4267a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:23:22,354::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:23:22,354::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:23:22,355::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`93a52610-9133-485a-b4f6-c9715af4267a`::Granted request >Thread-34::DEBUG::2014-07-24 11:23:22,355::task::827::TaskManager.Task::(resourceAcquired) Task=`bb96f59b-26fa-474a-9bac-f6e3905a224a`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:23:22,355::task::990::TaskManager.Task::(_decref) Task=`bb96f59b-26fa-474a-9bac-f6e3905a224a`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:23:22,356::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:23:22,356::task::1185::TaskManager.Task::(prepare) Task=`bb96f59b-26fa-474a-9bac-f6e3905a224a`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:23:22,356::task::595::TaskManager.Task::(_updateState) Task=`bb96f59b-26fa-474a-9bac-f6e3905a224a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:23:22,356::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:23:22,356::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:23:22,357::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:23:22,357::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:23:22,357::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:23:22,357::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:23:22,357::task::990::TaskManager.Task::(_decref) Task=`bb96f59b-26fa-474a-9bac-f6e3905a224a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:23:22,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:23:22,647::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334719 s, 30.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:23:24,037::task::595::TaskManager.Task::(_updateState) Task=`45da0e12-a894-47f3-a328-d0fc5cea5aef`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:23:24,038::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:23:24,038::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0122198', 'lastCheck': '8.0', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:23:24,038::task::1185::TaskManager.Task::(prepare) Task=`45da0e12-a894-47f3-a328-d0fc5cea5aef`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0122198', 'lastCheck': '8.0', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:23:24,038::task::595::TaskManager.Task::(_updateState) Task=`45da0e12-a894-47f3-a328-d0fc5cea5aef`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:23:24,038::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:23:24,039::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:23:24,039::task::990::TaskManager.Task::(_decref) Task=`45da0e12-a894-47f3-a328-d0fc5cea5aef`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:23:24,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:23:24,731::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330028 s, 31.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:23:26,033::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:23:26,053::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0124192 s, 330 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:23:26,744::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:23:26,818::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349363 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:23:28,830::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:23:28,905::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355942 s, 28.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:23:29,740::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:23:30,917::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:23:30,993::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353573 s, 29.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:23:32,428::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [3b38bf98] >Thread-14::DEBUG::2014-07-24 11:23:32,428::task::595::TaskManager.Task::(_updateState) Task=`a7b60542-b0ae-41ce-8ddf-cf0ba3452d4d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:23:32,428::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:23:32,429::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:23:32,429::task::1185::TaskManager.Task::(prepare) Task=`a7b60542-b0ae-41ce-8ddf-cf0ba3452d4d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:23:32,429::task::595::TaskManager.Task::(_updateState) Task=`a7b60542-b0ae-41ce-8ddf-cf0ba3452d4d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:23:32,429::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:23:32,429::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:23:32,429::task::990::TaskManager.Task::(_decref) Task=`a7b60542-b0ae-41ce-8ddf-cf0ba3452d4d`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:23:32,462::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [3b38bf98] >Thread-34::DEBUG::2014-07-24 11:23:32,463::task::595::TaskManager.Task::(_updateState) Task=`4911ce99-40cd-4852-a469-de22140d3498`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:23:32,463::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:23:32,463::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d7a9d2e1-61a4-4d05-8962-30333071fdee`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:23:32,463::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:23:32,464::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:23:32,464::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d7a9d2e1-61a4-4d05-8962-30333071fdee`::Granted request >Thread-34::DEBUG::2014-07-24 11:23:32,464::task::827::TaskManager.Task::(resourceAcquired) Task=`4911ce99-40cd-4852-a469-de22140d3498`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:23:32,464::task::990::TaskManager.Task::(_decref) Task=`4911ce99-40cd-4852-a469-de22140d3498`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:23:32,465::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:23:32,465::task::1185::TaskManager.Task::(prepare) Task=`4911ce99-40cd-4852-a469-de22140d3498`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:23:32,465::task::595::TaskManager.Task::(_updateState) Task=`4911ce99-40cd-4852-a469-de22140d3498`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:23:32,465::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:23:32,466::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:23:32,466::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:23:32,466::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:23:32,466::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:23:32,466::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:23:32,467::task::990::TaskManager.Task::(_decref) Task=`4911ce99-40cd-4852-a469-de22140d3498`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:23:33,005::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:23:33,081::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339153 s, 30.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:23:35,094::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:23:35,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345412 s, 29.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:23:36,058::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:23:36,079::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0119213 s, 344 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:23:37,180::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:23:37,259::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0391517 s, 26.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:23:39,272::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:23:39,348::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350495 s, 29.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:23:39,422::task::595::TaskManager.Task::(_updateState) Task=`e9cfeead-bb3e-411b-b996-3ac1269b9432`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:23:39,423::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:23:39,423::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0119213', 'lastCheck': '3.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:23:39,423::task::1185::TaskManager.Task::(prepare) Task=`e9cfeead-bb3e-411b-b996-3ac1269b9432`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0119213', 'lastCheck': '3.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:23:39,423::task::595::TaskManager.Task::(_updateState) Task=`e9cfeead-bb3e-411b-b996-3ac1269b9432`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:23:39,424::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:23:39,424::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:23:39,424::task::990::TaskManager.Task::(_decref) Task=`e9cfeead-bb3e-411b-b996-3ac1269b9432`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:23:41,360::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:23:41,434::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347176 s, 29.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:23:42,532::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:23:42,532::task::595::TaskManager.Task::(_updateState) Task=`6ccbfe68-733e-4e11-a762-c94d5f3af104`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:23:42,532::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:23:42,533::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:23:42,533::task::1185::TaskManager.Task::(prepare) Task=`6ccbfe68-733e-4e11-a762-c94d5f3af104`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:23:42,533::task::595::TaskManager.Task::(_updateState) Task=`6ccbfe68-733e-4e11-a762-c94d5f3af104`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:23:42,533::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:23:42,533::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:23:42,533::task::990::TaskManager.Task::(_decref) Task=`6ccbfe68-733e-4e11-a762-c94d5f3af104`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:23:42,571::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:23:42,571::task::595::TaskManager.Task::(_updateState) Task=`df101a0e-a175-4b8f-88ec-29e0d23f1c73`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:23:42,571::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:23:42,572::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`003d064d-e5a1-4df8-a88e-c22b592380e3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:23:42,572::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:23:42,572::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:23:42,572::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`003d064d-e5a1-4df8-a88e-c22b592380e3`::Granted request >Thread-34::DEBUG::2014-07-24 11:23:42,573::task::827::TaskManager.Task::(resourceAcquired) Task=`df101a0e-a175-4b8f-88ec-29e0d23f1c73`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:23:42,573::task::990::TaskManager.Task::(_decref) Task=`df101a0e-a175-4b8f-88ec-29e0d23f1c73`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:23:42,574::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:23:42,574::task::1185::TaskManager.Task::(prepare) Task=`df101a0e-a175-4b8f-88ec-29e0d23f1c73`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:23:42,574::task::595::TaskManager.Task::(_updateState) Task=`df101a0e-a175-4b8f-88ec-29e0d23f1c73`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:23:42,574::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:23:42,574::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:23:42,575::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:23:42,575::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:23:42,575::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:23:42,575::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:23:42,575::task::990::TaskManager.Task::(_decref) Task=`df101a0e-a175-4b8f-88ec-29e0d23f1c73`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:23:43,446::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:23:43,521::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352712 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:23:45,533::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:23:45,607::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342201 s, 29.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:23:46,083::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:23:46,104::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0121584 s, 337 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:23:47,619::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:23:47,693::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340956 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:23:49,705::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:23:49,780::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03554 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:23:51,792::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:23:51,869::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0375947 s, 27.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:23:52,638::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:23:52,639::task::595::TaskManager.Task::(_updateState) Task=`265a4735-8008-4c1e-b607-5955c68976a7`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:23:52,639::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:23:52,639::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:23:52,639::task::1185::TaskManager.Task::(prepare) Task=`265a4735-8008-4c1e-b607-5955c68976a7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:23:52,639::task::595::TaskManager.Task::(_updateState) Task=`265a4735-8008-4c1e-b607-5955c68976a7`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:23:52,640::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:23:52,640::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:23:52,640::task::990::TaskManager.Task::(_decref) Task=`265a4735-8008-4c1e-b607-5955c68976a7`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:23:52,689::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:23:52,689::task::595::TaskManager.Task::(_updateState) Task=`98988c62-cdca-4e5e-ad02-112b24baf4ce`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:23:52,689::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:23:52,690::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`74a9b3b1-b09e-44df-97bc-4310dca21e5f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:23:52,690::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:23:52,691::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:23:52,691::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`74a9b3b1-b09e-44df-97bc-4310dca21e5f`::Granted request >Thread-34::DEBUG::2014-07-24 11:23:52,691::task::827::TaskManager.Task::(resourceAcquired) Task=`98988c62-cdca-4e5e-ad02-112b24baf4ce`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:23:52,692::task::990::TaskManager.Task::(_decref) Task=`98988c62-cdca-4e5e-ad02-112b24baf4ce`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:23:52,692::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:23:52,693::task::1185::TaskManager.Task::(prepare) Task=`98988c62-cdca-4e5e-ad02-112b24baf4ce`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:23:52,693::task::595::TaskManager.Task::(_updateState) Task=`98988c62-cdca-4e5e-ad02-112b24baf4ce`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:23:52,693::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:23:52,693::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:23:52,693::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:23:52,693::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:23:52,694::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:23:52,694::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:23:52,694::task::990::TaskManager.Task::(_decref) Task=`98988c62-cdca-4e5e-ad02-112b24baf4ce`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:23:53,882::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:23:53,955::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344796 s, 29.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:23:54,875::task::595::TaskManager.Task::(_updateState) Task=`311710b8-31f0-45c3-9132-02379234fe25`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:23:54,875::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:23:54,875::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0121584', 'lastCheck': '8.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:23:54,875::task::1185::TaskManager.Task::(prepare) Task=`311710b8-31f0-45c3-9132-02379234fe25`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0121584', 'lastCheck': '8.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:23:54,875::task::595::TaskManager.Task::(_updateState) Task=`311710b8-31f0-45c3-9132-02379234fe25`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:23:54,876::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:23:54,876::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:23:54,876::task::990::TaskManager.Task::(_decref) Task=`311710b8-31f0-45c3-9132-02379234fe25`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:23:55,968::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:23:56,042::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343365 s, 29.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:23:56,109::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:23:56,118::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000721922 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:23:58,054::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:23:58,128::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347541 s, 29.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:23:59,777::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:24:00,144::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:24:00,232::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349989 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:24:02,244::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:24:02,316::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332386 s, 30.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:24:02,751::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:24:02,752::task::595::TaskManager.Task::(_updateState) Task=`57d53bd4-7a3d-4bb2-ae22-24fee597bdd2`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:24:02,752::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:24:02,752::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:24:02,753::task::1185::TaskManager.Task::(prepare) Task=`57d53bd4-7a3d-4bb2-ae22-24fee597bdd2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:24:02,753::task::595::TaskManager.Task::(_updateState) Task=`57d53bd4-7a3d-4bb2-ae22-24fee597bdd2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:24:02,753::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:24:02,753::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:24:02,753::task::990::TaskManager.Task::(_decref) Task=`57d53bd4-7a3d-4bb2-ae22-24fee597bdd2`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:24:02,785::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:24:02,785::task::595::TaskManager.Task::(_updateState) Task=`3816ca89-0050-49ea-bb2f-11a55a73bc6e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:24:02,785::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:24:02,786::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`9aae9002-642d-4831-8927-9fcae35cf64c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:24:02,786::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:24:02,786::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:24:02,786::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`9aae9002-642d-4831-8927-9fcae35cf64c`::Granted request >Thread-34::DEBUG::2014-07-24 11:24:02,787::task::827::TaskManager.Task::(resourceAcquired) Task=`3816ca89-0050-49ea-bb2f-11a55a73bc6e`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:24:02,787::task::990::TaskManager.Task::(_decref) Task=`3816ca89-0050-49ea-bb2f-11a55a73bc6e`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:24:02,788::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:24:02,788::task::1185::TaskManager.Task::(prepare) Task=`3816ca89-0050-49ea-bb2f-11a55a73bc6e`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:24:02,788::task::595::TaskManager.Task::(_updateState) Task=`3816ca89-0050-49ea-bb2f-11a55a73bc6e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:24:02,788::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:24:02,788::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:24:02,789::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:24:02,789::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:24:02,789::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:24:02,789::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:24:02,789::task::990::TaskManager.Task::(_decref) Task=`3816ca89-0050-49ea-bb2f-11a55a73bc6e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:24:04,328::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-37::DEBUG::2014-07-24 11:24:04,388::task::595::TaskManager.Task::(_updateState) Task=`23d134bc-4cba-4e0c-8aaf-c9189eea6870`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:24:04,391::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:24:04,393::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:24:04,395::task::1185::TaskManager.Task::(prepare) Task=`23d134bc-4cba-4e0c-8aaf-c9189eea6870`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:24:04,396::task::595::TaskManager.Task::(_updateState) Task=`23d134bc-4cba-4e0c-8aaf-c9189eea6870`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:24:04,398::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:24:04,399::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:24:04,400::task::990::TaskManager.Task::(_decref) Task=`23d134bc-4cba-4e0c-8aaf-c9189eea6870`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:24:04,422::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356687 s, 28.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:24:06,122::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:24:06,138::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00670578 s, 611 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:24:06,436::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:24:06,508::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335031 s, 30.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:24:08,521::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:24:08,594::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333723 s, 30.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:24:10,279::task::595::TaskManager.Task::(_updateState) Task=`a8029e01-9a13-4112-91ce-7e7b82395a5a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:24:10,279::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:24:10,280::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00670578', 'lastCheck': '4.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:24:10,280::task::1185::TaskManager.Task::(prepare) Task=`a8029e01-9a13-4112-91ce-7e7b82395a5a`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00670578', 'lastCheck': '4.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:24:10,280::task::595::TaskManager.Task::(_updateState) Task=`a8029e01-9a13-4112-91ce-7e7b82395a5a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:24:10,280::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:24:10,280::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:24:10,280::task::990::TaskManager.Task::(_decref) Task=`a8029e01-9a13-4112-91ce-7e7b82395a5a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:24:10,607::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:24:10,680::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333806 s, 30.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:24:12,692::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:24:12,764::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329088 s, 31.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:24:12,848::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:24:12,848::task::595::TaskManager.Task::(_updateState) Task=`c2ebcd7d-3c90-4927-b862-8f9b43ae3f97`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:24:12,848::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:24:12,849::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:24:12,849::task::1185::TaskManager.Task::(prepare) Task=`c2ebcd7d-3c90-4927-b862-8f9b43ae3f97`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:24:12,849::task::595::TaskManager.Task::(_updateState) Task=`c2ebcd7d-3c90-4927-b862-8f9b43ae3f97`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:24:12,849::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:24:12,849::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:24:12,849::task::990::TaskManager.Task::(_decref) Task=`c2ebcd7d-3c90-4927-b862-8f9b43ae3f97`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:24:12,884::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:24:12,885::task::595::TaskManager.Task::(_updateState) Task=`03730c64-c931-400b-9ec1-985f81353d2e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:24:12,885::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:24:12,885::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4e6bc7b7-3ce3-4665-b3f4-560dabd3a7e8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:24:12,885::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:24:12,886::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:24:12,886::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4e6bc7b7-3ce3-4665-b3f4-560dabd3a7e8`::Granted request >Thread-34::DEBUG::2014-07-24 11:24:12,886::task::827::TaskManager.Task::(resourceAcquired) Task=`03730c64-c931-400b-9ec1-985f81353d2e`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:24:12,886::task::990::TaskManager.Task::(_decref) Task=`03730c64-c931-400b-9ec1-985f81353d2e`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:24:12,887::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:24:12,887::task::1185::TaskManager.Task::(prepare) Task=`03730c64-c931-400b-9ec1-985f81353d2e`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:24:12,887::task::595::TaskManager.Task::(_updateState) Task=`03730c64-c931-400b-9ec1-985f81353d2e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:24:12,887::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:24:12,888::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:24:12,888::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:24:12,888::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:24:12,888::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:24:12,888::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:24:12,889::task::990::TaskManager.Task::(_decref) Task=`03730c64-c931-400b-9ec1-985f81353d2e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:24:14,776::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:24:14,859::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0394018 s, 26.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:24:16,142::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:24:16,170::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0187964 s, 218 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:24:16,871::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:24:16,945::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343179 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:24:18,957::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:24:19,034::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0377829 s, 27.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:24:21,047::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:24:21,138::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0407014 s, 25.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:24:22,955::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:24:22,955::task::595::TaskManager.Task::(_updateState) Task=`82d8d8ad-65d7-4a19-957f-89fd5f623ee5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:24:22,956::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:24:22,956::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:24:22,956::task::1185::TaskManager.Task::(prepare) Task=`82d8d8ad-65d7-4a19-957f-89fd5f623ee5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:24:22,956::task::595::TaskManager.Task::(_updateState) Task=`82d8d8ad-65d7-4a19-957f-89fd5f623ee5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:24:22,956::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:24:22,957::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:24:22,957::task::990::TaskManager.Task::(_decref) Task=`82d8d8ad-65d7-4a19-957f-89fd5f623ee5`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:24:23,029::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:24:23,029::task::595::TaskManager.Task::(_updateState) Task=`60a8d7d4-d1a6-4d03-8b13-3a716018f689`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:24:23,029::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:24:23,030::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`51df3670-1677-4556-9a9e-c43429af3121`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:24:23,030::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:24:23,030::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:24:23,030::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`51df3670-1677-4556-9a9e-c43429af3121`::Granted request >Thread-34::DEBUG::2014-07-24 11:24:23,031::task::827::TaskManager.Task::(resourceAcquired) Task=`60a8d7d4-d1a6-4d03-8b13-3a716018f689`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:24:23,031::task::990::TaskManager.Task::(_decref) Task=`60a8d7d4-d1a6-4d03-8b13-3a716018f689`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:24:23,032::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:24:23,032::task::1185::TaskManager.Task::(prepare) Task=`60a8d7d4-d1a6-4d03-8b13-3a716018f689`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:24:23,032::task::595::TaskManager.Task::(_updateState) Task=`60a8d7d4-d1a6-4d03-8b13-3a716018f689`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:24:23,032::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:24:23,032::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:24:23,033::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:24:23,033::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:24:23,033::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:24:23,033::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:24:23,033::task::990::TaskManager.Task::(_decref) Task=`60a8d7d4-d1a6-4d03-8b13-3a716018f689`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:24:23,150::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:24:23,224::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346875 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:24:25,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:24:25,317::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360762 s, 28.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:24:25,980::task::595::TaskManager.Task::(_updateState) Task=`09f88de0-1c8f-4351-8e3e-da793f3e7a8d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:24:25,980::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:24:25,980::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0187964', 'lastCheck': '9.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:24:25,980::task::1185::TaskManager.Task::(prepare) Task=`09f88de0-1c8f-4351-8e3e-da793f3e7a8d`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0187964', 'lastCheck': '9.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:24:25,980::task::595::TaskManager.Task::(_updateState) Task=`09f88de0-1c8f-4351-8e3e-da793f3e7a8d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:24:25,981::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:24:25,981::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:24:25,981::task::990::TaskManager.Task::(_decref) Task=`09f88de0-1c8f-4351-8e3e-da793f3e7a8d`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:24:26,174::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:24:26,188::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00537692 s, 762 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:24:27,329::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:24:27,402::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334887 s, 30.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:24:29,414::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:24:29,487::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328694 s, 31.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:24:29,812::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:24:31,499::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:24:31,571::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333357 s, 30.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:24:33,121::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:24:33,122::task::595::TaskManager.Task::(_updateState) Task=`edcebe24-f6ed-4e6f-9901-3e93f7cacf49`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:24:33,122::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:24:33,122::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:24:33,122::task::1185::TaskManager.Task::(prepare) Task=`edcebe24-f6ed-4e6f-9901-3e93f7cacf49`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:24:33,123::task::595::TaskManager.Task::(_updateState) Task=`edcebe24-f6ed-4e6f-9901-3e93f7cacf49`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:24:33,123::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:24:33,123::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:24:33,123::task::990::TaskManager.Task::(_decref) Task=`edcebe24-f6ed-4e6f-9901-3e93f7cacf49`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:24:33,169::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:24:33,170::task::595::TaskManager.Task::(_updateState) Task=`b86177a2-9a94-4c5f-900e-a26a30ac2cfe`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:24:33,170::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:24:33,170::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c98f4a50-88ba-494a-87d1-2fde6ae5fe1c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:24:33,171::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:24:33,171::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:24:33,171::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c98f4a50-88ba-494a-87d1-2fde6ae5fe1c`::Granted request >Thread-34::DEBUG::2014-07-24 11:24:33,171::task::827::TaskManager.Task::(resourceAcquired) Task=`b86177a2-9a94-4c5f-900e-a26a30ac2cfe`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:24:33,172::task::990::TaskManager.Task::(_decref) Task=`b86177a2-9a94-4c5f-900e-a26a30ac2cfe`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:24:33,172::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:24:33,172::task::1185::TaskManager.Task::(prepare) Task=`b86177a2-9a94-4c5f-900e-a26a30ac2cfe`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:24:33,173::task::595::TaskManager.Task::(_updateState) Task=`b86177a2-9a94-4c5f-900e-a26a30ac2cfe`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:24:33,173::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:24:33,173::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:24:33,173::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:24:33,173::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:24:33,174::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:24:33,174::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:24:33,174::task::990::TaskManager.Task::(_decref) Task=`b86177a2-9a94-4c5f-900e-a26a30ac2cfe`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:24:33,583::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:24:33,656::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337272 s, 30.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:24:35,669::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:24:35,740::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329484 s, 31.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:24:36,193::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:24:36,213::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0119754 s, 342 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:24:37,753::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:24:37,828::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03412 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:24:39,841::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:24:39,916::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361682 s, 28.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:24:41,360::task::595::TaskManager.Task::(_updateState) Task=`7a9d9cf3-1a96-4cb2-b920-42b3f1581068`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:24:41,361::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:24:41,361::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0119754', 'lastCheck': '5.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:24:41,361::task::1185::TaskManager.Task::(prepare) Task=`7a9d9cf3-1a96-4cb2-b920-42b3f1581068`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0119754', 'lastCheck': '5.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:24:41,361::task::595::TaskManager.Task::(_updateState) Task=`7a9d9cf3-1a96-4cb2-b920-42b3f1581068`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:24:41,361::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:24:41,361::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:24:41,362::task::990::TaskManager.Task::(_decref) Task=`7a9d9cf3-1a96-4cb2-b920-42b3f1581068`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:24:41,929::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:24:42,003::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343315 s, 29.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:24:43,233::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:24:43,234::task::595::TaskManager.Task::(_updateState) Task=`c0585ad3-1dd8-4024-be83-5e6080ae597c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:24:43,234::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:24:43,234::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:24:43,234::task::1185::TaskManager.Task::(prepare) Task=`c0585ad3-1dd8-4024-be83-5e6080ae597c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:24:43,235::task::595::TaskManager.Task::(_updateState) Task=`c0585ad3-1dd8-4024-be83-5e6080ae597c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:24:43,235::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:24:43,235::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:24:43,235::task::990::TaskManager.Task::(_decref) Task=`c0585ad3-1dd8-4024-be83-5e6080ae597c`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:24:43,266::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:24:43,266::task::595::TaskManager.Task::(_updateState) Task=`0e3d13b7-9d48-454c-a058-e722ba490e60`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:24:43,266::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:24:43,267::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`adbfcc52-aee1-4ee3-83a8-9f03d71b538d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:24:43,267::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:24:43,267::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:24:43,267::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`adbfcc52-aee1-4ee3-83a8-9f03d71b538d`::Granted request >Thread-34::DEBUG::2014-07-24 11:24:43,268::task::827::TaskManager.Task::(resourceAcquired) Task=`0e3d13b7-9d48-454c-a058-e722ba490e60`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:24:43,268::task::990::TaskManager.Task::(_decref) Task=`0e3d13b7-9d48-454c-a058-e722ba490e60`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:24:43,269::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:24:43,269::task::1185::TaskManager.Task::(prepare) Task=`0e3d13b7-9d48-454c-a058-e722ba490e60`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:24:43,269::task::595::TaskManager.Task::(_updateState) Task=`0e3d13b7-9d48-454c-a058-e722ba490e60`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:24:43,269::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:24:43,269::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:24:43,269::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:24:43,270::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:24:43,270::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:24:43,270::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:24:43,270::task::990::TaskManager.Task::(_decref) Task=`0e3d13b7-9d48-454c-a058-e722ba490e60`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:24:44,015::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:24:44,088::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341774 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:24:46,101::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:24:46,175::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351861 s, 29.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:24:46,218::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:24:46,239::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0121528 s, 337 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:24:48,187::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:24:48,548::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.320243 s, 3.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:24:50,560::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:24:50,669::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0694045 s, 14.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:24:52,681::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:24:52,756::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354464 s, 28.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:24:53,350::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:24:53,350::task::595::TaskManager.Task::(_updateState) Task=`965d5a2e-a8ab-4ddd-8243-7ee934f9e25e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:24:53,350::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:24:53,351::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:24:53,351::task::1185::TaskManager.Task::(prepare) Task=`965d5a2e-a8ab-4ddd-8243-7ee934f9e25e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:24:53,351::task::595::TaskManager.Task::(_updateState) Task=`965d5a2e-a8ab-4ddd-8243-7ee934f9e25e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:24:53,351::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:24:53,351::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:24:53,351::task::990::TaskManager.Task::(_decref) Task=`965d5a2e-a8ab-4ddd-8243-7ee934f9e25e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:24:53,383::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:24:53,383::task::595::TaskManager.Task::(_updateState) Task=`a2db3536-302e-4849-bc44-c3dcf9b675a7`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:24:53,383::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:24:53,384::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`6df1ae6a-8691-4b78-8905-e257dea3c691`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:24:53,384::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:24:53,384::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:24:53,384::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`6df1ae6a-8691-4b78-8905-e257dea3c691`::Granted request >Thread-34::DEBUG::2014-07-24 11:24:53,385::task::827::TaskManager.Task::(resourceAcquired) Task=`a2db3536-302e-4849-bc44-c3dcf9b675a7`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:24:53,385::task::990::TaskManager.Task::(_decref) Task=`a2db3536-302e-4849-bc44-c3dcf9b675a7`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:24:53,386::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:24:53,386::task::1185::TaskManager.Task::(prepare) Task=`a2db3536-302e-4849-bc44-c3dcf9b675a7`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:24:53,386::task::595::TaskManager.Task::(_updateState) Task=`a2db3536-302e-4849-bc44-c3dcf9b675a7`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:24:53,386::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:24:53,386::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:24:53,387::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:24:53,387::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:24:53,387::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:24:53,387::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:24:53,387::task::990::TaskManager.Task::(_decref) Task=`a2db3536-302e-4849-bc44-c3dcf9b675a7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:24:54,768::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:24:54,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353077 s, 29.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:24:56,243::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:24:56,264::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0121028 s, 338 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:24:56,770::task::595::TaskManager.Task::(_updateState) Task=`0d5f6776-ccb2-4a85-b47d-748c21a1c5f3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:24:56,770::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:24:56,770::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0121028', 'lastCheck': '0.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:24:56,770::task::1185::TaskManager.Task::(prepare) Task=`0d5f6776-ccb2-4a85-b47d-748c21a1c5f3`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0121028', 'lastCheck': '0.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:24:56,770::task::595::TaskManager.Task::(_updateState) Task=`0d5f6776-ccb2-4a85-b47d-748c21a1c5f3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:24:56,771::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:24:56,771::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:24:56,771::task::990::TaskManager.Task::(_decref) Task=`0d5f6776-ccb2-4a85-b47d-748c21a1c5f3`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:24:56,855::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:24:56,936::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344304 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:24:58,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:24:59,021::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330834 s, 31.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:24:59,846::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:25:01,033::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:25:01,105::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330865 s, 30.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:25:03,118::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:25:03,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340581 s, 30.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:25:03,444::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:25:03,445::task::595::TaskManager.Task::(_updateState) Task=`eba22a1f-305a-4fc2-9700-274bab8b72cd`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:25:03,445::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:25:03,445::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:25:03,445::task::1185::TaskManager.Task::(prepare) Task=`eba22a1f-305a-4fc2-9700-274bab8b72cd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:25:03,446::task::595::TaskManager.Task::(_updateState) Task=`eba22a1f-305a-4fc2-9700-274bab8b72cd`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:25:03,446::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:25:03,446::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:25:03,446::task::990::TaskManager.Task::(_decref) Task=`eba22a1f-305a-4fc2-9700-274bab8b72cd`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:25:03,479::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:25:03,479::task::595::TaskManager.Task::(_updateState) Task=`8d740755-8ef4-439c-b241-56f0c42ca374`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:25:03,479::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:25:03,480::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`8d527724-0d5e-4ee2-afc4-5bf215af08ce`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:25:03,480::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:25:03,480::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:25:03,480::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`8d527724-0d5e-4ee2-afc4-5bf215af08ce`::Granted request >Thread-34::DEBUG::2014-07-24 11:25:03,482::task::827::TaskManager.Task::(resourceAcquired) Task=`8d740755-8ef4-439c-b241-56f0c42ca374`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:25:03,482::task::990::TaskManager.Task::(_decref) Task=`8d740755-8ef4-439c-b241-56f0c42ca374`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:25:03,483::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:25:03,483::task::1185::TaskManager.Task::(prepare) Task=`8d740755-8ef4-439c-b241-56f0c42ca374`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:25:03,483::task::595::TaskManager.Task::(_updateState) Task=`8d740755-8ef4-439c-b241-56f0c42ca374`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:25:03,483::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:25:03,483::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:25:03,484::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:25:03,484::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:25:03,484::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:25:03,484::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:25:03,484::task::990::TaskManager.Task::(_decref) Task=`8d740755-8ef4-439c-b241-56f0c42ca374`::ref 0 aborting False >Thread-37::DEBUG::2014-07-24 11:25:04,566::task::595::TaskManager.Task::(_updateState) Task=`89c48ec0-f71b-439d-a5f6-4d3fee1f73cd`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:25:04,566::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:25:04,566::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:25:04,567::task::1185::TaskManager.Task::(prepare) Task=`89c48ec0-f71b-439d-a5f6-4d3fee1f73cd`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:25:04,567::task::595::TaskManager.Task::(_updateState) Task=`89c48ec0-f71b-439d-a5f6-4d3fee1f73cd`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:25:04,567::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:25:04,567::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:25:04,567::task::990::TaskManager.Task::(_decref) Task=`89c48ec0-f71b-439d-a5f6-4d3fee1f73cd`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:25:05,204::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:25:05,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339039 s, 30.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:25:06,269::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:25:06,289::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0116053 s, 353 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:25:07,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:25:07,579::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.197684 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:25:09,591::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:25:09,665::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350199 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:25:11,678::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:25:11,751::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343606 s, 29.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:25:12,291::task::595::TaskManager.Task::(_updateState) Task=`35cb04b4-fa47-469e-8304-1fe5bf266fe4`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:25:12,291::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:25:12,291::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0116053', 'lastCheck': '6.0', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:25:12,292::task::1185::TaskManager.Task::(prepare) Task=`35cb04b4-fa47-469e-8304-1fe5bf266fe4`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0116053', 'lastCheck': '6.0', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:25:12,292::task::595::TaskManager.Task::(_updateState) Task=`35cb04b4-fa47-469e-8304-1fe5bf266fe4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:25:12,292::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:25:12,292::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:25:12,292::task::990::TaskManager.Task::(_decref) Task=`35cb04b4-fa47-469e-8304-1fe5bf266fe4`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 11:25:13,548::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:25:13,549::task::595::TaskManager.Task::(_updateState) Task=`df73abcf-009e-49df-94b4-db7c080c88c7`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:25:13,549::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:25:13,549::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:25:13,549::task::1185::TaskManager.Task::(prepare) Task=`df73abcf-009e-49df-94b4-db7c080c88c7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:25:13,549::task::595::TaskManager.Task::(_updateState) Task=`df73abcf-009e-49df-94b4-db7c080c88c7`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:25:13,550::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:25:13,550::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:25:13,550::task::990::TaskManager.Task::(_decref) Task=`df73abcf-009e-49df-94b4-db7c080c88c7`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:25:13,620::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:25:13,620::task::595::TaskManager.Task::(_updateState) Task=`07c80abd-41d0-409a-86cc-0539af06d093`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:25:13,620::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:25:13,621::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`59c05b5a-8d55-4068-8586-631cf7aa7d9e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:25:13,621::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:25:13,621::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:25:13,621::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`59c05b5a-8d55-4068-8586-631cf7aa7d9e`::Granted request >Thread-34::DEBUG::2014-07-24 11:25:13,622::task::827::TaskManager.Task::(resourceAcquired) Task=`07c80abd-41d0-409a-86cc-0539af06d093`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:25:13,622::task::990::TaskManager.Task::(_decref) Task=`07c80abd-41d0-409a-86cc-0539af06d093`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:25:13,623::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:25:13,623::task::1185::TaskManager.Task::(prepare) Task=`07c80abd-41d0-409a-86cc-0539af06d093`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:25:13,623::task::595::TaskManager.Task::(_updateState) Task=`07c80abd-41d0-409a-86cc-0539af06d093`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:25:13,623::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:25:13,623::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:25:13,624::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:25:13,624::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:25:13,624::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:25:13,624::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:25:13,624::task::990::TaskManager.Task::(_decref) Task=`07c80abd-41d0-409a-86cc-0539af06d093`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:25:13,764::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:25:13,837::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331657 s, 30.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:25:15,849::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:25:15,924::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352048 s, 29.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:25:16,294::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:25:16,314::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0115174 s, 356 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:25:17,936::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:25:18,010::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349755 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:25:20,022::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:25:20,096::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340895 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:25:22,108::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:25:22,181::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336946 s, 30.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:25:23,718::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:25:23,719::task::595::TaskManager.Task::(_updateState) Task=`b1b47d09-3d05-4588-90f5-031f45434f40`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:25:23,719::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:25:23,720::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:25:23,720::task::1185::TaskManager.Task::(prepare) Task=`b1b47d09-3d05-4588-90f5-031f45434f40`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:25:23,720::task::595::TaskManager.Task::(_updateState) Task=`b1b47d09-3d05-4588-90f5-031f45434f40`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:25:23,720::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:25:23,720::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:25:23,720::task::990::TaskManager.Task::(_decref) Task=`b1b47d09-3d05-4588-90f5-031f45434f40`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:25:23,752::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:25:23,753::task::595::TaskManager.Task::(_updateState) Task=`a544469a-1d32-4c70-bf4a-7ea1cf8a6eb6`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:25:23,753::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:25:23,753::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`dd89436e-f1c7-4a56-820f-8ac2bcef17d2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:25:23,753::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:25:23,754::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:25:23,754::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`dd89436e-f1c7-4a56-820f-8ac2bcef17d2`::Granted request >Thread-34::DEBUG::2014-07-24 11:25:23,754::task::827::TaskManager.Task::(resourceAcquired) Task=`a544469a-1d32-4c70-bf4a-7ea1cf8a6eb6`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:25:23,754::task::990::TaskManager.Task::(_decref) Task=`a544469a-1d32-4c70-bf4a-7ea1cf8a6eb6`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:25:23,755::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:25:23,755::task::1185::TaskManager.Task::(prepare) Task=`a544469a-1d32-4c70-bf4a-7ea1cf8a6eb6`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:25:23,755::task::595::TaskManager.Task::(_updateState) Task=`a544469a-1d32-4c70-bf4a-7ea1cf8a6eb6`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:25:23,756::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:25:23,756::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:25:23,756::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:25:23,756::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:25:23,756::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:25:23,757::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:25:23,757::task::990::TaskManager.Task::(_decref) Task=`a544469a-1d32-4c70-bf4a-7ea1cf8a6eb6`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:25:24,193::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:25:24,266::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338748 s, 30.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:25:26,279::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-24 11:25:26,322::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:25:26,338::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000590721 s, 6.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:25:26,400::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0823669 s, 12.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:25:27,841::task::595::TaskManager.Task::(_updateState) Task=`e49406fe-46c2-44fc-aae0-6ad21403485c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:25:27,841::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:25:27,842::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000590721', 'lastCheck': '1.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:25:27,842::task::1185::TaskManager.Task::(prepare) Task=`e49406fe-46c2-44fc-aae0-6ad21403485c`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000590721', 'lastCheck': '1.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:25:27,842::task::595::TaskManager.Task::(_updateState) Task=`e49406fe-46c2-44fc-aae0-6ad21403485c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:25:27,842::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:25:27,842::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:25:27,842::task::990::TaskManager.Task::(_decref) Task=`e49406fe-46c2-44fc-aae0-6ad21403485c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:25:28,412::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:25:28,502::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359192 s, 28.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:25:29,883::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:25:30,514::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:25:30,589::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354272 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:25:32,601::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:25:32,674::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331446 s, 30.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:25:33,812::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:25:33,812::task::595::TaskManager.Task::(_updateState) Task=`40651a7b-6546-47a1-abf2-83e325fb89fd`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:25:33,812::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:25:33,813::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:25:33,813::task::1185::TaskManager.Task::(prepare) Task=`40651a7b-6546-47a1-abf2-83e325fb89fd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:25:33,813::task::595::TaskManager.Task::(_updateState) Task=`40651a7b-6546-47a1-abf2-83e325fb89fd`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:25:33,813::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:25:33,813::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:25:33,813::task::990::TaskManager.Task::(_decref) Task=`40651a7b-6546-47a1-abf2-83e325fb89fd`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:25:33,845::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:25:33,846::task::595::TaskManager.Task::(_updateState) Task=`3b8f2651-7a64-4963-b140-0421e71106f7`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:25:33,846::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:25:33,846::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`818bb049-a8df-4242-a8df-2e17e3ee9d31`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:25:33,846::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:25:33,847::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:25:33,847::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`818bb049-a8df-4242-a8df-2e17e3ee9d31`::Granted request >Thread-34::DEBUG::2014-07-24 11:25:33,847::task::827::TaskManager.Task::(resourceAcquired) Task=`3b8f2651-7a64-4963-b140-0421e71106f7`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:25:33,847::task::990::TaskManager.Task::(_decref) Task=`3b8f2651-7a64-4963-b140-0421e71106f7`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:25:33,848::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:25:33,848::task::1185::TaskManager.Task::(prepare) Task=`3b8f2651-7a64-4963-b140-0421e71106f7`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:25:33,848::task::595::TaskManager.Task::(_updateState) Task=`3b8f2651-7a64-4963-b140-0421e71106f7`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:25:33,849::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:25:33,849::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:25:33,849::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:25:33,849::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:25:33,849::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:25:33,850::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:25:33,850::task::990::TaskManager.Task::(_decref) Task=`3b8f2651-7a64-4963-b140-0421e71106f7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:25:34,687::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:25:34,760::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343154 s, 29.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:25:36,369::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:25:36,378::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000749921 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:25:36,772::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:25:36,846::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351618 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:25:38,859::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:25:38,932::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345896 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:25:40,945::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:25:41,017::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332338 s, 30.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:25:43,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:25:43,101::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331689 s, 30.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:25:43,226::task::595::TaskManager.Task::(_updateState) Task=`c6c538c5-3228-4dd7-ba69-3921931ac2db`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:25:43,226::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:25:43,226::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000749921', 'lastCheck': '6.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:25:43,226::task::1185::TaskManager.Task::(prepare) Task=`c6c538c5-3228-4dd7-ba69-3921931ac2db`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000749921', 'lastCheck': '6.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:25:43,226::task::595::TaskManager.Task::(_updateState) Task=`c6c538c5-3228-4dd7-ba69-3921931ac2db`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:25:43,227::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:25:43,227::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:25:43,227::task::990::TaskManager.Task::(_decref) Task=`c6c538c5-3228-4dd7-ba69-3921931ac2db`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 11:25:43,920::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:25:43,921::task::595::TaskManager.Task::(_updateState) Task=`cc50fa58-0322-4418-9dea-1b7250276e12`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:25:43,921::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:25:43,921::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:25:43,921::task::1185::TaskManager.Task::(prepare) Task=`cc50fa58-0322-4418-9dea-1b7250276e12`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:25:43,922::task::595::TaskManager.Task::(_updateState) Task=`cc50fa58-0322-4418-9dea-1b7250276e12`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:25:43,922::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:25:43,922::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:25:43,922::task::990::TaskManager.Task::(_decref) Task=`cc50fa58-0322-4418-9dea-1b7250276e12`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:25:43,974::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:25:43,975::task::595::TaskManager.Task::(_updateState) Task=`cc1320a8-212f-4df7-8c6b-71f821fa2bf0`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:25:43,975::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:25:43,975::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`5830fe31-33f3-4617-a182-84c74a656ad5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:25:43,976::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:25:43,976::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:25:43,976::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`5830fe31-33f3-4617-a182-84c74a656ad5`::Granted request >Thread-34::DEBUG::2014-07-24 11:25:43,976::task::827::TaskManager.Task::(resourceAcquired) Task=`cc1320a8-212f-4df7-8c6b-71f821fa2bf0`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:25:43,977::task::990::TaskManager.Task::(_decref) Task=`cc1320a8-212f-4df7-8c6b-71f821fa2bf0`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:25:43,977::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:25:43,977::task::1185::TaskManager.Task::(prepare) Task=`cc1320a8-212f-4df7-8c6b-71f821fa2bf0`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:25:43,978::task::595::TaskManager.Task::(_updateState) Task=`cc1320a8-212f-4df7-8c6b-71f821fa2bf0`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:25:43,978::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:25:43,978::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:25:43,978::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:25:43,978::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:25:43,978::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:25:43,979::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:25:43,979::task::990::TaskManager.Task::(_decref) Task=`cc1320a8-212f-4df7-8c6b-71f821fa2bf0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:25:45,113::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:25:45,188::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352198 s, 29.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:25:46,383::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:25:46,407::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0156191 s, 262 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:25:47,200::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:25:47,273::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329109 s, 31.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:25:49,285::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:25:49,361::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354989 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:25:51,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:25:51,449::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357064 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:25:53,461::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:25:53,535::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348745 s, 29.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:25:54,050::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:25:54,051::task::595::TaskManager.Task::(_updateState) Task=`c52fae66-65b8-4c1b-8d8d-28a1b272a42e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:25:54,051::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:25:54,051::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:25:54,051::task::1185::TaskManager.Task::(prepare) Task=`c52fae66-65b8-4c1b-8d8d-28a1b272a42e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:25:54,052::task::595::TaskManager.Task::(_updateState) Task=`c52fae66-65b8-4c1b-8d8d-28a1b272a42e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:25:54,052::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:25:54,052::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:25:54,052::task::990::TaskManager.Task::(_decref) Task=`c52fae66-65b8-4c1b-8d8d-28a1b272a42e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:25:54,087::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:25:54,087::task::595::TaskManager.Task::(_updateState) Task=`0ce82555-7b7c-4075-9e81-04d44efc0a18`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:25:54,087::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:25:54,088::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7cb1038e-015a-472c-891f-647d1be4abce`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:25:54,088::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:25:54,088::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:25:54,088::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7cb1038e-015a-472c-891f-647d1be4abce`::Granted request >Thread-34::DEBUG::2014-07-24 11:25:54,089::task::827::TaskManager.Task::(resourceAcquired) Task=`0ce82555-7b7c-4075-9e81-04d44efc0a18`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:25:54,089::task::990::TaskManager.Task::(_decref) Task=`0ce82555-7b7c-4075-9e81-04d44efc0a18`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:25:54,090::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:25:54,090::task::1185::TaskManager.Task::(prepare) Task=`0ce82555-7b7c-4075-9e81-04d44efc0a18`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:25:54,090::task::595::TaskManager.Task::(_updateState) Task=`0ce82555-7b7c-4075-9e81-04d44efc0a18`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:25:54,090::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:25:54,090::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:25:54,091::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:25:54,091::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:25:54,091::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:25:54,091::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:25:54,091::task::990::TaskManager.Task::(_decref) Task=`0ce82555-7b7c-4075-9e81-04d44efc0a18`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:25:55,547::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:25:55,622::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350665 s, 29.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:25:56,412::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:25:56,421::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000693305 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:25:57,634::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:25:57,958::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356673 s, 28.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:25:58,604::task::595::TaskManager.Task::(_updateState) Task=`aa57ac93-2a4e-4019-9536-59ee97326ed1`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:25:58,605::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:25:58,605::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693305', 'lastCheck': '2.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:25:58,605::task::1185::TaskManager.Task::(prepare) Task=`aa57ac93-2a4e-4019-9536-59ee97326ed1`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693305', 'lastCheck': '2.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:25:58,605::task::595::TaskManager.Task::(_updateState) Task=`aa57ac93-2a4e-4019-9536-59ee97326ed1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:25:58,605::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:25:58,605::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:25:58,606::task::990::TaskManager.Task::(_decref) Task=`aa57ac93-2a4e-4019-9536-59ee97326ed1`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-07-24 11:25:59,919::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:25:59,970::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:26:00,046::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342388 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:26:02,059::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:26:02,131::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329121 s, 31.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:26:04,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-24 11:26:04,153::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:26:04,153::task::595::TaskManager.Task::(_updateState) Task=`0c60c9ea-b1c7-418e-b37b-67428f9e1d5b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:26:04,154::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:26:04,154::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:26:04,155::task::1185::TaskManager.Task::(prepare) Task=`0c60c9ea-b1c7-418e-b37b-67428f9e1d5b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:26:04,155::task::595::TaskManager.Task::(_updateState) Task=`0c60c9ea-b1c7-418e-b37b-67428f9e1d5b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:26:04,155::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:26:04,155::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:26:04,156::task::990::TaskManager.Task::(_decref) Task=`0c60c9ea-b1c7-418e-b37b-67428f9e1d5b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:26:04,191::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:26:04,192::task::595::TaskManager.Task::(_updateState) Task=`bfad3609-a0a9-4d62-bf49-7b0838acd4b4`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:26:04,194::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:26:04,195::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`9c4eceaf-0737-41d2-9c0c-9db474c4e81a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:26:04,196::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:26:04,197::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:26:04,198::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`9c4eceaf-0737-41d2-9c0c-9db474c4e81a`::Granted request >Thread-34::DEBUG::2014-07-24 11:26:04,199::task::827::TaskManager.Task::(resourceAcquired) Task=`bfad3609-a0a9-4d62-bf49-7b0838acd4b4`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:26:04,200::task::990::TaskManager.Task::(_decref) Task=`bfad3609-a0a9-4d62-bf49-7b0838acd4b4`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:26:04,203::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:26:04,204::task::1185::TaskManager.Task::(prepare) Task=`bfad3609-a0a9-4d62-bf49-7b0838acd4b4`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:26:04,205::task::595::TaskManager.Task::(_updateState) Task=`bfad3609-a0a9-4d62-bf49-7b0838acd4b4`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:26:04,205::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:26:04,206::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:26:04,207::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:26:04,208::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:26:04,209::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:26:04,209::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:26:04,210::task::990::TaskManager.Task::(_decref) Task=`bfad3609-a0a9-4d62-bf49-7b0838acd4b4`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:26:04,239::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034819 s, 29.4 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:26:04,731::task::595::TaskManager.Task::(_updateState) Task=`a6443b8e-164b-4802-9f22-76f060a531e6`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:26:04,731::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:26:04,732::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:26:04,732::task::1185::TaskManager.Task::(prepare) Task=`a6443b8e-164b-4802-9f22-76f060a531e6`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:26:04,732::task::595::TaskManager.Task::(_updateState) Task=`a6443b8e-164b-4802-9f22-76f060a531e6`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:26:04,732::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:26:04,732::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:26:04,732::task::990::TaskManager.Task::(_decref) Task=`a6443b8e-164b-4802-9f22-76f060a531e6`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:26:06,251::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:26:06,324::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034385 s, 29.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:26:06,426::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:26:06,435::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000731731 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:26:08,337::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:26:08,415::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0391416 s, 26.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:26:10,428::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:26:10,503::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356608 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:26:12,515::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:26:12,590::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357253 s, 28.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:26:14,301::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:26:14,301::task::595::TaskManager.Task::(_updateState) Task=`4a014ac3-26bf-41c2-a8f3-19bd41583029`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:26:14,302::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:26:14,302::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:26:14,302::task::1185::TaskManager.Task::(prepare) Task=`4a014ac3-26bf-41c2-a8f3-19bd41583029`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:26:14,302::task::595::TaskManager.Task::(_updateState) Task=`4a014ac3-26bf-41c2-a8f3-19bd41583029`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:26:14,302::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:26:14,303::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:26:14,303::task::990::TaskManager.Task::(_decref) Task=`4a014ac3-26bf-41c2-a8f3-19bd41583029`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:26:14,370::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:26:14,370::task::595::TaskManager.Task::(_updateState) Task=`68e9a430-83ca-4993-9e68-2a24914eec9f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:26:14,370::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:26:14,371::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`db57acbe-00dc-4622-bc0d-b3ddcbacc75c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:26:14,371::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:26:14,371::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:26:14,371::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`db57acbe-00dc-4622-bc0d-b3ddcbacc75c`::Granted request >Thread-34::DEBUG::2014-07-24 11:26:14,372::task::827::TaskManager.Task::(resourceAcquired) Task=`68e9a430-83ca-4993-9e68-2a24914eec9f`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:26:14,373::task::990::TaskManager.Task::(_decref) Task=`68e9a430-83ca-4993-9e68-2a24914eec9f`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:26:14,373::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:26:14,373::task::1185::TaskManager.Task::(prepare) Task=`68e9a430-83ca-4993-9e68-2a24914eec9f`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:26:14,374::task::595::TaskManager.Task::(_updateState) Task=`68e9a430-83ca-4993-9e68-2a24914eec9f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:26:14,374::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:26:14,374::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:26:14,374::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:26:14,374::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:26:14,375::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:26:14,375::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:26:14,375::task::990::TaskManager.Task::(_decref) Task=`68e9a430-83ca-4993-9e68-2a24914eec9f`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 11:26:14,422::task::595::TaskManager.Task::(_updateState) Task=`dee505a2-57f1-4bbe-b2b9-2bc8222c2e59`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:26:14,422::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:26:14,422::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000731731', 'lastCheck': '8.0', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:26:14,422::task::1185::TaskManager.Task::(prepare) Task=`dee505a2-57f1-4bbe-b2b9-2bc8222c2e59`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000731731', 'lastCheck': '8.0', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:26:14,422::task::595::TaskManager.Task::(_updateState) Task=`dee505a2-57f1-4bbe-b2b9-2bc8222c2e59`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:26:14,423::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:26:14,423::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:26:14,423::task::990::TaskManager.Task::(_decref) Task=`dee505a2-57f1-4bbe-b2b9-2bc8222c2e59`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:26:14,603::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:26:14,676::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333392 s, 30.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:26:16,439::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 23aa0606-edc3-4882-a4aa-18aa1983458f >Thread-18::DEBUG::2014-07-24 11:26:16,440::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-18::DEBUG::2014-07-24 11:26:16,440::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:26:16,449::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000655517 s, 3.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:26:16,450::misc::264::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000655517 s, 3.1 MB/s'], size: 2048 >Thread-18::DEBUG::2014-07-24 11:26:16,450::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-18::WARNING::2014-07-24 11:26:16,450::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-18::DEBUG::2014-07-24 11:26:16,450::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-18::DEBUG::2014-07-24 11:26:16,451::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 11:26:16,451::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 11:26:16,451::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 11:26:16,451::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 11:26:16,452::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 11:26:16,452::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:26:16,688::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-24 11:26:16,724::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:26:16,729::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 11:26:16,731::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'LOCKPOLICY=', 'POOL_DOMAINS=23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'POOL_DESCRIPTION=DS1', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_UUID=637ea13c-81a8-4b44-8cab-961458b01883', 'POOL_SPM_ID=1', '_SHA_CKSUM=a749afdc7119a2d6aad840af5c63c9b28c0b612c', 'POOL_SPM_LVER=0'] >Thread-18::INFO::2014-07-24 11:26:16,736::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_imageNS already registered >Thread-18::INFO::2014-07-24 11:26:16,737::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_volumeNS already registered >Thread-18::INFO::2014-07-24 11:26:16,738::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_lvmActivationNS already registered >Thread-18::DEBUG::2014-07-24 11:26:16,743::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:26:16,796::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0663231 s, 15.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:26:16,901::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:26:16,902::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:26:16,912::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000615866 s, 6.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:26:18,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:26:19,173::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.324721 s, 3.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:26:21,185::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:26:21,302::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0731065 s, 14.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:26:23,315::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:26:23,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336199 s, 30.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:26:24,432::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:26:24,432::task::595::TaskManager.Task::(_updateState) Task=`86a6699c-3629-4ea7-a4c8-e5c5fe655aaa`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:26:24,432::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:26:24,433::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:26:24,433::task::1185::TaskManager.Task::(prepare) Task=`86a6699c-3629-4ea7-a4c8-e5c5fe655aaa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:26:24,433::task::595::TaskManager.Task::(_updateState) Task=`86a6699c-3629-4ea7-a4c8-e5c5fe655aaa`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:26:24,433::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:26:24,433::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:26:24,434::task::990::TaskManager.Task::(_decref) Task=`86a6699c-3629-4ea7-a4c8-e5c5fe655aaa`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:26:24,468::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:26:24,468::task::595::TaskManager.Task::(_updateState) Task=`e19d6477-c85b-4716-97c8-1ce0fbdd259a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:26:24,468::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:26:24,468::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`287b0821-eb75-416c-a4a3-9039af582189`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:26:24,469::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:26:24,469::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:26:24,469::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`287b0821-eb75-416c-a4a3-9039af582189`::Granted request >Thread-34::DEBUG::2014-07-24 11:26:24,469::task::827::TaskManager.Task::(resourceAcquired) Task=`e19d6477-c85b-4716-97c8-1ce0fbdd259a`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:26:24,470::task::990::TaskManager.Task::(_decref) Task=`e19d6477-c85b-4716-97c8-1ce0fbdd259a`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:26:24,470::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:26:24,470::task::1185::TaskManager.Task::(prepare) Task=`e19d6477-c85b-4716-97c8-1ce0fbdd259a`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:26:24,471::task::595::TaskManager.Task::(_updateState) Task=`e19d6477-c85b-4716-97c8-1ce0fbdd259a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:26:24,471::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:26:24,471::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:26:24,471::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:26:24,471::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:26:24,471::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:26:24,472::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:26:24,472::task::990::TaskManager.Task::(_decref) Task=`e19d6477-c85b-4716-97c8-1ce0fbdd259a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:26:25,404::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:26:25,478::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340037 s, 30.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:26:26,916::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:26:26,926::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000692542 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:26:27,490::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:26:27,565::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343383 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:26:29,577::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:26:29,651::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341635 s, 30.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:26:29,779::task::595::TaskManager.Task::(_updateState) Task=`2b5ec699-74bf-425d-804d-c1982d2cd562`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:26:29,779::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:26:29,779::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000692542', 'lastCheck': '2.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:26:29,779::task::1185::TaskManager.Task::(prepare) Task=`2b5ec699-74bf-425d-804d-c1982d2cd562`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000692542', 'lastCheck': '2.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:26:29,779::task::595::TaskManager.Task::(_updateState) Task=`2b5ec699-74bf-425d-804d-c1982d2cd562`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:26:29,780::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:26:29,780::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:26:29,780::task::990::TaskManager.Task::(_decref) Task=`2b5ec699-74bf-425d-804d-c1982d2cd562`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-07-24 11:26:29,953::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:26:31,663::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:26:31,737::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344675 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:26:33,750::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:26:33,823::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335485 s, 30.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:26:34,531::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:26:34,531::task::595::TaskManager.Task::(_updateState) Task=`0b6b7aeb-80b0-46e0-b9a9-929995f48fe9`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:26:34,532::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:26:34,532::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:26:34,532::task::1185::TaskManager.Task::(prepare) Task=`0b6b7aeb-80b0-46e0-b9a9-929995f48fe9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:26:34,532::task::595::TaskManager.Task::(_updateState) Task=`0b6b7aeb-80b0-46e0-b9a9-929995f48fe9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:26:34,532::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:26:34,533::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:26:34,533::task::990::TaskManager.Task::(_decref) Task=`0b6b7aeb-80b0-46e0-b9a9-929995f48fe9`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:26:34,574::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:26:34,575::task::595::TaskManager.Task::(_updateState) Task=`dd08c189-1398-46cc-9886-9147e2cf94c6`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:26:34,575::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:26:34,575::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`3a8ca420-472f-48e2-a1fb-181e2eeed66a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:26:34,575::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:26:34,576::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:26:34,576::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`3a8ca420-472f-48e2-a1fb-181e2eeed66a`::Granted request >Thread-34::DEBUG::2014-07-24 11:26:34,576::task::827::TaskManager.Task::(resourceAcquired) Task=`dd08c189-1398-46cc-9886-9147e2cf94c6`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:26:34,576::task::990::TaskManager.Task::(_decref) Task=`dd08c189-1398-46cc-9886-9147e2cf94c6`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:26:34,577::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:26:34,577::task::1185::TaskManager.Task::(prepare) Task=`dd08c189-1398-46cc-9886-9147e2cf94c6`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:26:34,577::task::595::TaskManager.Task::(_updateState) Task=`dd08c189-1398-46cc-9886-9147e2cf94c6`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:26:34,578::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:26:34,578::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:26:34,578::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:26:34,578::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:26:34,578::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:26:34,578::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:26:34,579::task::990::TaskManager.Task::(_decref) Task=`dd08c189-1398-46cc-9886-9147e2cf94c6`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:26:35,835::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:26:35,910::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347353 s, 29.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:26:36,931::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:26:36,940::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00070476 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:26:37,922::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:26:37,998::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360881 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:26:40,010::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:26:40,085::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353408 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:26:42,097::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:26:42,176::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358472 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:26:44,188::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:26:44,262::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343115 s, 29.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:26:44,640::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:26:44,641::task::595::TaskManager.Task::(_updateState) Task=`059d269f-d790-4fc1-bddb-692e6e4bf5ec`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:26:44,641::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:26:44,641::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:26:44,642::task::1185::TaskManager.Task::(prepare) Task=`059d269f-d790-4fc1-bddb-692e6e4bf5ec`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:26:44,642::task::595::TaskManager.Task::(_updateState) Task=`059d269f-d790-4fc1-bddb-692e6e4bf5ec`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:26:44,642::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:26:44,642::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:26:44,642::task::990::TaskManager.Task::(_decref) Task=`059d269f-d790-4fc1-bddb-692e6e4bf5ec`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:26:44,675::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:26:44,675::task::595::TaskManager.Task::(_updateState) Task=`fb13ecea-5fd2-4598-8818-ca268a5538f9`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:26:44,675::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:26:44,676::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`3c830ba8-0569-4141-a5ba-552941fafc3a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:26:44,676::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:26:44,676::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:26:44,676::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`3c830ba8-0569-4141-a5ba-552941fafc3a`::Granted request >Thread-34::DEBUG::2014-07-24 11:26:44,677::task::827::TaskManager.Task::(resourceAcquired) Task=`fb13ecea-5fd2-4598-8818-ca268a5538f9`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:26:44,677::task::990::TaskManager.Task::(_decref) Task=`fb13ecea-5fd2-4598-8818-ca268a5538f9`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:26:44,678::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:26:44,678::task::1185::TaskManager.Task::(prepare) Task=`fb13ecea-5fd2-4598-8818-ca268a5538f9`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:26:44,678::task::595::TaskManager.Task::(_updateState) Task=`fb13ecea-5fd2-4598-8818-ca268a5538f9`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:26:44,678::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:26:44,678::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:26:44,678::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:26:44,679::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:26:44,679::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:26:44,679::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:26:44,679::task::990::TaskManager.Task::(_decref) Task=`fb13ecea-5fd2-4598-8818-ca268a5538f9`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 11:26:45,212::task::595::TaskManager.Task::(_updateState) Task=`784c4339-dc91-4134-bc27-d3bd228e9480`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:26:45,222::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:26:45,222::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00070476', 'lastCheck': '8.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:26:45,222::task::1185::TaskManager.Task::(prepare) Task=`784c4339-dc91-4134-bc27-d3bd228e9480`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00070476', 'lastCheck': '8.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:26:45,222::task::595::TaskManager.Task::(_updateState) Task=`784c4339-dc91-4134-bc27-d3bd228e9480`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:26:45,223::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:26:45,223::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:26:45,223::task::990::TaskManager.Task::(_decref) Task=`784c4339-dc91-4134-bc27-d3bd228e9480`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:26:46,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:26:46,350::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355435 s, 28.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:26:46,947::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:26:46,956::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000805851 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:26:48,362::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:26:48,440::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351831 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:26:50,453::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:26:50,526::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330544 s, 31.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:26:52,538::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:26:52,613::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350997 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:26:54,625::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:26:54,700::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356756 s, 28.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:26:54,740::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:26:54,741::task::595::TaskManager.Task::(_updateState) Task=`0560bc51-1b23-42d2-a0fd-b7eaaa78adaf`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:26:54,742::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:26:54,744::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:26:54,744::task::1185::TaskManager.Task::(prepare) Task=`0560bc51-1b23-42d2-a0fd-b7eaaa78adaf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:26:54,745::task::595::TaskManager.Task::(_updateState) Task=`0560bc51-1b23-42d2-a0fd-b7eaaa78adaf`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:26:54,746::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:26:54,746::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:26:54,746::task::990::TaskManager.Task::(_decref) Task=`0560bc51-1b23-42d2-a0fd-b7eaaa78adaf`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:26:54,787::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:26:54,787::task::595::TaskManager.Task::(_updateState) Task=`7715a937-93d0-4918-8c84-f49be91c26b7`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:26:54,787::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:26:54,788::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4f9fb778-a215-4a3a-a45e-bc0437683b5e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:26:54,788::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:26:54,788::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:26:54,788::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4f9fb778-a215-4a3a-a45e-bc0437683b5e`::Granted request >Thread-34::DEBUG::2014-07-24 11:26:54,788::task::827::TaskManager.Task::(resourceAcquired) Task=`7715a937-93d0-4918-8c84-f49be91c26b7`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:26:54,789::task::990::TaskManager.Task::(_decref) Task=`7715a937-93d0-4918-8c84-f49be91c26b7`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:26:54,789::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:26:54,790::task::1185::TaskManager.Task::(prepare) Task=`7715a937-93d0-4918-8c84-f49be91c26b7`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:26:54,790::task::595::TaskManager.Task::(_updateState) Task=`7715a937-93d0-4918-8c84-f49be91c26b7`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:26:54,790::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:26:54,790::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:26:54,790::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:26:54,790::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:26:54,791::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:26:54,791::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:26:54,791::task::990::TaskManager.Task::(_decref) Task=`7715a937-93d0-4918-8c84-f49be91c26b7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:26:56,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:26:56,799::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0472406 s, 21.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:26:56,961::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:26:56,970::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000799 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:26:58,811::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:26:58,891::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0371215 s, 27.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:26:59,988::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-14::DEBUG::2014-07-24 11:27:00,634::task::595::TaskManager.Task::(_updateState) Task=`6c747a2d-2fc8-457c-ac14-75c758e2d1f5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:27:00,634::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:27:00,634::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000799', 'lastCheck': '3.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:27:00,634::task::1185::TaskManager.Task::(prepare) Task=`6c747a2d-2fc8-457c-ac14-75c758e2d1f5`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000799', 'lastCheck': '3.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:27:00,634::task::595::TaskManager.Task::(_updateState) Task=`6c747a2d-2fc8-457c-ac14-75c758e2d1f5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:27:00,635::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:27:00,635::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:27:00,635::task::990::TaskManager.Task::(_decref) Task=`6c747a2d-2fc8-457c-ac14-75c758e2d1f5`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:27:00,903::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:27:00,977::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346471 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:27:02,990::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:27:03,065::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361729 s, 28.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:27:04,852::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [22918c4c] >Thread-14::DEBUG::2014-07-24 11:27:04,852::task::595::TaskManager.Task::(_updateState) Task=`353084d2-4ab7-4a00-ace9-f4a8e432d356`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:27:04,852::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:27:04,853::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:27:04,853::task::1185::TaskManager.Task::(prepare) Task=`353084d2-4ab7-4a00-ace9-f4a8e432d356`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:27:04,853::task::595::TaskManager.Task::(_updateState) Task=`353084d2-4ab7-4a00-ace9-f4a8e432d356`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:27:04,853::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:27:04,853::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:27:04,853::task::990::TaskManager.Task::(_decref) Task=`353084d2-4ab7-4a00-ace9-f4a8e432d356`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:27:04,891::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [22918c4c] >Thread-34::DEBUG::2014-07-24 11:27:04,892::task::595::TaskManager.Task::(_updateState) Task=`771fc296-0805-4509-ab29-32ad9614d501`::moving from state init -> state preparing >Thread-37::DEBUG::2014-07-24 11:27:04,892::task::595::TaskManager.Task::(_updateState) Task=`af769efe-23c0-4aad-a447-b04560f7fc1c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:27:04,893::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-37::INFO::2014-07-24 11:27:04,894::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-34::DEBUG::2014-07-24 11:27:04,895::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`3f420400-1806-4500-8c16-6a3d3280da92`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:27:04,895::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-37::INFO::2014-07-24 11:27:04,896::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-34::DEBUG::2014-07-24 11:27:04,897::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-37::DEBUG::2014-07-24 11:27:04,897::task::1185::TaskManager.Task::(prepare) Task=`af769efe-23c0-4aad-a447-b04560f7fc1c`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-34::DEBUG::2014-07-24 11:27:04,898::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`3f420400-1806-4500-8c16-6a3d3280da92`::Granted request >Thread-37::DEBUG::2014-07-24 11:27:04,898::task::595::TaskManager.Task::(_updateState) Task=`af769efe-23c0-4aad-a447-b04560f7fc1c`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:27:04,899::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:27:04,899::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:27:04,900::task::990::TaskManager.Task::(_decref) Task=`af769efe-23c0-4aad-a447-b04560f7fc1c`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:27:04,900::task::827::TaskManager.Task::(resourceAcquired) Task=`771fc296-0805-4509-ab29-32ad9614d501`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:27:04,901::task::990::TaskManager.Task::(_decref) Task=`771fc296-0805-4509-ab29-32ad9614d501`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:27:04,902::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:27:04,902::task::1185::TaskManager.Task::(prepare) Task=`771fc296-0805-4509-ab29-32ad9614d501`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:27:04,902::task::595::TaskManager.Task::(_updateState) Task=`771fc296-0805-4509-ab29-32ad9614d501`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:27:04,902::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:27:04,903::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:27:04,903::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:27:04,903::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:27:04,903::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:27:04,903::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:27:04,904::task::990::TaskManager.Task::(_decref) Task=`771fc296-0805-4509-ab29-32ad9614d501`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:27:05,078::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:27:05,151::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335401 s, 30.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:27:06,975::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:27:06,992::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00808171 s, 507 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:27:07,163::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:27:07,236::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336075 s, 30.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:27:09,248::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:27:09,324::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362699 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:27:11,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:27:11,409::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337971 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:27:13,421::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:27:13,500::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0399071 s, 25.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:27:14,969::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:27:14,970::task::595::TaskManager.Task::(_updateState) Task=`ef0ef375-862a-49e6-ad89-8ed4203ff99d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:27:14,970::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:27:14,970::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:27:14,971::task::1185::TaskManager.Task::(prepare) Task=`ef0ef375-862a-49e6-ad89-8ed4203ff99d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:27:14,971::task::595::TaskManager.Task::(_updateState) Task=`ef0ef375-862a-49e6-ad89-8ed4203ff99d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:27:14,971::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:27:14,971::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:27:14,971::task::990::TaskManager.Task::(_decref) Task=`ef0ef375-862a-49e6-ad89-8ed4203ff99d`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:27:15,012::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:27:15,012::task::595::TaskManager.Task::(_updateState) Task=`3f9c07dd-c476-4d0c-83d8-6e8a596b5517`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:27:15,012::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:27:15,013::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`a2e1abef-7b56-4d52-89ee-8ddd3fe0f19f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:27:15,013::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:27:15,013::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:27:15,013::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`a2e1abef-7b56-4d52-89ee-8ddd3fe0f19f`::Granted request >Thread-34::DEBUG::2014-07-24 11:27:15,014::task::827::TaskManager.Task::(resourceAcquired) Task=`3f9c07dd-c476-4d0c-83d8-6e8a596b5517`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:27:15,014::task::990::TaskManager.Task::(_decref) Task=`3f9c07dd-c476-4d0c-83d8-6e8a596b5517`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:27:15,015::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:27:15,015::task::1185::TaskManager.Task::(prepare) Task=`3f9c07dd-c476-4d0c-83d8-6e8a596b5517`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:27:15,015::task::595::TaskManager.Task::(_updateState) Task=`3f9c07dd-c476-4d0c-83d8-6e8a596b5517`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:27:15,015::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:27:15,015::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:27:15,015::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:27:15,016::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:27:15,016::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:27:15,016::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:27:15,016::task::990::TaskManager.Task::(_decref) Task=`3f9c07dd-c476-4d0c-83d8-6e8a596b5517`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:27:15,513::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:27:15,585::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338916 s, 30.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:27:16,011::task::595::TaskManager.Task::(_updateState) Task=`63918cf7-9929-412b-b958-99e12876d794`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:27:16,011::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:27:16,011::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00808171', 'lastCheck': '9.0', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:27:16,012::task::1185::TaskManager.Task::(prepare) Task=`63918cf7-9929-412b-b958-99e12876d794`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00808171', 'lastCheck': '9.0', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:27:16,012::task::595::TaskManager.Task::(_updateState) Task=`63918cf7-9929-412b-b958-99e12876d794`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:27:16,012::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:27:16,012::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:27:16,012::task::990::TaskManager.Task::(_decref) Task=`63918cf7-9929-412b-b958-99e12876d794`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:27:16,997::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:27:17,006::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000711366 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:27:17,598::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:27:17,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336994 s, 30.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:27:19,685::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:27:19,757::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033643 s, 30.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:27:21,770::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:27:21,842::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330624 s, 31.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:27:23,854::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:27:23,930::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356473 s, 28.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:27:25,075::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:27:25,075::task::595::TaskManager.Task::(_updateState) Task=`99ec0b9c-a7fa-4162-85d4-12ea72f84603`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:27:25,075::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:27:25,076::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:27:25,076::task::1185::TaskManager.Task::(prepare) Task=`99ec0b9c-a7fa-4162-85d4-12ea72f84603`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:27:25,076::task::595::TaskManager.Task::(_updateState) Task=`99ec0b9c-a7fa-4162-85d4-12ea72f84603`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:27:25,076::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:27:25,077::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:27:25,077::task::990::TaskManager.Task::(_decref) Task=`99ec0b9c-a7fa-4162-85d4-12ea72f84603`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:27:25,117::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:27:25,117::task::595::TaskManager.Task::(_updateState) Task=`bd3e1d40-9253-40aa-ad71-de27fa539509`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:27:25,117::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:27:25,118::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`743536bb-800a-46e5-86df-325df69f9615`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:27:25,118::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:27:25,118::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:27:25,118::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`743536bb-800a-46e5-86df-325df69f9615`::Granted request >Thread-34::DEBUG::2014-07-24 11:27:25,119::task::827::TaskManager.Task::(resourceAcquired) Task=`bd3e1d40-9253-40aa-ad71-de27fa539509`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:27:25,119::task::990::TaskManager.Task::(_decref) Task=`bd3e1d40-9253-40aa-ad71-de27fa539509`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:27:25,119::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:27:25,120::task::1185::TaskManager.Task::(prepare) Task=`bd3e1d40-9253-40aa-ad71-de27fa539509`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:27:25,120::task::595::TaskManager.Task::(_updateState) Task=`bd3e1d40-9253-40aa-ad71-de27fa539509`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:27:25,120::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:27:25,120::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:27:25,120::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:27:25,121::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:27:25,121::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:27:25,121::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:27:25,121::task::990::TaskManager.Task::(_decref) Task=`bd3e1d40-9253-40aa-ad71-de27fa539509`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:27:25,942::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:27:26,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343768 s, 29.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:27:27,011::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:27:27,028::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000760681 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:27:28,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:27:28,103::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353442 s, 29.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:27:30,031::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:27:30,115::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:27:30,190::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358216 s, 28.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:27:31,487::task::595::TaskManager.Task::(_updateState) Task=`cd9017c7-7911-47f7-9463-f8ea9dd4137a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:27:31,488::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:27:31,488::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000760681', 'lastCheck': '4.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:27:31,488::task::1185::TaskManager.Task::(prepare) Task=`cd9017c7-7911-47f7-9463-f8ea9dd4137a`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000760681', 'lastCheck': '4.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:27:31,488::task::595::TaskManager.Task::(_updateState) Task=`cd9017c7-7911-47f7-9463-f8ea9dd4137a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:27:31,488::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:27:31,489::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:27:31,489::task::990::TaskManager.Task::(_decref) Task=`cd9017c7-7911-47f7-9463-f8ea9dd4137a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:27:32,203::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:27:32,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356738 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:27:34,290::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:27:34,363::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337046 s, 30.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:27:35,232::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [1487b3f5] >Thread-14::DEBUG::2014-07-24 11:27:35,237::task::595::TaskManager.Task::(_updateState) Task=`c98eb714-f8e5-4183-8cdf-60277ebfddd8`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:27:35,237::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:27:35,237::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:27:35,237::task::1185::TaskManager.Task::(prepare) Task=`c98eb714-f8e5-4183-8cdf-60277ebfddd8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:27:35,238::task::595::TaskManager.Task::(_updateState) Task=`c98eb714-f8e5-4183-8cdf-60277ebfddd8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:27:35,238::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:27:35,238::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:27:35,238::task::990::TaskManager.Task::(_decref) Task=`c98eb714-f8e5-4183-8cdf-60277ebfddd8`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:27:35,286::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [1487b3f5] >Thread-34::DEBUG::2014-07-24 11:27:35,286::task::595::TaskManager.Task::(_updateState) Task=`56180fce-8c04-4cd0-8a85-1c7943c1f148`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:27:35,286::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:27:35,287::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e1c4c156-23a2-49f3-9c57-9924380d553e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:27:35,287::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:27:35,287::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:27:35,287::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e1c4c156-23a2-49f3-9c57-9924380d553e`::Granted request >Thread-34::DEBUG::2014-07-24 11:27:35,288::task::827::TaskManager.Task::(resourceAcquired) Task=`56180fce-8c04-4cd0-8a85-1c7943c1f148`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:27:35,288::task::990::TaskManager.Task::(_decref) Task=`56180fce-8c04-4cd0-8a85-1c7943c1f148`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:27:35,289::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:27:35,289::task::1185::TaskManager.Task::(prepare) Task=`56180fce-8c04-4cd0-8a85-1c7943c1f148`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:27:35,289::task::595::TaskManager.Task::(_updateState) Task=`56180fce-8c04-4cd0-8a85-1c7943c1f148`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:27:35,289::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:27:35,289::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:27:35,290::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:27:35,290::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:27:35,290::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:27:35,290::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:27:35,291::task::990::TaskManager.Task::(_decref) Task=`56180fce-8c04-4cd0-8a85-1c7943c1f148`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:27:36,376::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:27:36,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348919 s, 29.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:27:37,034::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:27:37,043::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000646461 s, 6.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:27:38,463::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:27:38,542::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.040076 s, 25.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:27:40,554::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:27:40,627::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335745 s, 30.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:27:42,639::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:27:42,715::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344752 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:27:44,728::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:27:44,802::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346393 s, 29.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:27:45,347::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:27:45,347::task::595::TaskManager.Task::(_updateState) Task=`f513e390-1e1e-4356-a02e-a98289fea8a2`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:27:45,348::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:27:45,348::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:27:45,348::task::1185::TaskManager.Task::(prepare) Task=`f513e390-1e1e-4356-a02e-a98289fea8a2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:27:45,348::task::595::TaskManager.Task::(_updateState) Task=`f513e390-1e1e-4356-a02e-a98289fea8a2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:27:45,348::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:27:45,349::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:27:45,349::task::990::TaskManager.Task::(_decref) Task=`f513e390-1e1e-4356-a02e-a98289fea8a2`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:27:45,379::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:27:45,379::task::595::TaskManager.Task::(_updateState) Task=`ce753614-5503-40e7-a5fd-ab779cea2a3e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:27:45,380::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:27:45,380::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`6961a898-ba5d-40c5-bf9a-d25213f25438`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:27:45,380::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:27:45,380::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:27:45,381::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`6961a898-ba5d-40c5-bf9a-d25213f25438`::Granted request >Thread-34::DEBUG::2014-07-24 11:27:45,381::task::827::TaskManager.Task::(resourceAcquired) Task=`ce753614-5503-40e7-a5fd-ab779cea2a3e`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:27:45,381::task::990::TaskManager.Task::(_decref) Task=`ce753614-5503-40e7-a5fd-ab779cea2a3e`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:27:45,382::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:27:45,382::task::1185::TaskManager.Task::(prepare) Task=`ce753614-5503-40e7-a5fd-ab779cea2a3e`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:27:45,382::task::595::TaskManager.Task::(_updateState) Task=`ce753614-5503-40e7-a5fd-ab779cea2a3e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:27:45,382::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:27:45,383::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:27:45,383::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:27:45,383::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:27:45,383::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:27:45,383::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:27:45,383::task::990::TaskManager.Task::(_decref) Task=`ce753614-5503-40e7-a5fd-ab779cea2a3e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:27:46,815::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-24 11:27:46,891::task::595::TaskManager.Task::(_updateState) Task=`a949f358-5420-469c-9128-3115bcf777de`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:27:46,892::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:27:46,893::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000646461', 'lastCheck': '9.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:27:46,894::task::1185::TaskManager.Task::(prepare) Task=`a949f358-5420-469c-9128-3115bcf777de`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000646461', 'lastCheck': '9.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:27:46,895::task::595::TaskManager.Task::(_updateState) Task=`a949f358-5420-469c-9128-3115bcf777de`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:27:46,896::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:27:46,897::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:27:46,898::task::990::TaskManager.Task::(_decref) Task=`a949f358-5420-469c-9128-3115bcf777de`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:27:46,930::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363117 s, 28.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:27:47,048::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:27:47,057::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000717906 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:27:48,943::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:27:49,020::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356165 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:27:51,032::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:27:51,106::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347116 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:27:53,118::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:27:53,197::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349759 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:27:55,209::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:27:55,284::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035599 s, 28.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:27:55,452::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:27:55,453::task::595::TaskManager.Task::(_updateState) Task=`0c1d7978-2566-4733-84e7-715b9baa12e8`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:27:55,453::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:27:55,454::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:27:55,454::task::1185::TaskManager.Task::(prepare) Task=`0c1d7978-2566-4733-84e7-715b9baa12e8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:27:55,454::task::595::TaskManager.Task::(_updateState) Task=`0c1d7978-2566-4733-84e7-715b9baa12e8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:27:55,454::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:27:55,454::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:27:55,454::task::990::TaskManager.Task::(_decref) Task=`0c1d7978-2566-4733-84e7-715b9baa12e8`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:27:55,491::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:27:55,491::task::595::TaskManager.Task::(_updateState) Task=`e1a73532-f29b-4cc9-bf5d-f650608fda08`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:27:55,491::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:27:55,491::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`857c2648-2db2-4371-9641-f30c54cebc68`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:27:55,492::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:27:55,492::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:27:55,492::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`857c2648-2db2-4371-9641-f30c54cebc68`::Granted request >Thread-34::DEBUG::2014-07-24 11:27:55,492::task::827::TaskManager.Task::(resourceAcquired) Task=`e1a73532-f29b-4cc9-bf5d-f650608fda08`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:27:55,493::task::990::TaskManager.Task::(_decref) Task=`e1a73532-f29b-4cc9-bf5d-f650608fda08`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:27:55,493::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:27:55,494::task::1185::TaskManager.Task::(prepare) Task=`e1a73532-f29b-4cc9-bf5d-f650608fda08`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:27:55,494::task::595::TaskManager.Task::(_updateState) Task=`e1a73532-f29b-4cc9-bf5d-f650608fda08`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:27:55,494::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:27:55,494::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:27:55,494::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:27:55,495::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:27:55,495::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:27:55,495::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:27:55,495::task::990::TaskManager.Task::(_decref) Task=`e1a73532-f29b-4cc9-bf5d-f650608fda08`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:27:57,062::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:27:57,071::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000649483 s, 6.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:27:57,296::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:27:57,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353911 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:27:59,389::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:27:59,463::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346934 s, 29.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:28:00,074::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:28:01,476::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:28:01,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354436 s, 28.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:28:02,287::task::595::TaskManager.Task::(_updateState) Task=`969586ac-6506-44ba-a111-ef0c9e2aa74c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:28:02,300::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:28:02,301::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000649483', 'lastCheck': '5.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:28:02,301::task::1185::TaskManager.Task::(prepare) Task=`969586ac-6506-44ba-a111-ef0c9e2aa74c`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000649483', 'lastCheck': '5.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:28:02,301::task::595::TaskManager.Task::(_updateState) Task=`969586ac-6506-44ba-a111-ef0c9e2aa74c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:28:02,301::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:28:02,301::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:28:02,301::task::990::TaskManager.Task::(_decref) Task=`969586ac-6506-44ba-a111-ef0c9e2aa74c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:28:03,563::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:28:03,638::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358607 s, 28.6 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:28:05,046::task::595::TaskManager.Task::(_updateState) Task=`cdf65aeb-8984-4e26-87a5-2fcd3bbacf72`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:28:05,047::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:28:05,047::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:28:05,047::task::1185::TaskManager.Task::(prepare) Task=`cdf65aeb-8984-4e26-87a5-2fcd3bbacf72`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:28:05,047::task::595::TaskManager.Task::(_updateState) Task=`cdf65aeb-8984-4e26-87a5-2fcd3bbacf72`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:28:05,047::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:28:05,048::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:28:05,048::task::990::TaskManager.Task::(_decref) Task=`cdf65aeb-8984-4e26-87a5-2fcd3bbacf72`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 11:28:05,554::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:28:05,554::task::595::TaskManager.Task::(_updateState) Task=`a4e7b765-d820-4423-b067-a43acd389d93`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:28:05,554::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:28:05,554::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:28:05,554::task::1185::TaskManager.Task::(prepare) Task=`a4e7b765-d820-4423-b067-a43acd389d93`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:28:05,555::task::595::TaskManager.Task::(_updateState) Task=`a4e7b765-d820-4423-b067-a43acd389d93`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:28:05,555::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:28:05,555::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:28:05,555::task::990::TaskManager.Task::(_decref) Task=`a4e7b765-d820-4423-b067-a43acd389d93`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:28:05,590::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:28:05,590::task::595::TaskManager.Task::(_updateState) Task=`d0e8c769-ca88-4fcb-870a-5f2ab428a851`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:28:05,591::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:28:05,591::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`9feedf8e-0505-4754-b493-a30caf476ca4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:28:05,591::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:28:05,591::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:28:05,592::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`9feedf8e-0505-4754-b493-a30caf476ca4`::Granted request >Thread-34::DEBUG::2014-07-24 11:28:05,592::task::827::TaskManager.Task::(resourceAcquired) Task=`d0e8c769-ca88-4fcb-870a-5f2ab428a851`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:28:05,592::task::990::TaskManager.Task::(_decref) Task=`d0e8c769-ca88-4fcb-870a-5f2ab428a851`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:28:05,593::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:28:05,593::task::1185::TaskManager.Task::(prepare) Task=`d0e8c769-ca88-4fcb-870a-5f2ab428a851`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:28:05,593::task::595::TaskManager.Task::(_updateState) Task=`d0e8c769-ca88-4fcb-870a-5f2ab428a851`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:28:05,593::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:28:05,594::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:28:05,594::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:28:05,594::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:28:05,594::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:28:05,594::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:28:05,594::task::990::TaskManager.Task::(_decref) Task=`d0e8c769-ca88-4fcb-870a-5f2ab428a851`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:28:05,650::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:28:05,725::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356457 s, 28.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:28:07,077::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:28:07,087::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000570284 s, 7.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:28:07,737::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:28:07,810::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337337 s, 30.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:28:09,823::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:28:09,896::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033695 s, 30.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:28:11,908::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:28:11,981::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033841 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:28:13,994::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:28:14,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337826 s, 30.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:28:15,654::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:28:15,654::task::595::TaskManager.Task::(_updateState) Task=`b3b89902-876c-4c73-ba0f-2425440f9af0`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:28:15,654::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:28:15,655::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:28:15,655::task::1185::TaskManager.Task::(prepare) Task=`b3b89902-876c-4c73-ba0f-2425440f9af0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:28:15,655::task::595::TaskManager.Task::(_updateState) Task=`b3b89902-876c-4c73-ba0f-2425440f9af0`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:28:15,655::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:28:15,655::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:28:15,656::task::990::TaskManager.Task::(_decref) Task=`b3b89902-876c-4c73-ba0f-2425440f9af0`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:28:15,688::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:28:15,689::task::595::TaskManager.Task::(_updateState) Task=`582e94f3-4d65-4103-b51b-6abf283f3b1e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:28:15,689::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:28:15,689::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e648f531-8b62-4112-b3fb-d317deaeca48`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:28:15,690::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:28:15,690::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:28:15,690::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e648f531-8b62-4112-b3fb-d317deaeca48`::Granted request >Thread-34::DEBUG::2014-07-24 11:28:15,690::task::827::TaskManager.Task::(resourceAcquired) Task=`582e94f3-4d65-4103-b51b-6abf283f3b1e`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:28:15,690::task::990::TaskManager.Task::(_decref) Task=`582e94f3-4d65-4103-b51b-6abf283f3b1e`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:28:15,691::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:28:15,691::task::1185::TaskManager.Task::(prepare) Task=`582e94f3-4d65-4103-b51b-6abf283f3b1e`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:28:15,692::task::595::TaskManager.Task::(_updateState) Task=`582e94f3-4d65-4103-b51b-6abf283f3b1e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:28:15,692::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:28:15,692::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:28:15,692::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:28:15,692::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:28:15,692::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:28:15,693::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:28:15,693::task::990::TaskManager.Task::(_decref) Task=`582e94f3-4d65-4103-b51b-6abf283f3b1e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:28:16,079::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:28:16,152::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338617 s, 30.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:28:17,092::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:28:17,103::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000658112 s, 6.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:28:17,662::task::595::TaskManager.Task::(_updateState) Task=`30c0ba02-31ab-4347-ba5d-055559411dc5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:28:17,662::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:28:17,663::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000658112', 'lastCheck': '0.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:28:17,663::task::1185::TaskManager.Task::(prepare) Task=`30c0ba02-31ab-4347-ba5d-055559411dc5`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000658112', 'lastCheck': '0.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:28:17,663::task::595::TaskManager.Task::(_updateState) Task=`30c0ba02-31ab-4347-ba5d-055559411dc5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:28:17,663::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:28:17,663::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:28:17,664::task::990::TaskManager.Task::(_decref) Task=`30c0ba02-31ab-4347-ba5d-055559411dc5`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:28:18,165::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:28:18,240::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364739 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:28:20,252::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:28:20,326::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342187 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:28:22,338::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:28:22,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359143 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:28:24,425::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:28:24,500::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353974 s, 28.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:28:25,750::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:28:25,751::task::595::TaskManager.Task::(_updateState) Task=`55ea157e-d439-4dbd-8409-360fec4edec2`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:28:25,751::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:28:25,751::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:28:25,751::task::1185::TaskManager.Task::(prepare) Task=`55ea157e-d439-4dbd-8409-360fec4edec2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:28:25,752::task::595::TaskManager.Task::(_updateState) Task=`55ea157e-d439-4dbd-8409-360fec4edec2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:28:25,752::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:28:25,752::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:28:25,752::task::990::TaskManager.Task::(_decref) Task=`55ea157e-d439-4dbd-8409-360fec4edec2`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:28:25,784::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:28:25,784::task::595::TaskManager.Task::(_updateState) Task=`74b64928-d727-4638-8c95-04f09475b01f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:28:25,784::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:28:25,785::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e5f30900-e624-4b94-a1d8-88f45d4c64e2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:28:25,785::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:28:25,785::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:28:25,785::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e5f30900-e624-4b94-a1d8-88f45d4c64e2`::Granted request >Thread-34::DEBUG::2014-07-24 11:28:25,785::task::827::TaskManager.Task::(resourceAcquired) Task=`74b64928-d727-4638-8c95-04f09475b01f`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:28:25,786::task::990::TaskManager.Task::(_decref) Task=`74b64928-d727-4638-8c95-04f09475b01f`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:28:25,786::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:28:25,786::task::1185::TaskManager.Task::(prepare) Task=`74b64928-d727-4638-8c95-04f09475b01f`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:28:25,787::task::595::TaskManager.Task::(_updateState) Task=`74b64928-d727-4638-8c95-04f09475b01f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:28:25,787::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:28:25,787::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:28:25,787::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:28:25,787::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:28:25,788::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:28:25,788::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:28:25,788::task::990::TaskManager.Task::(_decref) Task=`74b64928-d727-4638-8c95-04f09475b01f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:28:26,512::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:28:26,585::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335152 s, 30.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:28:27,109::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:28:27,127::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00955534 s, 429 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:28:28,597::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:28:29,002::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.365956 s, 2.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:28:30,122::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:28:31,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:28:31,105::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0520497 s, 19.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:28:33,031::task::595::TaskManager.Task::(_updateState) Task=`157b969b-b50b-4f28-94ae-ddefa69d5ff8`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:28:33,031::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:28:33,031::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00955534', 'lastCheck': '5.9', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:28:33,032::task::1185::TaskManager.Task::(prepare) Task=`157b969b-b50b-4f28-94ae-ddefa69d5ff8`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00955534', 'lastCheck': '5.9', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:28:33,032::task::595::TaskManager.Task::(_updateState) Task=`157b969b-b50b-4f28-94ae-ddefa69d5ff8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:28:33,032::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:28:33,032::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:28:33,032::task::990::TaskManager.Task::(_decref) Task=`157b969b-b50b-4f28-94ae-ddefa69d5ff8`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:28:33,117::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:28:33,204::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0463283 s, 22.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:28:35,216::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:28:35,291::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352579 s, 29.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:28:35,849::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:28:35,849::task::595::TaskManager.Task::(_updateState) Task=`87221349-0e81-491c-8a7d-1f1218f8c122`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:28:35,849::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:28:35,850::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:28:35,850::task::1185::TaskManager.Task::(prepare) Task=`87221349-0e81-491c-8a7d-1f1218f8c122`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:28:35,850::task::595::TaskManager.Task::(_updateState) Task=`87221349-0e81-491c-8a7d-1f1218f8c122`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:28:35,850::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:28:35,850::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:28:35,850::task::990::TaskManager.Task::(_decref) Task=`87221349-0e81-491c-8a7d-1f1218f8c122`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:28:35,885::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:28:35,886::task::595::TaskManager.Task::(_updateState) Task=`bdf22cf5-339a-4a2a-bdd3-ae1ba36c5aa3`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:28:35,886::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:28:35,886::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f141ccb3-edc9-45b1-86e8-4c5fafe66cfb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:28:35,887::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:28:35,887::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:28:35,887::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f141ccb3-edc9-45b1-86e8-4c5fafe66cfb`::Granted request >Thread-34::DEBUG::2014-07-24 11:28:35,887::task::827::TaskManager.Task::(resourceAcquired) Task=`bdf22cf5-339a-4a2a-bdd3-ae1ba36c5aa3`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:28:35,888::task::990::TaskManager.Task::(_decref) Task=`bdf22cf5-339a-4a2a-bdd3-ae1ba36c5aa3`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:28:35,888::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:28:35,888::task::1185::TaskManager.Task::(prepare) Task=`bdf22cf5-339a-4a2a-bdd3-ae1ba36c5aa3`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:28:35,889::task::595::TaskManager.Task::(_updateState) Task=`bdf22cf5-339a-4a2a-bdd3-ae1ba36c5aa3`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:28:35,889::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:28:35,889::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:28:35,889::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:28:35,889::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:28:35,890::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:28:35,890::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:28:35,890::task::990::TaskManager.Task::(_decref) Task=`bdf22cf5-339a-4a2a-bdd3-ae1ba36c5aa3`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:28:37,133::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:28:37,143::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000715805 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:28:37,303::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:28:37,379::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357393 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:28:39,391::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:28:39,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338328 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:28:41,477::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:28:41,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337837 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:28:43,564::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:28:43,638::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342653 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:28:45,651::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:28:45,725::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351348 s, 29.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:28:45,952::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:28:45,952::task::595::TaskManager.Task::(_updateState) Task=`c0a2536f-76a8-406d-b2ff-ba66cce76c7c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:28:45,953::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:28:45,953::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:28:45,953::task::1185::TaskManager.Task::(prepare) Task=`c0a2536f-76a8-406d-b2ff-ba66cce76c7c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:28:45,953::task::595::TaskManager.Task::(_updateState) Task=`c0a2536f-76a8-406d-b2ff-ba66cce76c7c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:28:45,953::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:28:45,954::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:28:45,954::task::990::TaskManager.Task::(_decref) Task=`c0a2536f-76a8-406d-b2ff-ba66cce76c7c`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:28:45,985::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:28:45,986::task::595::TaskManager.Task::(_updateState) Task=`2fd45dc9-8b71-4f2a-9f85-b018f637c0b4`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:28:45,986::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:28:45,986::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`187bded7-ce1a-4066-9060-86099fa19625`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:28:45,986::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:28:45,987::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:28:45,987::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`187bded7-ce1a-4066-9060-86099fa19625`::Granted request >Thread-34::DEBUG::2014-07-24 11:28:45,987::task::827::TaskManager.Task::(resourceAcquired) Task=`2fd45dc9-8b71-4f2a-9f85-b018f637c0b4`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:28:45,987::task::990::TaskManager.Task::(_decref) Task=`2fd45dc9-8b71-4f2a-9f85-b018f637c0b4`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:28:45,988::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:28:45,988::task::1185::TaskManager.Task::(prepare) Task=`2fd45dc9-8b71-4f2a-9f85-b018f637c0b4`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:28:45,988::task::595::TaskManager.Task::(_updateState) Task=`2fd45dc9-8b71-4f2a-9f85-b018f637c0b4`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:28:45,989::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:28:45,989::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:28:45,989::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:28:45,989::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:28:45,989::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:28:45,989::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:28:45,990::task::990::TaskManager.Task::(_decref) Task=`2fd45dc9-8b71-4f2a-9f85-b018f637c0b4`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:28:47,148::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:28:47,157::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000828864 s, 4.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:28:47,737::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:28:47,812::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355014 s, 28.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:28:48,410::task::595::TaskManager.Task::(_updateState) Task=`658303d7-95ec-4bc5-8149-1c98f50922df`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:28:48,410::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:28:48,410::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000828864', 'lastCheck': '1.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:28:48,410::task::1185::TaskManager.Task::(prepare) Task=`658303d7-95ec-4bc5-8149-1c98f50922df`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000828864', 'lastCheck': '1.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:28:48,410::task::595::TaskManager.Task::(_updateState) Task=`658303d7-95ec-4bc5-8149-1c98f50922df`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:28:48,411::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:28:48,411::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:28:48,411::task::990::TaskManager.Task::(_decref) Task=`658303d7-95ec-4bc5-8149-1c98f50922df`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:28:49,825::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:28:49,902::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368959 s, 27.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:28:51,914::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:28:51,990::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356709 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:28:54,002::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:28:54,078::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360467 s, 28.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:28:56,043::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:28:56,044::task::595::TaskManager.Task::(_updateState) Task=`e9900d03-85ef-45bb-8979-780506557eb5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:28:56,044::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:28:56,044::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:28:56,045::task::1185::TaskManager.Task::(prepare) Task=`e9900d03-85ef-45bb-8979-780506557eb5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:28:56,045::task::595::TaskManager.Task::(_updateState) Task=`e9900d03-85ef-45bb-8979-780506557eb5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:28:56,045::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:28:56,045::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:28:56,045::task::990::TaskManager.Task::(_decref) Task=`e9900d03-85ef-45bb-8979-780506557eb5`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:28:56,079::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:28:56,080::task::595::TaskManager.Task::(_updateState) Task=`ece7da4c-b098-4db2-8ec7-ed322c507734`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:28:56,080::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:28:56,080::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4588e5ae-98d3-4422-8c9e-b812f2c59daf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:28:56,080::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:28:56,081::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:28:56,081::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4588e5ae-98d3-4422-8c9e-b812f2c59daf`::Granted request >Thread-34::DEBUG::2014-07-24 11:28:56,081::task::827::TaskManager.Task::(resourceAcquired) Task=`ece7da4c-b098-4db2-8ec7-ed322c507734`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:28:56,081::task::990::TaskManager.Task::(_decref) Task=`ece7da4c-b098-4db2-8ec7-ed322c507734`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:28:56,082::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:28:56,082::task::1185::TaskManager.Task::(prepare) Task=`ece7da4c-b098-4db2-8ec7-ed322c507734`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:28:56,082::task::595::TaskManager.Task::(_updateState) Task=`ece7da4c-b098-4db2-8ec7-ed322c507734`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:28:56,083::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:28:56,083::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:28:56,083::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:28:56,083::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:28:56,083::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:28:56,083::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:28:56,084::task::990::TaskManager.Task::(_decref) Task=`ece7da4c-b098-4db2-8ec7-ed322c507734`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:28:56,090::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:28:56,164::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333301 s, 30.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:28:57,162::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:28:57,171::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000713607 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:28:58,176::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:28:58,249::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338048 s, 30.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:29:00,158::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:29:00,261::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:29:00,335::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346199 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:29:02,347::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:29:02,420::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339291 s, 30.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:29:03,806::task::595::TaskManager.Task::(_updateState) Task=`28177986-92b7-4e22-9d87-c63107aea690`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:29:03,816::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:29:03,817::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000713607', 'lastCheck': '6.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:29:03,817::task::1185::TaskManager.Task::(prepare) Task=`28177986-92b7-4e22-9d87-c63107aea690`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000713607', 'lastCheck': '6.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:29:03,817::task::595::TaskManager.Task::(_updateState) Task=`28177986-92b7-4e22-9d87-c63107aea690`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:29:03,817::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:29:03,817::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:29:03,817::task::990::TaskManager.Task::(_decref) Task=`28177986-92b7-4e22-9d87-c63107aea690`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:29:04,433::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:29:04,508::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354398 s, 28.9 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:29:05,212::task::595::TaskManager.Task::(_updateState) Task=`cbf8fa2a-e83e-4225-8d09-be65fa06b455`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:29:05,213::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:29:05,213::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:29:05,213::task::1185::TaskManager.Task::(prepare) Task=`cbf8fa2a-e83e-4225-8d09-be65fa06b455`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:29:05,213::task::595::TaskManager.Task::(_updateState) Task=`cbf8fa2a-e83e-4225-8d09-be65fa06b455`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:29:05,213::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:29:05,214::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:29:05,214::task::990::TaskManager.Task::(_decref) Task=`cbf8fa2a-e83e-4225-8d09-be65fa06b455`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 11:29:06,143::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:29:06,144::task::595::TaskManager.Task::(_updateState) Task=`1d327703-28bb-4fed-92a9-9c181b4c05b4`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:29:06,144::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:29:06,144::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:29:06,145::task::1185::TaskManager.Task::(prepare) Task=`1d327703-28bb-4fed-92a9-9c181b4c05b4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:29:06,145::task::595::TaskManager.Task::(_updateState) Task=`1d327703-28bb-4fed-92a9-9c181b4c05b4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:29:06,145::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:29:06,145::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:29:06,145::task::990::TaskManager.Task::(_decref) Task=`1d327703-28bb-4fed-92a9-9c181b4c05b4`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:29:06,176::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:29:06,176::task::595::TaskManager.Task::(_updateState) Task=`96b865bd-4aea-4317-a039-20d1f963fffd`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:29:06,177::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:29:06,177::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ad5eb29f-694c-41a7-ac19-00fe9e740883`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:29:06,177::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:29:06,177::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:29:06,178::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ad5eb29f-694c-41a7-ac19-00fe9e740883`::Granted request >Thread-34::DEBUG::2014-07-24 11:29:06,178::task::827::TaskManager.Task::(resourceAcquired) Task=`96b865bd-4aea-4317-a039-20d1f963fffd`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:29:06,178::task::990::TaskManager.Task::(_decref) Task=`96b865bd-4aea-4317-a039-20d1f963fffd`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:29:06,179::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:29:06,179::task::1185::TaskManager.Task::(prepare) Task=`96b865bd-4aea-4317-a039-20d1f963fffd`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:29:06,179::task::595::TaskManager.Task::(_updateState) Task=`96b865bd-4aea-4317-a039-20d1f963fffd`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:29:06,179::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:29:06,179::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:29:06,180::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:29:06,180::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:29:06,180::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:29:06,180::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:29:06,180::task::990::TaskManager.Task::(_decref) Task=`96b865bd-4aea-4317-a039-20d1f963fffd`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:29:06,520::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:29:06,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356664 s, 28.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:29:07,179::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:29:07,199::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000654057 s, 6.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:29:08,607::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:29:08,683::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361532 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:29:10,695::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:29:10,769::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353163 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:29:12,782::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:29:12,854::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330615 s, 31.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:29:14,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:29:14,938::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329554 s, 31.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:29:16,234::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [6674a7d7] >Thread-14::DEBUG::2014-07-24 11:29:16,234::task::595::TaskManager.Task::(_updateState) Task=`fc31a684-8fd6-4835-9007-29cc585845f9`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:29:16,234::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:29:16,235::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:29:16,235::task::1185::TaskManager.Task::(prepare) Task=`fc31a684-8fd6-4835-9007-29cc585845f9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:29:16,235::task::595::TaskManager.Task::(_updateState) Task=`fc31a684-8fd6-4835-9007-29cc585845f9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:29:16,235::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:29:16,235::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:29:16,235::task::990::TaskManager.Task::(_decref) Task=`fc31a684-8fd6-4835-9007-29cc585845f9`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:29:16,266::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [6674a7d7] >Thread-34::DEBUG::2014-07-24 11:29:16,266::task::595::TaskManager.Task::(_updateState) Task=`4a403e64-ffb6-4ef3-9cf5-28f0a617f03a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:29:16,267::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:29:16,267::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e72f9c34-4b26-4534-8ec6-daad00e6975d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:29:16,267::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:29:16,267::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:29:16,268::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e72f9c34-4b26-4534-8ec6-daad00e6975d`::Granted request >Thread-34::DEBUG::2014-07-24 11:29:16,268::task::827::TaskManager.Task::(resourceAcquired) Task=`4a403e64-ffb6-4ef3-9cf5-28f0a617f03a`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:29:16,268::task::990::TaskManager.Task::(_decref) Task=`4a403e64-ffb6-4ef3-9cf5-28f0a617f03a`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:29:16,269::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:29:16,269::task::1185::TaskManager.Task::(prepare) Task=`4a403e64-ffb6-4ef3-9cf5-28f0a617f03a`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:29:16,269::task::595::TaskManager.Task::(_updateState) Task=`4a403e64-ffb6-4ef3-9cf5-28f0a617f03a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:29:16,269::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:29:16,270::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:29:16,270::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:29:16,270::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:29:16,270::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:29:16,270::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:29:16,270::task::990::TaskManager.Task::(_decref) Task=`4a403e64-ffb6-4ef3-9cf5-28f0a617f03a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:29:16,951::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:29:17,026::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330985 s, 30.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:29:17,218::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:29:17,227::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000704908 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:29:19,038::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:29:19,110::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0326789 s, 31.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:29:19,222::task::595::TaskManager.Task::(_updateState) Task=`973cae74-c400-4bce-8f81-653b308cdf08`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:29:19,222::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:29:19,222::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000704908', 'lastCheck': '2.0', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:29:19,223::task::1185::TaskManager.Task::(prepare) Task=`973cae74-c400-4bce-8f81-653b308cdf08`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000704908', 'lastCheck': '2.0', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:29:19,223::task::595::TaskManager.Task::(_updateState) Task=`973cae74-c400-4bce-8f81-653b308cdf08`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:29:19,223::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:29:19,223::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:29:19,223::task::990::TaskManager.Task::(_decref) Task=`973cae74-c400-4bce-8f81-653b308cdf08`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:29:21,122::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:29:21,196::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341001 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:29:23,208::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:29:23,298::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0326194 s, 31.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:29:25,311::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:29:25,383::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331075 s, 30.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:29:26,331::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:29:26,331::task::595::TaskManager.Task::(_updateState) Task=`098727c8-fd40-4cda-b468-35677fdc7944`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:29:26,331::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:29:26,332::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:29:26,332::task::1185::TaskManager.Task::(prepare) Task=`098727c8-fd40-4cda-b468-35677fdc7944`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:29:26,332::task::595::TaskManager.Task::(_updateState) Task=`098727c8-fd40-4cda-b468-35677fdc7944`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:29:26,332::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:29:26,332::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:29:26,333::task::990::TaskManager.Task::(_decref) Task=`098727c8-fd40-4cda-b468-35677fdc7944`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:29:26,366::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:29:26,366::task::595::TaskManager.Task::(_updateState) Task=`07e4ebfa-dc4b-4cdc-a248-5802d604a58f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:29:26,367::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:29:26,367::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`46f3a37d-3e78-4eb5-a469-e4895d2c9faa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:29:26,367::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:29:26,367::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:29:26,368::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`46f3a37d-3e78-4eb5-a469-e4895d2c9faa`::Granted request >Thread-34::DEBUG::2014-07-24 11:29:26,368::task::827::TaskManager.Task::(resourceAcquired) Task=`07e4ebfa-dc4b-4cdc-a248-5802d604a58f`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:29:26,368::task::990::TaskManager.Task::(_decref) Task=`07e4ebfa-dc4b-4cdc-a248-5802d604a58f`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:29:26,369::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:29:26,369::task::1185::TaskManager.Task::(prepare) Task=`07e4ebfa-dc4b-4cdc-a248-5802d604a58f`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:29:26,369::task::595::TaskManager.Task::(_updateState) Task=`07e4ebfa-dc4b-4cdc-a248-5802d604a58f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:29:26,369::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:29:26,369::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:29:26,370::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:29:26,370::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:29:26,370::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:29:26,370::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:29:26,370::task::990::TaskManager.Task::(_decref) Task=`07e4ebfa-dc4b-4cdc-a248-5802d604a58f`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:29:27,232::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:29:27,241::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000791566 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:29:27,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:29:27,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03379 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:29:29,481::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:29:29,556::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355792 s, 28.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:29:30,194::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:29:31,568::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:29:31,643::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352628 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:29:33,655::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:29:33,729::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353305 s, 29.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:29:34,709::task::595::TaskManager.Task::(_updateState) Task=`32a44ed5-34fc-4b4b-bf50-6c34be1f1a97`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:29:34,710::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:29:34,710::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000791566', 'lastCheck': '7.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:29:34,710::task::1185::TaskManager.Task::(prepare) Task=`32a44ed5-34fc-4b4b-bf50-6c34be1f1a97`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000791566', 'lastCheck': '7.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:29:34,710::task::595::TaskManager.Task::(_updateState) Task=`32a44ed5-34fc-4b4b-bf50-6c34be1f1a97`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:29:34,710::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:29:34,710::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:29:34,711::task::990::TaskManager.Task::(_decref) Task=`32a44ed5-34fc-4b4b-bf50-6c34be1f1a97`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:29:35,741::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:29:35,815::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338977 s, 30.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:29:36,431::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:29:36,437::task::595::TaskManager.Task::(_updateState) Task=`49d378da-2961-4bce-a908-54b06d3939cf`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:29:36,437::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:29:36,437::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:29:36,437::task::1185::TaskManager.Task::(prepare) Task=`49d378da-2961-4bce-a908-54b06d3939cf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:29:36,437::task::595::TaskManager.Task::(_updateState) Task=`49d378da-2961-4bce-a908-54b06d3939cf`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:29:36,438::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:29:36,438::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:29:36,438::task::990::TaskManager.Task::(_decref) Task=`49d378da-2961-4bce-a908-54b06d3939cf`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:29:36,474::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:29:36,474::task::595::TaskManager.Task::(_updateState) Task=`89f1f4cb-5d9a-4326-83e2-539a70f1550e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:29:36,475::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:29:36,475::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`8aa4c7bd-ed62-4e26-a6c6-43f8f2d86be3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:29:36,475::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:29:36,475::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:29:36,476::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`8aa4c7bd-ed62-4e26-a6c6-43f8f2d86be3`::Granted request >Thread-34::DEBUG::2014-07-24 11:29:36,476::task::827::TaskManager.Task::(resourceAcquired) Task=`89f1f4cb-5d9a-4326-83e2-539a70f1550e`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:29:36,476::task::990::TaskManager.Task::(_decref) Task=`89f1f4cb-5d9a-4326-83e2-539a70f1550e`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:29:36,477::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:29:36,477::task::1185::TaskManager.Task::(prepare) Task=`89f1f4cb-5d9a-4326-83e2-539a70f1550e`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:29:36,477::task::595::TaskManager.Task::(_updateState) Task=`89f1f4cb-5d9a-4326-83e2-539a70f1550e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:29:36,477::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:29:36,477::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:29:36,478::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:29:36,478::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:29:36,478::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:29:36,478::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:29:36,478::task::990::TaskManager.Task::(_decref) Task=`89f1f4cb-5d9a-4326-83e2-539a70f1550e`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:29:37,246::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:29:37,261::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00643956 s, 636 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:29:37,827::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:29:37,906::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368812 s, 27.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:29:39,918::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:29:39,992::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333242 s, 30.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:29:42,005::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:29:42,077::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330472 s, 31.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:29:44,089::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:29:44,164::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350281 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:29:46,176::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:29:46,251::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361369 s, 28.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:29:46,533::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:29:46,534::task::595::TaskManager.Task::(_updateState) Task=`739df90f-2ff3-45a0-b596-884d7897221b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:29:46,534::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:29:46,534::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:29:46,534::task::1185::TaskManager.Task::(prepare) Task=`739df90f-2ff3-45a0-b596-884d7897221b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:29:46,535::task::595::TaskManager.Task::(_updateState) Task=`739df90f-2ff3-45a0-b596-884d7897221b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:29:46,535::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:29:46,535::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:29:46,535::task::990::TaskManager.Task::(_decref) Task=`739df90f-2ff3-45a0-b596-884d7897221b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:29:46,569::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:29:46,570::task::595::TaskManager.Task::(_updateState) Task=`8127bd29-40a1-4124-89d2-5b78ed72af57`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:29:46,570::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:29:46,570::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d970dd60-62be-4558-9e43-b63eaf592984`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:29:46,570::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:29:46,571::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:29:46,571::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d970dd60-62be-4558-9e43-b63eaf592984`::Granted request >Thread-34::DEBUG::2014-07-24 11:29:46,571::task::827::TaskManager.Task::(resourceAcquired) Task=`8127bd29-40a1-4124-89d2-5b78ed72af57`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:29:46,571::task::990::TaskManager.Task::(_decref) Task=`8127bd29-40a1-4124-89d2-5b78ed72af57`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:29:46,572::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:29:46,572::task::1185::TaskManager.Task::(prepare) Task=`8127bd29-40a1-4124-89d2-5b78ed72af57`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:29:46,572::task::595::TaskManager.Task::(_updateState) Task=`8127bd29-40a1-4124-89d2-5b78ed72af57`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:29:46,573::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:29:46,573::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:29:46,573::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:29:46,573::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:29:46,573::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:29:46,573::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:29:46,574::task::990::TaskManager.Task::(_decref) Task=`8127bd29-40a1-4124-89d2-5b78ed72af57`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:29:47,266::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:29:47,275::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000771921 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:29:48,263::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:29:48,339::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354319 s, 28.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:29:50,343::task::595::TaskManager.Task::(_updateState) Task=`da871300-5a1f-4c4c-8a08-abc222cda12b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:29:50,343::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:29:50,344::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000771921', 'lastCheck': '3.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:29:50,344::task::1185::TaskManager.Task::(prepare) Task=`da871300-5a1f-4c4c-8a08-abc222cda12b`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000771921', 'lastCheck': '3.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:29:50,344::task::595::TaskManager.Task::(_updateState) Task=`da871300-5a1f-4c4c-8a08-abc222cda12b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:29:50,344::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:29:50,344::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:29:50,345::task::990::TaskManager.Task::(_decref) Task=`da871300-5a1f-4c4c-8a08-abc222cda12b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:29:50,351::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:29:50,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327139 s, 31.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:29:52,435::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:29:52,510::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352086 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:29:54,522::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:29:54,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336855 s, 30.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:29:56,607::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-13::DEBUG::2014-07-24 11:29:56,661::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:29:56,663::task::595::TaskManager.Task::(_updateState) Task=`7f75b373-a4cf-4988-bc02-825fefb6f951`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:29:56,664::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:29:56,665::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:29:56,666::task::1185::TaskManager.Task::(prepare) Task=`7f75b373-a4cf-4988-bc02-825fefb6f951`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:29:56,667::task::595::TaskManager.Task::(_updateState) Task=`7f75b373-a4cf-4988-bc02-825fefb6f951`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:29:56,667::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:29:56,668::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:29:56,668::task::990::TaskManager.Task::(_decref) Task=`7f75b373-a4cf-4988-bc02-825fefb6f951`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:29:56,693::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036774 s, 27.8 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-24 11:29:56,722::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:29:56,723::task::595::TaskManager.Task::(_updateState) Task=`1fbfbc8f-fd28-4d78-affe-eab8185fcd82`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:29:56,723::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:29:56,723::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4d2877e1-ff4b-4253-955b-afd5f8eaee88`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:29:56,724::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:29:56,724::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:29:56,724::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4d2877e1-ff4b-4253-955b-afd5f8eaee88`::Granted request >Thread-34::DEBUG::2014-07-24 11:29:56,724::task::827::TaskManager.Task::(resourceAcquired) Task=`1fbfbc8f-fd28-4d78-affe-eab8185fcd82`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:29:56,724::task::990::TaskManager.Task::(_decref) Task=`1fbfbc8f-fd28-4d78-affe-eab8185fcd82`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:29:56,725::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:29:56,725::task::1185::TaskManager.Task::(prepare) Task=`1fbfbc8f-fd28-4d78-affe-eab8185fcd82`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:29:56,726::task::595::TaskManager.Task::(_updateState) Task=`1fbfbc8f-fd28-4d78-affe-eab8185fcd82`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:29:56,726::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:29:56,726::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:29:56,726::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:29:56,726::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:29:56,726::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:29:56,727::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:29:56,727::task::990::TaskManager.Task::(_decref) Task=`1fbfbc8f-fd28-4d78-affe-eab8185fcd82`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:29:57,285::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:29:57,294::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000661946 s, 6.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:29:58,706::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:29:58,788::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037523 s, 27.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:30:00,231::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:30:00,802::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:30:00,874::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332938 s, 30.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:30:02,886::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:30:02,959::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331655 s, 30.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:30:04,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:30:05,047::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034816 s, 29.4 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:30:05,396::task::595::TaskManager.Task::(_updateState) Task=`a91565c7-6aa9-4651-826d-246680576a4d`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:30:05,396::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:30:05,396::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:30:05,397::task::1185::TaskManager.Task::(prepare) Task=`a91565c7-6aa9-4651-826d-246680576a4d`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:30:05,397::task::595::TaskManager.Task::(_updateState) Task=`a91565c7-6aa9-4651-826d-246680576a4d`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:30:05,397::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:30:05,397::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:30:05,397::task::990::TaskManager.Task::(_decref) Task=`a91565c7-6aa9-4651-826d-246680576a4d`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 11:30:05,817::task::595::TaskManager.Task::(_updateState) Task=`48e0c6e4-f219-4d95-a51e-e42a2fbc161a`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:30:05,817::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:30:05,817::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000661946', 'lastCheck': '8.5', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:30:05,817::task::1185::TaskManager.Task::(prepare) Task=`48e0c6e4-f219-4d95-a51e-e42a2fbc161a`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000661946', 'lastCheck': '8.5', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:30:05,817::task::595::TaskManager.Task::(_updateState) Task=`48e0c6e4-f219-4d95-a51e-e42a2fbc161a`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:30:05,818::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:30:05,818::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:30:05,818::task::990::TaskManager.Task::(_decref) Task=`48e0c6e4-f219-4d95-a51e-e42a2fbc161a`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 11:30:06,787::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:30:06,787::task::595::TaskManager.Task::(_updateState) Task=`eaf65f8d-8d85-4ab9-b329-48636d5963b8`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:30:06,787::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:30:06,787::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:30:06,787::task::1185::TaskManager.Task::(prepare) Task=`eaf65f8d-8d85-4ab9-b329-48636d5963b8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:30:06,788::task::595::TaskManager.Task::(_updateState) Task=`eaf65f8d-8d85-4ab9-b329-48636d5963b8`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:30:06,788::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:30:06,788::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:30:06,788::task::990::TaskManager.Task::(_decref) Task=`eaf65f8d-8d85-4ab9-b329-48636d5963b8`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:30:06,823::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:30:06,823::task::595::TaskManager.Task::(_updateState) Task=`43912368-99e9-480b-ae98-924823a29712`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:30:06,823::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:30:06,824::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`49af9e0e-dad8-4de5-9073-78cc9183881e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:30:06,824::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:30:06,824::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:30:06,824::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`49af9e0e-dad8-4de5-9073-78cc9183881e`::Granted request >Thread-34::DEBUG::2014-07-24 11:30:06,825::task::827::TaskManager.Task::(resourceAcquired) Task=`43912368-99e9-480b-ae98-924823a29712`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:30:06,825::task::990::TaskManager.Task::(_decref) Task=`43912368-99e9-480b-ae98-924823a29712`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:30:06,826::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:30:06,826::task::1185::TaskManager.Task::(prepare) Task=`43912368-99e9-480b-ae98-924823a29712`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:30:06,826::task::595::TaskManager.Task::(_updateState) Task=`43912368-99e9-480b-ae98-924823a29712`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:30:06,826::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:30:06,826::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:30:06,826::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:30:06,827::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:30:06,827::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:30:06,827::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:30:06,827::task::990::TaskManager.Task::(_decref) Task=`43912368-99e9-480b-ae98-924823a29712`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:30:07,060::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:30:07,132::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329802 s, 31.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:30:07,299::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:30:07,308::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000658928 s, 6.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:30:09,144::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:30:09,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351077 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:30:11,231::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:30:11,304::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344246 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:30:13,317::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:30:13,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350744 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:30:15,404::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:30:15,495::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0510053 s, 20.1 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:30:16,888::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:30:16,888::task::595::TaskManager.Task::(_updateState) Task=`d2150957-141e-4c6c-9800-d100a77262e6`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:30:16,888::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:30:16,889::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:30:16,889::task::1185::TaskManager.Task::(prepare) Task=`d2150957-141e-4c6c-9800-d100a77262e6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:30:16,889::task::595::TaskManager.Task::(_updateState) Task=`d2150957-141e-4c6c-9800-d100a77262e6`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:30:16,889::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:30:16,889::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:30:16,889::task::990::TaskManager.Task::(_decref) Task=`d2150957-141e-4c6c-9800-d100a77262e6`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:30:16,922::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:30:16,923::task::595::TaskManager.Task::(_updateState) Task=`ac2dd8dd-c7df-40a5-95d9-99590ac314fa`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:30:16,923::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:30:16,923::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`a171116e-adba-4f88-b3f0-2aa12499cea2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:30:16,923::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:30:16,924::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:30:16,924::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`a171116e-adba-4f88-b3f0-2aa12499cea2`::Granted request >Thread-34::DEBUG::2014-07-24 11:30:16,924::task::827::TaskManager.Task::(resourceAcquired) Task=`ac2dd8dd-c7df-40a5-95d9-99590ac314fa`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:30:16,924::task::990::TaskManager.Task::(_decref) Task=`ac2dd8dd-c7df-40a5-95d9-99590ac314fa`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:30:16,925::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:30:16,925::task::1185::TaskManager.Task::(prepare) Task=`ac2dd8dd-c7df-40a5-95d9-99590ac314fa`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:30:16,925::task::595::TaskManager.Task::(_updateState) Task=`ac2dd8dd-c7df-40a5-95d9-99590ac314fa`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:30:16,926::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:30:16,926::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:30:16,926::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:30:16,926::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:30:16,926::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:30:16,926::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:30:16,927::task::990::TaskManager.Task::(_decref) Task=`ac2dd8dd-c7df-40a5-95d9-99590ac314fa`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:30:17,313::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:30:17,323::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000793366 s, 5.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:30:17,508::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:30:17,580::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327718 s, 31.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:30:19,592::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:30:19,666::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346409 s, 29.6 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:30:21,237::task::595::TaskManager.Task::(_updateState) Task=`9c9ccee5-0421-442a-be4c-442cc0100a8b`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:30:21,238::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:30:21,238::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000793366', 'lastCheck': '3.9', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:30:21,238::task::1185::TaskManager.Task::(prepare) Task=`9c9ccee5-0421-442a-be4c-442cc0100a8b`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000793366', 'lastCheck': '3.9', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:30:21,238::task::595::TaskManager.Task::(_updateState) Task=`9c9ccee5-0421-442a-be4c-442cc0100a8b`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:30:21,238::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:30:21,239::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:30:21,239::task::990::TaskManager.Task::(_decref) Task=`9c9ccee5-0421-442a-be4c-442cc0100a8b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:30:21,679::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:30:21,751::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0326879 s, 31.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:30:23,763::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:30:23,837::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336322 s, 30.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:30:25,849::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:30:25,924::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340276 s, 30.1 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:30:26,990::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:30:26,991::task::595::TaskManager.Task::(_updateState) Task=`b5701a58-2690-4076-904c-39a6b313795a`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:30:26,991::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:30:26,991::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:30:26,991::task::1185::TaskManager.Task::(prepare) Task=`b5701a58-2690-4076-904c-39a6b313795a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:30:26,992::task::595::TaskManager.Task::(_updateState) Task=`b5701a58-2690-4076-904c-39a6b313795a`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:30:26,992::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:30:26,992::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:30:26,992::task::990::TaskManager.Task::(_decref) Task=`b5701a58-2690-4076-904c-39a6b313795a`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:30:27,028::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:30:27,028::task::595::TaskManager.Task::(_updateState) Task=`31a9a955-6995-441e-93ec-09f146a89ae2`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:30:27,028::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:30:27,029::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`5d901bc3-6f42-42b7-9320-325dbb4553fc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:30:27,029::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:30:27,029::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:30:27,030::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`5d901bc3-6f42-42b7-9320-325dbb4553fc`::Granted request >Thread-34::DEBUG::2014-07-24 11:30:27,030::task::827::TaskManager.Task::(resourceAcquired) Task=`31a9a955-6995-441e-93ec-09f146a89ae2`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:30:27,030::task::990::TaskManager.Task::(_decref) Task=`31a9a955-6995-441e-93ec-09f146a89ae2`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:30:27,031::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:30:27,031::task::1185::TaskManager.Task::(prepare) Task=`31a9a955-6995-441e-93ec-09f146a89ae2`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:30:27,031::task::595::TaskManager.Task::(_updateState) Task=`31a9a955-6995-441e-93ec-09f146a89ae2`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:30:27,031::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:30:27,032::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:30:27,032::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:30:27,032::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:30:27,032::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:30:27,032::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:30:27,033::task::990::TaskManager.Task::(_decref) Task=`31a9a955-6995-441e-93ec-09f146a89ae2`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:30:27,327::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:30:27,337::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000745179 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:30:27,936::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:30:28,012::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356819 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:30:30,024::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:30:30,098::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341842 s, 30.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:30:30,268::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:30:32,110::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:30:32,184::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351114 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:30:34,195::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:30:34,268::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328917 s, 31.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:30:36,280::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:30:36,355::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355634 s, 28.8 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:30:36,633::task::595::TaskManager.Task::(_updateState) Task=`03e756c1-3cce-4bd7-b794-94ee74af2566`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:30:36,634::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:30:36,634::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000745179', 'lastCheck': '9.3', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:30:36,634::task::1185::TaskManager.Task::(prepare) Task=`03e756c1-3cce-4bd7-b794-94ee74af2566`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000745179', 'lastCheck': '9.3', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:30:36,634::task::595::TaskManager.Task::(_updateState) Task=`03e756c1-3cce-4bd7-b794-94ee74af2566`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:30:36,634::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:30:36,634::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:30:36,635::task::990::TaskManager.Task::(_decref) Task=`03e756c1-3cce-4bd7-b794-94ee74af2566`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 11:30:37,094::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:30:37,094::task::595::TaskManager.Task::(_updateState) Task=`ff764b8b-45bf-4615-a241-bdb68610321d`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:30:37,095::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:30:37,095::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:30:37,095::task::1185::TaskManager.Task::(prepare) Task=`ff764b8b-45bf-4615-a241-bdb68610321d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:30:37,095::task::595::TaskManager.Task::(_updateState) Task=`ff764b8b-45bf-4615-a241-bdb68610321d`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:30:37,095::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:30:37,096::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:30:37,096::task::990::TaskManager.Task::(_decref) Task=`ff764b8b-45bf-4615-a241-bdb68610321d`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:30:37,133::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:30:37,133::task::595::TaskManager.Task::(_updateState) Task=`269c7f7e-d9c9-4c35-a48f-4436d343dfaf`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:30:37,134::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:30:37,134::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`2526b694-5c28-4270-b5e3-cf11a095d4bd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:30:37,134::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:30:37,134::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:30:37,135::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`2526b694-5c28-4270-b5e3-cf11a095d4bd`::Granted request >Thread-34::DEBUG::2014-07-24 11:30:37,135::task::827::TaskManager.Task::(resourceAcquired) Task=`269c7f7e-d9c9-4c35-a48f-4436d343dfaf`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:30:37,135::task::990::TaskManager.Task::(_decref) Task=`269c7f7e-d9c9-4c35-a48f-4436d343dfaf`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:30:37,136::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:30:37,136::task::1185::TaskManager.Task::(prepare) Task=`269c7f7e-d9c9-4c35-a48f-4436d343dfaf`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:30:37,136::task::595::TaskManager.Task::(_updateState) Task=`269c7f7e-d9c9-4c35-a48f-4436d343dfaf`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:30:37,136::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:30:37,136::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:30:37,137::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:30:37,137::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:30:37,137::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:30:37,137::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:30:37,137::task::990::TaskManager.Task::(_decref) Task=`269c7f7e-d9c9-4c35-a48f-4436d343dfaf`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:30:37,342::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:30:37,351::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000729984 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:30:38,367::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:30:38,439::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329014 s, 31.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:30:40,451::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:30:40,531::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0411821 s, 24.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:30:42,544::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:30:42,617::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341137 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:30:44,629::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:30:44,701::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329797 s, 31.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:30:46,713::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:30:46,793::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0406899 s, 25.2 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:30:47,197::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [21656b69] >Thread-13::DEBUG::2014-07-24 11:30:47,197::task::595::TaskManager.Task::(_updateState) Task=`8f962d99-6bfb-4bb6-b471-16640e279b4a`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:30:47,198::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:30:47,198::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:30:47,198::task::1185::TaskManager.Task::(prepare) Task=`8f962d99-6bfb-4bb6-b471-16640e279b4a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:30:47,198::task::595::TaskManager.Task::(_updateState) Task=`8f962d99-6bfb-4bb6-b471-16640e279b4a`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:30:47,198::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:30:47,199::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:30:47,199::task::990::TaskManager.Task::(_decref) Task=`8f962d99-6bfb-4bb6-b471-16640e279b4a`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:30:47,238::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [21656b69] >Thread-34::DEBUG::2014-07-24 11:30:47,238::task::595::TaskManager.Task::(_updateState) Task=`1f35ce07-aada-47d0-8a00-3ae42fc64158`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:30:47,238::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:30:47,239::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7da773cd-a038-4bf4-881d-af4df45aa5e4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:30:47,239::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:30:47,239::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:30:47,239::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7da773cd-a038-4bf4-881d-af4df45aa5e4`::Granted request >Thread-34::DEBUG::2014-07-24 11:30:47,239::task::827::TaskManager.Task::(resourceAcquired) Task=`1f35ce07-aada-47d0-8a00-3ae42fc64158`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:30:47,240::task::990::TaskManager.Task::(_decref) Task=`1f35ce07-aada-47d0-8a00-3ae42fc64158`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:30:47,240::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:30:47,241::task::1185::TaskManager.Task::(prepare) Task=`1f35ce07-aada-47d0-8a00-3ae42fc64158`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:30:47,241::task::595::TaskManager.Task::(_updateState) Task=`1f35ce07-aada-47d0-8a00-3ae42fc64158`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:30:47,241::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:30:47,241::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:30:47,241::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:30:47,242::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:30:47,242::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:30:47,242::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:30:47,242::task::990::TaskManager.Task::(_decref) Task=`1f35ce07-aada-47d0-8a00-3ae42fc64158`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:30:47,356::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:30:47,366::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00081977 s, 5.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:30:48,805::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:30:49,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.170806 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:30:51,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:30:51,103::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348641 s, 29.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:30:52,019::task::595::TaskManager.Task::(_updateState) Task=`272987b9-08f6-49ec-94c6-83f55a17cde6`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:30:52,019::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:30:52,020::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00081977', 'lastCheck': '4.6', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:30:52,020::task::1185::TaskManager.Task::(prepare) Task=`272987b9-08f6-49ec-94c6-83f55a17cde6`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00081977', 'lastCheck': '4.6', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:30:52,020::task::595::TaskManager.Task::(_updateState) Task=`272987b9-08f6-49ec-94c6-83f55a17cde6`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:30:52,020::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:30:52,020::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:30:52,020::task::990::TaskManager.Task::(_decref) Task=`272987b9-08f6-49ec-94c6-83f55a17cde6`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:30:53,115::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:30:53,190::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035462 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:30:55,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:30:55,282::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0404848 s, 25.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:30:57,294::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::ERROR::2014-07-24 11:30:57,303::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 731, in _checkForMail > (rc, in_mail, err) = misc.execCmd(cmd, sudo=False, raw=True) > File "/usr/lib64/python2.6/site-packages/vdsm/utils.py", line 645, in execCmd > deathSignal=deathSignal, childUmask=childUmask) > File "/usr/lib64/python2.6/site-packages/cpopen/__init__.py", line 50, in __init__ > stderr=PIPE) > File "/usr/lib64/python2.6/subprocess.py", line 642, in __init__ > errread, errwrite) > File "/usr/lib64/python2.6/site-packages/cpopen/__init__.py", line 80, in _execute_child_v275 > self._childUmask) >OSError: [Errno 2] No such file or directory >Thread-13::DEBUG::2014-07-24 11:30:57,306::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:30:57,307::task::595::TaskManager.Task::(_updateState) Task=`21737e30-30db-4dfd-a9fc-12bb766272f2`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:30:57,308::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:30:57,308::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:30:57,308::task::1185::TaskManager.Task::(prepare) Task=`21737e30-30db-4dfd-a9fc-12bb766272f2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:30:57,309::task::595::TaskManager.Task::(_updateState) Task=`21737e30-30db-4dfd-a9fc-12bb766272f2`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:30:57,309::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:30:57,309::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:30:57,309::task::990::TaskManager.Task::(_decref) Task=`21737e30-30db-4dfd-a9fc-12bb766272f2`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:30:57,346::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:30:57,346::task::595::TaskManager.Task::(_updateState) Task=`796eaeb3-48e2-42f7-9f85-4619bfc043f3`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:30:57,346::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:30:57,347::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`5e053b52-b2ab-40cd-aac5-780dda8dd26f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:30:57,347::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:30:57,347::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:30:57,347::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`5e053b52-b2ab-40cd-aac5-780dda8dd26f`::Granted request >Thread-34::DEBUG::2014-07-24 11:30:57,348::task::827::TaskManager.Task::(resourceAcquired) Task=`796eaeb3-48e2-42f7-9f85-4619bfc043f3`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:30:57,348::task::990::TaskManager.Task::(_decref) Task=`796eaeb3-48e2-42f7-9f85-4619bfc043f3`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:30:57,349::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:30:57,349::task::1185::TaskManager.Task::(prepare) Task=`796eaeb3-48e2-42f7-9f85-4619bfc043f3`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:30:57,349::task::595::TaskManager.Task::(_updateState) Task=`796eaeb3-48e2-42f7-9f85-4619bfc043f3`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:30:57,349::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:30:57,349::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:30:57,350::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:30:57,350::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:30:57,350::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:30:57,350::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:30:57,350::task::990::TaskManager.Task::(_decref) Task=`796eaeb3-48e2-42f7-9f85-4619bfc043f3`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:30:57,370::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::ERROR::2014-07-24 11:30:57,376::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain) Error while collecting domain 23aa0606-edc3-4882-a4aa-18aa1983458f monitoring information >Traceback (most recent call last): > File "/usr/share/vdsm/storage/domainMonitor.py", line 217, in _monitorDomain > self.nextStatus.readDelay = self.domain.getReadDelay() > File "/usr/share/vdsm/storage/blockSD.py", line 600, in getReadDelay > stats = misc.readspeed(lvm.lvPath(self.sdUUID, sd.METADATA), 4096) > File "/usr/share/vdsm/storage/misc.py", line 210, in readspeed > rc, _, err = execCmd(cmd) > File "/usr/lib64/python2.6/site-packages/vdsm/utils.py", line 645, in execCmd > deathSignal=deathSignal, childUmask=childUmask) > File "/usr/lib64/python2.6/site-packages/cpopen/__init__.py", line 50, in __init__ > stderr=PIPE) > File "/usr/lib64/python2.6/subprocess.py", line 642, in __init__ > errread, errwrite) > File "/usr/lib64/python2.6/site-packages/cpopen/__init__.py", line 80, in _execute_child_v275 > self._childUmask) >OSError: [Errno 2] No such file or directory >Thread-18::DEBUG::2014-07-24 11:30:57,378::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain 23aa0606-edc3-4882-a4aa-18aa1983458f changed its status to Invalid >Thread-43::DEBUG::2014-07-24 11:30:57,379::misc::860::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event >Thread-43::DEBUG::2014-07-24 11:30:57,379::misc::870::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `_onDomainStateChange` >Thread-43::DEBUG::2014-07-24 11:30:57,380::misc::870::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms` >Thread-43::DEBUG::2014-07-24 11:30:57,381::misc::870::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `_upgradePoolDomain` >Thread-43::DEBUG::2014-07-24 11:30:57,382::misc::880::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted >Dummy-33::DEBUG::2014-07-24 11:30:59,309::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:30:59,386::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329969 s, 31.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:31:00,307::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:31:01,399::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:31:01,480::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379445 s, 27.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:31:03,492::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:31:03,571::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365319 s, 28.0 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:31:05,545::task::595::TaskManager.Task::(_updateState) Task=`694f3857-faba-4a89-b7c1-2f773d7e675b`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:31:05,545::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:31:05,545::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:31:05,545::task::1185::TaskManager.Task::(prepare) Task=`694f3857-faba-4a89-b7c1-2f773d7e675b`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:31:05,546::task::595::TaskManager.Task::(_updateState) Task=`694f3857-faba-4a89-b7c1-2f773d7e675b`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:31:05,546::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:31:05,546::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:31:05,546::task::990::TaskManager.Task::(_decref) Task=`694f3857-faba-4a89-b7c1-2f773d7e675b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:31:05,584::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:31:05,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332098 s, 30.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:31:07,380::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:31:07,406::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0152933 s, 268 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:31:07,410::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:31:07,412::task::595::TaskManager.Task::(_updateState) Task=`602ee0ab-8f8b-4a3d-9d5b-5617c7d14fee`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:31:07,414::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:31:07,415::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:31:07,416::task::1185::TaskManager.Task::(prepare) Task=`602ee0ab-8f8b-4a3d-9d5b-5617c7d14fee`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:31:07,417::task::595::TaskManager.Task::(_updateState) Task=`602ee0ab-8f8b-4a3d-9d5b-5617c7d14fee`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:31:07,418::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:31:07,419::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:31:07,419::task::990::TaskManager.Task::(_decref) Task=`602ee0ab-8f8b-4a3d-9d5b-5617c7d14fee`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:31:07,420::domainMonitor::247::Storage.DomainMonitorThread::(_monitorDomain) Domain 23aa0606-edc3-4882-a4aa-18aa1983458f changed its status to Valid >Thread-47::DEBUG::2014-07-24 11:31:07,423::misc::860::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event >Thread-47::DEBUG::2014-07-24 11:31:07,424::misc::870::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `_onDomainStateChange` >Thread-47::DEBUG::2014-07-24 11:31:07,425::misc::870::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms` >Thread-48::WARNING::2014-07-24 11:31:07,426::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/23aa0606-edc3-4882-a4aa-18aa1983458f/images already exists >Thread-48::WARNING::2014-07-24 11:31:07,427::fileUtils::167::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt/blockSD/23aa0606-edc3-4882-a4aa-18aa1983458f/dom_md already exists >Thread-47::DEBUG::2014-07-24 11:31:07,427::misc::870::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `_upgradePoolDomain` >Thread-49::INFO::2014-07-24 11:31:07,429::clientIF::126::vds::(contEIOVms) vmContainerLock acquired >Thread-47::DEBUG::2014-07-24 11:31:07,432::misc::880::Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted >Thread-48::INFO::2014-07-24 11:31:07,432::sp::1113::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/23aa0606-edc3-4882-a4aa-18aa1983458f to /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/23aa0606-edc3-4882-a4aa-18aa1983458f >Thread-48::INFO::2014-07-24 11:31:07,434::sp::1113::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/blockSD/23aa0606-edc3-4882-a4aa-18aa1983458f to /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd >Thread-34::DEBUG::2014-07-24 11:31:07,453::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:31:07,453::task::595::TaskManager.Task::(_updateState) Task=`6cc2ca56-7521-46ba-b3e2-7936e50f0a7e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:31:07,453::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:31:07,454::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`850528a2-eb74-4388-aabc-7c01b5b22755`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:31:07,454::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:31:07,454::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:31:07,454::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`850528a2-eb74-4388-aabc-7c01b5b22755`::Granted request >Thread-34::DEBUG::2014-07-24 11:31:07,455::task::827::TaskManager.Task::(resourceAcquired) Task=`6cc2ca56-7521-46ba-b3e2-7936e50f0a7e`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:31:07,455::task::990::TaskManager.Task::(_decref) Task=`6cc2ca56-7521-46ba-b3e2-7936e50f0a7e`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:31:07,456::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:31:07,456::task::1185::TaskManager.Task::(prepare) Task=`6cc2ca56-7521-46ba-b3e2-7936e50f0a7e`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:31:07,456::task::595::TaskManager.Task::(_updateState) Task=`6cc2ca56-7521-46ba-b3e2-7936e50f0a7e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:31:07,456::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:31:07,456::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:31:07,456::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:31:07,457::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:31:07,457::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:31:07,457::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:31:07,457::task::990::TaskManager.Task::(_decref) Task=`6cc2ca56-7521-46ba-b3e2-7936e50f0a7e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:31:07,671::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-13::DEBUG::2014-07-24 11:31:07,706::task::595::TaskManager.Task::(_updateState) Task=`c38c4dd0-b958-4a41-b4a0-acc5b41171fc`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:31:07,709::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:31:07,710::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0152933', 'lastCheck': '0.3', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:31:07,712::task::1185::TaskManager.Task::(prepare) Task=`c38c4dd0-b958-4a41-b4a0-acc5b41171fc`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0152933', 'lastCheck': '0.3', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:31:07,713::task::595::TaskManager.Task::(_updateState) Task=`c38c4dd0-b958-4a41-b4a0-acc5b41171fc`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:31:07,714::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:31:07,715::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:31:07,717::task::990::TaskManager.Task::(_decref) Task=`c38c4dd0-b958-4a41-b4a0-acc5b41171fc`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:31:07,789::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0757559 s, 13.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:31:09,801::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:31:09,879::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344502 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:31:11,891::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:31:11,966::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033444 s, 30.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:31:13,978::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:31:14,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330762 s, 31.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:31:16,073::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:31:16,149::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339124 s, 30.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:31:17,423::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 23aa0606-edc3-4882-a4aa-18aa1983458f >Thread-18::DEBUG::2014-07-24 11:31:17,423::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-18::DEBUG::2014-07-24 11:31:17,424::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:31:17,435::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000721759 s, 2.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:31:17,436::misc::264::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000721759 s, 2.8 MB/s'], size: 2048 >Thread-18::DEBUG::2014-07-24 11:31:17,436::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-18::WARNING::2014-07-24 11:31:17,436::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-18::DEBUG::2014-07-24 11:31:17,436::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-18::DEBUG::2014-07-24 11:31:17,437::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 11:31:17,437::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 11:31:17,437::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 11:31:17,437::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 11:31:17,437::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 11:31:17,438::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-13::DEBUG::2014-07-24 11:31:17,515::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:31:17,516::task::595::TaskManager.Task::(_updateState) Task=`689926a2-6131-4dd3-b607-01eb4b756e7b`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:31:17,516::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-18::DEBUG::2014-07-24 11:31:17,645::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:31:17,646::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 11:31:17,647::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'LOCKPOLICY=', 'POOL_DOMAINS=23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'POOL_DESCRIPTION=DS1', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_UUID=637ea13c-81a8-4b44-8cab-961458b01883', 'POOL_SPM_ID=1', '_SHA_CKSUM=a749afdc7119a2d6aad840af5c63c9b28c0b612c', 'POOL_SPM_LVER=0'] >Thread-18::INFO::2014-07-24 11:31:17,647::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_imageNS already registered >Thread-18::INFO::2014-07-24 11:31:17,648::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_volumeNS already registered >Thread-18::INFO::2014-07-24 11:31:17,648::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_lvmActivationNS already registered >Thread-13::INFO::2014-07-24 11:31:17,650::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:31:17,651::task::1185::TaskManager.Task::(prepare) Task=`689926a2-6131-4dd3-b607-01eb4b756e7b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-18::DEBUG::2014-07-24 11:31:17,652::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-13::DEBUG::2014-07-24 11:31:17,661::task::595::TaskManager.Task::(_updateState) Task=`689926a2-6131-4dd3-b607-01eb4b756e7b`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:31:17,663::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:31:17,663::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:31:17,663::task::990::TaskManager.Task::(_decref) Task=`689926a2-6131-4dd3-b607-01eb4b756e7b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:31:17,699::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:31:17,699::task::595::TaskManager.Task::(_updateState) Task=`60405315-878a-49e8-bf0c-a2eaf11e1363`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:31:17,699::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:31:17,700::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`80cd919d-d8a3-4355-a3ff-32c9d9cf71a3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:31:17,700::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:31:17,700::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:31:17,701::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`80cd919d-d8a3-4355-a3ff-32c9d9cf71a3`::Granted request >Thread-34::DEBUG::2014-07-24 11:31:17,701::task::827::TaskManager.Task::(resourceAcquired) Task=`60405315-878a-49e8-bf0c-a2eaf11e1363`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:31:17,701::task::990::TaskManager.Task::(_decref) Task=`60405315-878a-49e8-bf0c-a2eaf11e1363`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:31:17,702::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:31:17,702::task::1185::TaskManager.Task::(prepare) Task=`60405315-878a-49e8-bf0c-a2eaf11e1363`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:31:17,702::task::595::TaskManager.Task::(_updateState) Task=`60405315-878a-49e8-bf0c-a2eaf11e1363`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:31:17,702::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:31:17,703::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:31:17,703::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:31:17,703::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:31:17,703::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:31:17,703::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:31:17,704::task::990::TaskManager.Task::(_decref) Task=`60405315-878a-49e8-bf0c-a2eaf11e1363`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:31:17,807::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:31:17,807::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:31:17,819::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000621592 s, 6.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:31:18,161::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:31:18,242::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0386101 s, 26.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:31:20,254::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:31:20,329::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336907 s, 30.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:31:22,343::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:31:22,417::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330715 s, 31.0 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:31:23,168::task::595::TaskManager.Task::(_updateState) Task=`8888fb51-dc8c-4975-a574-3882fbdde8e4`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:31:23,169::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:31:23,169::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000621592', 'lastCheck': '5.3', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:31:23,169::task::1185::TaskManager.Task::(prepare) Task=`8888fb51-dc8c-4975-a574-3882fbdde8e4`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000621592', 'lastCheck': '5.3', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:31:23,169::task::595::TaskManager.Task::(_updateState) Task=`8888fb51-dc8c-4975-a574-3882fbdde8e4`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:31:23,169::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:31:23,170::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:31:23,170::task::990::TaskManager.Task::(_decref) Task=`8888fb51-dc8c-4975-a574-3882fbdde8e4`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:31:24,430::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:31:24,507::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334704 s, 30.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:31:26,519::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:31:26,594::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332968 s, 30.8 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:31:27,763::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:31:27,764::task::595::TaskManager.Task::(_updateState) Task=`352762d1-2a3d-4151-95ff-afef1bad3172`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:31:27,764::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:31:27,764::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:31:27,765::task::1185::TaskManager.Task::(prepare) Task=`352762d1-2a3d-4151-95ff-afef1bad3172`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:31:27,765::task::595::TaskManager.Task::(_updateState) Task=`352762d1-2a3d-4151-95ff-afef1bad3172`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:31:27,765::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:31:27,765::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:31:27,765::task::990::TaskManager.Task::(_decref) Task=`352762d1-2a3d-4151-95ff-afef1bad3172`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:31:27,820::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:31:27,820::task::595::TaskManager.Task::(_updateState) Task=`3975b0f5-9dfc-4850-b348-1773ca7d7b51`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:31:27,820::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:31:27,822::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c27fc219-2ca0-4906-9b80-5b09967d6199`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:31:27,823::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:31:27,823::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:31:27,823::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c27fc219-2ca0-4906-9b80-5b09967d6199`::Granted request >Thread-34::DEBUG::2014-07-24 11:31:27,823::task::827::TaskManager.Task::(resourceAcquired) Task=`3975b0f5-9dfc-4850-b348-1773ca7d7b51`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:31:27,824::task::990::TaskManager.Task::(_decref) Task=`3975b0f5-9dfc-4850-b348-1773ca7d7b51`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:31:27,824::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:31:27,825::task::1185::TaskManager.Task::(prepare) Task=`3975b0f5-9dfc-4850-b348-1773ca7d7b51`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:31:27,825::task::595::TaskManager.Task::(_updateState) Task=`3975b0f5-9dfc-4850-b348-1773ca7d7b51`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:31:27,825::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:31:27,825::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:31:27,825::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:31:27,825::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:31:27,826::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:31:27,826::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:31:27,826::task::990::TaskManager.Task::(_decref) Task=`3975b0f5-9dfc-4850-b348-1773ca7d7b51`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:31:27,830::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:31:27,841::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000733055 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:31:28,607::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:31:28,682::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335285 s, 30.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:31:30,346::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:31:30,695::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:31:30,770::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331103 s, 30.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:31:32,783::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:31:32,857::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333441 s, 30.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:31:34,870::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:31:34,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352166 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:31:36,960::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:31:37,036::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338821 s, 30.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:31:37,846::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:31:37,857::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000663777 s, 6.2 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:31:37,916::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:31:37,916::task::595::TaskManager.Task::(_updateState) Task=`7d138b5b-0064-4cc4-b366-85c0dfc8f033`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:31:37,917::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:31:37,917::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:31:37,917::task::1185::TaskManager.Task::(prepare) Task=`7d138b5b-0064-4cc4-b366-85c0dfc8f033`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:31:37,917::task::595::TaskManager.Task::(_updateState) Task=`7d138b5b-0064-4cc4-b366-85c0dfc8f033`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:31:37,918::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:31:37,918::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:31:37,918::task::990::TaskManager.Task::(_decref) Task=`7d138b5b-0064-4cc4-b366-85c0dfc8f033`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:31:37,950::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:31:37,951::task::595::TaskManager.Task::(_updateState) Task=`ab04fb3d-d189-45ac-866c-80aeadd7f8a6`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:31:37,951::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:31:37,951::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`63814d9f-a203-4ff8-9aa4-400b7ee84fa7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:31:37,951::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:31:37,952::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:31:37,952::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`63814d9f-a203-4ff8-9aa4-400b7ee84fa7`::Granted request >Thread-34::DEBUG::2014-07-24 11:31:37,952::task::827::TaskManager.Task::(resourceAcquired) Task=`ab04fb3d-d189-45ac-866c-80aeadd7f8a6`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:31:37,952::task::990::TaskManager.Task::(_decref) Task=`ab04fb3d-d189-45ac-866c-80aeadd7f8a6`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:31:37,953::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:31:37,953::task::1185::TaskManager.Task::(prepare) Task=`ab04fb3d-d189-45ac-866c-80aeadd7f8a6`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:31:37,953::task::595::TaskManager.Task::(_updateState) Task=`ab04fb3d-d189-45ac-866c-80aeadd7f8a6`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:31:37,953::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:31:37,954::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:31:37,954::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:31:37,954::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:31:37,954::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:31:37,954::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:31:37,955::task::990::TaskManager.Task::(_decref) Task=`ab04fb3d-d189-45ac-866c-80aeadd7f8a6`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 11:31:38,524::task::595::TaskManager.Task::(_updateState) Task=`541e6031-9d49-40d4-b647-7bc1673f11b2`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:31:38,524::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:31:38,524::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000663777', 'lastCheck': '0.7', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:31:38,525::task::1185::TaskManager.Task::(prepare) Task=`541e6031-9d49-40d4-b647-7bc1673f11b2`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000663777', 'lastCheck': '0.7', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:31:38,525::task::595::TaskManager.Task::(_updateState) Task=`541e6031-9d49-40d4-b647-7bc1673f11b2`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:31:38,525::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:31:38,525::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:31:38,525::task::990::TaskManager.Task::(_decref) Task=`541e6031-9d49-40d4-b647-7bc1673f11b2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:31:39,048::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:31:39,251::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346796 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:31:41,263::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:31:41,339::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331527 s, 30.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:31:43,351::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:31:43,427::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0327827 s, 31.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:31:45,440::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:31:45,516::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336008 s, 30.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:31:47,528::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:31:47,604::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334861 s, 30.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:31:47,862::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:31:47,873::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00066701 s, 6.1 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:31:48,015::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:31:48,015::task::595::TaskManager.Task::(_updateState) Task=`6e118804-f40b-44ac-89d9-1a41a0991002`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:31:48,016::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:31:48,016::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:31:48,016::task::1185::TaskManager.Task::(prepare) Task=`6e118804-f40b-44ac-89d9-1a41a0991002`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:31:48,016::task::595::TaskManager.Task::(_updateState) Task=`6e118804-f40b-44ac-89d9-1a41a0991002`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:31:48,016::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:31:48,017::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:31:48,017::task::990::TaskManager.Task::(_decref) Task=`6e118804-f40b-44ac-89d9-1a41a0991002`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:31:48,048::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:31:48,049::task::595::TaskManager.Task::(_updateState) Task=`c73c9c1f-6093-4209-a452-e8178e359e2e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:31:48,049::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:31:48,049::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f386d892-f0b1-430c-8578-2d4d9e97429d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:31:48,049::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:31:48,050::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:31:48,050::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f386d892-f0b1-430c-8578-2d4d9e97429d`::Granted request >Thread-34::DEBUG::2014-07-24 11:31:48,050::task::827::TaskManager.Task::(resourceAcquired) Task=`c73c9c1f-6093-4209-a452-e8178e359e2e`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:31:48,050::task::990::TaskManager.Task::(_decref) Task=`c73c9c1f-6093-4209-a452-e8178e359e2e`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:31:48,051::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:31:48,051::task::1185::TaskManager.Task::(prepare) Task=`c73c9c1f-6093-4209-a452-e8178e359e2e`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:31:48,051::task::595::TaskManager.Task::(_updateState) Task=`c73c9c1f-6093-4209-a452-e8178e359e2e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:31:48,052::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:31:48,052::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:31:48,052::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:31:48,052::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:31:48,052::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:31:48,052::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:31:48,053::task::990::TaskManager.Task::(_decref) Task=`c73c9c1f-6093-4209-a452-e8178e359e2e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:31:49,616::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:31:49,692::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346702 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:31:51,705::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:31:51,804::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0566207 s, 18.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:31:53,816::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-13::DEBUG::2014-07-24 11:31:53,890::task::595::TaskManager.Task::(_updateState) Task=`cec84b04-7c10-4736-a72e-c39d66307bcb`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:31:53,892::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:31:53,894::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066701', 'lastCheck': '6.0', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:31:53,895::task::1185::TaskManager.Task::(prepare) Task=`cec84b04-7c10-4736-a72e-c39d66307bcb`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00066701', 'lastCheck': '6.0', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:31:53,897::task::595::TaskManager.Task::(_updateState) Task=`cec84b04-7c10-4736-a72e-c39d66307bcb`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:31:53,898::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:31:53,899::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:31:53,901::task::990::TaskManager.Task::(_decref) Task=`cec84b04-7c10-4736-a72e-c39d66307bcb`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:31:53,933::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330597 s, 31.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:31:55,946::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:31:56,023::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033334 s, 30.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:31:57,878::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:31:57,889::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000702215 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:31:58,035::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:31:58,110::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336226 s, 30.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:31:58,116::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:31:58,119::task::595::TaskManager.Task::(_updateState) Task=`08258795-7c71-41b1-8b00-f7251def210c`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:31:58,120::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:31:58,122::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:31:58,123::task::1185::TaskManager.Task::(prepare) Task=`08258795-7c71-41b1-8b00-f7251def210c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:31:58,124::task::595::TaskManager.Task::(_updateState) Task=`08258795-7c71-41b1-8b00-f7251def210c`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:31:58,125::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:31:58,126::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:31:58,127::task::990::TaskManager.Task::(_decref) Task=`08258795-7c71-41b1-8b00-f7251def210c`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:31:58,173::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:31:58,174::task::595::TaskManager.Task::(_updateState) Task=`b3397543-7827-4193-b7ba-e950f7f008ad`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:31:58,174::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:31:58,174::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e8846947-c3ac-469d-8cf6-6591d72c748b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:31:58,174::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:31:58,175::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:31:58,175::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e8846947-c3ac-469d-8cf6-6591d72c748b`::Granted request >Thread-34::DEBUG::2014-07-24 11:31:58,175::task::827::TaskManager.Task::(resourceAcquired) Task=`b3397543-7827-4193-b7ba-e950f7f008ad`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:31:58,175::task::990::TaskManager.Task::(_decref) Task=`b3397543-7827-4193-b7ba-e950f7f008ad`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:31:58,176::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:31:58,176::task::1185::TaskManager.Task::(prepare) Task=`b3397543-7827-4193-b7ba-e950f7f008ad`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:31:58,176::task::595::TaskManager.Task::(_updateState) Task=`b3397543-7827-4193-b7ba-e950f7f008ad`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:31:58,177::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:31:58,177::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:31:58,177::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:31:58,177::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:31:58,177::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:31:58,177::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:31:58,178::task::990::TaskManager.Task::(_decref) Task=`b3397543-7827-4193-b7ba-e950f7f008ad`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:32:00,140::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:32:00,229::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0444519 s, 23.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:32:00,384::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:32:02,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:32:02,317::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343336 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:32:04,330::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:32:04,406::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331438 s, 30.9 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:32:05,699::task::595::TaskManager.Task::(_updateState) Task=`ce7eb474-1389-4e70-b93a-eaba1eeffdc7`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:32:05,700::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:32:05,700::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:32:05,700::task::1185::TaskManager.Task::(prepare) Task=`ce7eb474-1389-4e70-b93a-eaba1eeffdc7`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:32:05,700::task::595::TaskManager.Task::(_updateState) Task=`ce7eb474-1389-4e70-b93a-eaba1eeffdc7`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:32:05,701::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:32:05,701::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:32:05,701::task::990::TaskManager.Task::(_decref) Task=`ce7eb474-1389-4e70-b93a-eaba1eeffdc7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:32:06,418::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:32:06,495::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346828 s, 29.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:32:07,894::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:32:07,906::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00127675 s, 3.2 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:32:08,243::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:32:08,244::task::595::TaskManager.Task::(_updateState) Task=`fb84cf76-6bb3-4289-a0ee-0d182e5eaa89`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:32:08,244::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:32:08,244::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:32:08,245::task::1185::TaskManager.Task::(prepare) Task=`fb84cf76-6bb3-4289-a0ee-0d182e5eaa89`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:32:08,245::task::595::TaskManager.Task::(_updateState) Task=`fb84cf76-6bb3-4289-a0ee-0d182e5eaa89`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:32:08,245::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:32:08,245::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:32:08,245::task::990::TaskManager.Task::(_decref) Task=`fb84cf76-6bb3-4289-a0ee-0d182e5eaa89`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:32:08,282::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:32:08,283::task::595::TaskManager.Task::(_updateState) Task=`d587109d-462f-4900-aa38-62a9970ac9be`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:32:08,283::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:32:08,283::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`915487a1-1774-434a-9506-461a21b69285`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:32:08,283::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:32:08,284::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:32:08,284::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`915487a1-1774-434a-9506-461a21b69285`::Granted request >Thread-34::DEBUG::2014-07-24 11:32:08,284::task::827::TaskManager.Task::(resourceAcquired) Task=`d587109d-462f-4900-aa38-62a9970ac9be`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:32:08,284::task::990::TaskManager.Task::(_decref) Task=`d587109d-462f-4900-aa38-62a9970ac9be`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:32:08,285::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:32:08,285::task::1185::TaskManager.Task::(prepare) Task=`d587109d-462f-4900-aa38-62a9970ac9be`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:32:08,285::task::595::TaskManager.Task::(_updateState) Task=`d587109d-462f-4900-aa38-62a9970ac9be`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:32:08,285::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:32:08,286::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:32:08,286::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:32:08,286::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:32:08,286::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:32:08,286::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:32:08,287::task::990::TaskManager.Task::(_decref) Task=`d587109d-462f-4900-aa38-62a9970ac9be`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:32:08,507::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:32:08,583::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339819 s, 30.1 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:32:09,301::task::595::TaskManager.Task::(_updateState) Task=`71bb0f94-e329-4e56-9d1f-1ac20498d9d8`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:32:09,302::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:32:09,302::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00127675', 'lastCheck': '1.4', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:32:09,302::task::1185::TaskManager.Task::(prepare) Task=`71bb0f94-e329-4e56-9d1f-1ac20498d9d8`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00127675', 'lastCheck': '1.4', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:32:09,302::task::595::TaskManager.Task::(_updateState) Task=`71bb0f94-e329-4e56-9d1f-1ac20498d9d8`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:32:09,302::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:32:09,302::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:32:09,303::task::990::TaskManager.Task::(_decref) Task=`71bb0f94-e329-4e56-9d1f-1ac20498d9d8`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:32:10,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:32:10,671::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333216 s, 30.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:32:12,683::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:32:12,759::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335616 s, 30.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:32:14,771::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:32:14,845::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329816 s, 31.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:32:16,858::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:32:16,936::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352657 s, 29.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:32:17,910::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:32:17,922::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00075294 s, 5.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:32:18,344::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:32:18,344::task::595::TaskManager.Task::(_updateState) Task=`57af6118-a8ec-4099-af4c-273b1204f644`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:32:18,345::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:32:18,345::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:32:18,345::task::1185::TaskManager.Task::(prepare) Task=`57af6118-a8ec-4099-af4c-273b1204f644`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:32:18,345::task::595::TaskManager.Task::(_updateState) Task=`57af6118-a8ec-4099-af4c-273b1204f644`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:32:18,345::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:32:18,346::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:32:18,346::task::990::TaskManager.Task::(_decref) Task=`57af6118-a8ec-4099-af4c-273b1204f644`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:32:18,379::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:32:18,379::task::595::TaskManager.Task::(_updateState) Task=`a5ab9604-aa8a-4204-a5d7-7d71cdccfc4c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:32:18,379::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:32:18,380::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f9edccc4-976b-4879-8f14-6e79c4cde936`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:32:18,380::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:32:18,380::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:32:18,380::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f9edccc4-976b-4879-8f14-6e79c4cde936`::Granted request >Thread-34::DEBUG::2014-07-24 11:32:18,381::task::827::TaskManager.Task::(resourceAcquired) Task=`a5ab9604-aa8a-4204-a5d7-7d71cdccfc4c`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:32:18,381::task::990::TaskManager.Task::(_decref) Task=`a5ab9604-aa8a-4204-a5d7-7d71cdccfc4c`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:32:18,381::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:32:18,382::task::1185::TaskManager.Task::(prepare) Task=`a5ab9604-aa8a-4204-a5d7-7d71cdccfc4c`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:32:18,382::task::595::TaskManager.Task::(_updateState) Task=`a5ab9604-aa8a-4204-a5d7-7d71cdccfc4c`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:32:18,382::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:32:18,382::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:32:18,382::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:32:18,382::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:32:18,383::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:32:18,383::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:32:18,383::task::990::TaskManager.Task::(_decref) Task=`a5ab9604-aa8a-4204-a5d7-7d71cdccfc4c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:32:18,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:32:19,025::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345947 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:32:21,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:32:21,113::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332386 s, 30.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:32:23,125::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:32:23,201::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033636 s, 30.4 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:32:24,669::task::595::TaskManager.Task::(_updateState) Task=`d84e6142-79a5-4e87-997b-49b4da70962c`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:32:24,670::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:32:24,670::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00075294', 'lastCheck': '6.7', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:32:24,670::task::1185::TaskManager.Task::(prepare) Task=`d84e6142-79a5-4e87-997b-49b4da70962c`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00075294', 'lastCheck': '6.7', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:32:24,670::task::595::TaskManager.Task::(_updateState) Task=`d84e6142-79a5-4e87-997b-49b4da70962c`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:32:24,670::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:32:24,671::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:32:24,671::task::990::TaskManager.Task::(_decref) Task=`d84e6142-79a5-4e87-997b-49b4da70962c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:32:25,212::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:32:25,288::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328935 s, 31.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:32:27,300::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:32:27,374::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329217 s, 31.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:32:27,927::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:32:27,938::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000691685 s, 5.9 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:32:28,445::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:32:28,461::task::595::TaskManager.Task::(_updateState) Task=`3e452bf4-8f01-42f9-bf29-476096325712`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:32:28,462::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:32:28,462::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:32:28,462::task::1185::TaskManager.Task::(prepare) Task=`3e452bf4-8f01-42f9-bf29-476096325712`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:32:28,462::task::595::TaskManager.Task::(_updateState) Task=`3e452bf4-8f01-42f9-bf29-476096325712`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:32:28,462::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:32:28,463::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:32:28,463::task::990::TaskManager.Task::(_decref) Task=`3e452bf4-8f01-42f9-bf29-476096325712`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:32:28,505::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:32:28,505::task::595::TaskManager.Task::(_updateState) Task=`0aceade0-5e53-4396-bf54-b2c13caf5b08`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:32:28,505::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:32:28,506::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e8388c88-bf32-4901-b926-495628b71b15`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:32:28,506::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:32:28,506::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:32:28,506::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e8388c88-bf32-4901-b926-495628b71b15`::Granted request >Thread-34::DEBUG::2014-07-24 11:32:28,507::task::827::TaskManager.Task::(resourceAcquired) Task=`0aceade0-5e53-4396-bf54-b2c13caf5b08`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:32:28,507::task::990::TaskManager.Task::(_decref) Task=`0aceade0-5e53-4396-bf54-b2c13caf5b08`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:32:28,507::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:32:28,508::task::1185::TaskManager.Task::(prepare) Task=`0aceade0-5e53-4396-bf54-b2c13caf5b08`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:32:28,508::task::595::TaskManager.Task::(_updateState) Task=`0aceade0-5e53-4396-bf54-b2c13caf5b08`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:32:28,508::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:32:28,508::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:32:28,508::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:32:28,508::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:32:28,509::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:32:28,509::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:32:28,509::task::990::TaskManager.Task::(_decref) Task=`0aceade0-5e53-4396-bf54-b2c13caf5b08`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:32:29,387::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:32:29,464::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034215 s, 29.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:32:30,423::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:32:31,474::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:32:31,551::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348411 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:32:33,564::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:32:33,639::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0326733 s, 31.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:32:35,651::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:32:35,756::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0629336 s, 16.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:32:37,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:32:37,855::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0424777 s, 24.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:32:37,943::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:32:37,956::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000722854 s, 5.7 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:32:38,563::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:32:38,564::task::595::TaskManager.Task::(_updateState) Task=`fd64c016-bc68-49d0-abcc-472720ec2f26`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:32:38,564::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:32:38,564::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:32:38,564::task::1185::TaskManager.Task::(prepare) Task=`fd64c016-bc68-49d0-abcc-472720ec2f26`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:32:38,565::task::595::TaskManager.Task::(_updateState) Task=`fd64c016-bc68-49d0-abcc-472720ec2f26`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:32:38,565::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:32:38,565::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:32:38,565::task::990::TaskManager.Task::(_decref) Task=`fd64c016-bc68-49d0-abcc-472720ec2f26`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:32:38,599::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:32:38,599::task::595::TaskManager.Task::(_updateState) Task=`d3c26330-a932-45d0-915f-8190b0cf1b5c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:32:38,600::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:32:38,600::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ee95d882-9aa3-424f-b007-5042f0f6d583`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:32:38,600::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:32:38,600::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:32:38,601::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ee95d882-9aa3-424f-b007-5042f0f6d583`::Granted request >Thread-34::DEBUG::2014-07-24 11:32:38,602::task::827::TaskManager.Task::(resourceAcquired) Task=`d3c26330-a932-45d0-915f-8190b0cf1b5c`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:32:38,602::task::990::TaskManager.Task::(_decref) Task=`d3c26330-a932-45d0-915f-8190b0cf1b5c`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:32:38,603::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:32:38,603::task::1185::TaskManager.Task::(prepare) Task=`d3c26330-a932-45d0-915f-8190b0cf1b5c`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:32:38,603::task::595::TaskManager.Task::(_updateState) Task=`d3c26330-a932-45d0-915f-8190b0cf1b5c`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:32:38,603::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:32:38,603::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:32:38,604::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:32:38,604::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:32:38,604::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:32:38,604::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:32:38,604::task::990::TaskManager.Task::(_decref) Task=`d3c26330-a932-45d0-915f-8190b0cf1b5c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:32:39,868::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:32:39,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0608701 s, 16.8 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:32:40,047::task::595::TaskManager.Task::(_updateState) Task=`a31de22d-7799-4570-a770-8baa93667144`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:32:40,048::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:32:40,048::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000722854', 'lastCheck': '2.1', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:32:40,048::task::1185::TaskManager.Task::(prepare) Task=`a31de22d-7799-4570-a770-8baa93667144`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000722854', 'lastCheck': '2.1', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:32:40,048::task::595::TaskManager.Task::(_updateState) Task=`a31de22d-7799-4570-a770-8baa93667144`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:32:40,048::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:32:40,049::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:32:40,049::task::990::TaskManager.Task::(_decref) Task=`a31de22d-7799-4570-a770-8baa93667144`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:32:41,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:32:42,059::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330828 s, 31.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:32:44,071::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:32:44,151::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373942 s, 27.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:32:46,164::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:32:46,242::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357708 s, 28.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:32:47,960::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:32:47,972::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000653533 s, 6.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:32:48,254::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:32:48,611::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.315595 s, 3.2 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:32:48,659::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:32:48,660::task::595::TaskManager.Task::(_updateState) Task=`7c1a41ca-518a-4463-90ac-21bb9d3d03fa`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:32:48,660::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:32:48,661::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:32:48,661::task::1185::TaskManager.Task::(prepare) Task=`7c1a41ca-518a-4463-90ac-21bb9d3d03fa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:32:48,661::task::595::TaskManager.Task::(_updateState) Task=`7c1a41ca-518a-4463-90ac-21bb9d3d03fa`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:32:48,661::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:32:48,661::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:32:48,662::task::990::TaskManager.Task::(_decref) Task=`7c1a41ca-518a-4463-90ac-21bb9d3d03fa`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:32:48,693::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:32:48,693::task::595::TaskManager.Task::(_updateState) Task=`d339df68-859f-4043-96d4-32c7874e8a11`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:32:48,694::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:32:48,694::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`8eb50ffc-9d26-4950-869e-056027e69f46`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:32:48,694::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:32:48,695::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:32:48,695::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`8eb50ffc-9d26-4950-869e-056027e69f46`::Granted request >Thread-34::DEBUG::2014-07-24 11:32:48,695::task::827::TaskManager.Task::(resourceAcquired) Task=`d339df68-859f-4043-96d4-32c7874e8a11`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:32:48,695::task::990::TaskManager.Task::(_decref) Task=`d339df68-859f-4043-96d4-32c7874e8a11`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:32:48,696::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:32:48,696::task::1185::TaskManager.Task::(prepare) Task=`d339df68-859f-4043-96d4-32c7874e8a11`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:32:48,696::task::595::TaskManager.Task::(_updateState) Task=`d339df68-859f-4043-96d4-32c7874e8a11`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:32:48,696::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:32:48,697::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:32:48,697::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:32:48,697::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:32:48,697::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:32:48,697::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:32:48,698::task::990::TaskManager.Task::(_decref) Task=`d339df68-859f-4043-96d4-32c7874e8a11`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:32:50,624::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:32:50,699::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331858 s, 30.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:32:52,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:32:52,786::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331772 s, 30.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:32:54,799::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:32:54,874::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332615 s, 30.8 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:32:55,439::task::595::TaskManager.Task::(_updateState) Task=`bd404c99-f0a9-44be-a01a-c5517c8e3537`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:32:55,439::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:32:55,439::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000653533', 'lastCheck': '7.5', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:32:55,440::task::1185::TaskManager.Task::(prepare) Task=`bd404c99-f0a9-44be-a01a-c5517c8e3537`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000653533', 'lastCheck': '7.5', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:32:55,440::task::595::TaskManager.Task::(_updateState) Task=`bd404c99-f0a9-44be-a01a-c5517c8e3537`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:32:55,440::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:32:55,440::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:32:55,440::task::990::TaskManager.Task::(_decref) Task=`bd404c99-f0a9-44be-a01a-c5517c8e3537`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:32:56,887::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:32:56,962::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329369 s, 31.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:32:57,979::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:32:57,996::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000709146 s, 5.8 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:32:58,754::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:32:58,755::task::595::TaskManager.Task::(_updateState) Task=`1c9127fe-06ec-418d-b771-f920ade73623`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:32:58,755::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:32:58,756::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:32:58,757::task::1185::TaskManager.Task::(prepare) Task=`1c9127fe-06ec-418d-b771-f920ade73623`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:32:58,757::task::595::TaskManager.Task::(_updateState) Task=`1c9127fe-06ec-418d-b771-f920ade73623`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:32:58,758::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:32:58,758::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:32:58,758::task::990::TaskManager.Task::(_decref) Task=`1c9127fe-06ec-418d-b771-f920ade73623`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:32:58,797::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:32:58,798::task::595::TaskManager.Task::(_updateState) Task=`b0deccd7-b647-44f2-a002-e4e6ebbe0a95`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:32:58,798::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:32:58,798::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ab196f41-0847-4818-a539-cae4a716c999`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:32:58,798::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:32:58,799::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:32:58,799::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ab196f41-0847-4818-a539-cae4a716c999`::Granted request >Thread-34::DEBUG::2014-07-24 11:32:58,799::task::827::TaskManager.Task::(resourceAcquired) Task=`b0deccd7-b647-44f2-a002-e4e6ebbe0a95`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:32:58,799::task::990::TaskManager.Task::(_decref) Task=`b0deccd7-b647-44f2-a002-e4e6ebbe0a95`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:32:58,800::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:32:58,800::task::1185::TaskManager.Task::(prepare) Task=`b0deccd7-b647-44f2-a002-e4e6ebbe0a95`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:32:58,800::task::595::TaskManager.Task::(_updateState) Task=`b0deccd7-b647-44f2-a002-e4e6ebbe0a95`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:32:58,801::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:32:58,801::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:32:58,801::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:32:58,801::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:32:58,801::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:32:58,802::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:32:58,802::task::990::TaskManager.Task::(_decref) Task=`b0deccd7-b647-44f2-a002-e4e6ebbe0a95`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:32:58,974::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:32:59,049::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331165 s, 30.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:33:00,457::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:33:01,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:33:01,138::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331764 s, 30.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:33:03,150::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:33:03,226::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332065 s, 30.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:33:05,238::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:33:05,319::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0393082 s, 26.1 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:33:05,862::task::595::TaskManager.Task::(_updateState) Task=`73874511-8080-4fae-a6a2-646092e831f6`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:33:05,862::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:33:05,863::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:33:05,863::task::1185::TaskManager.Task::(prepare) Task=`73874511-8080-4fae-a6a2-646092e831f6`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:33:05,863::task::595::TaskManager.Task::(_updateState) Task=`73874511-8080-4fae-a6a2-646092e831f6`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:33:05,863::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:33:05,863::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:33:05,863::task::990::TaskManager.Task::(_decref) Task=`73874511-8080-4fae-a6a2-646092e831f6`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:33:07,332::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:33:07,408::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332332 s, 30.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:33:08,008::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:33:08,020::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000670772 s, 6.1 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:33:08,866::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:33:08,867::task::595::TaskManager.Task::(_updateState) Task=`4fb2e516-fbee-4fc6-8a79-3a23e7742f0b`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:33:08,867::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:33:08,867::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:33:08,868::task::1185::TaskManager.Task::(prepare) Task=`4fb2e516-fbee-4fc6-8a79-3a23e7742f0b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:33:08,868::task::595::TaskManager.Task::(_updateState) Task=`4fb2e516-fbee-4fc6-8a79-3a23e7742f0b`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:33:08,868::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:33:08,868::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:33:08,868::task::990::TaskManager.Task::(_decref) Task=`4fb2e516-fbee-4fc6-8a79-3a23e7742f0b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:33:08,899::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:33:08,899::task::595::TaskManager.Task::(_updateState) Task=`58e6b4ee-23d3-44e1-b1ba-a8ec27c31473`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:33:08,900::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:33:08,900::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`0c5555c0-248b-424b-96db-462265f26d67`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:33:08,900::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:33:08,900::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:33:08,901::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`0c5555c0-248b-424b-96db-462265f26d67`::Granted request >Thread-34::DEBUG::2014-07-24 11:33:08,901::task::827::TaskManager.Task::(resourceAcquired) Task=`58e6b4ee-23d3-44e1-b1ba-a8ec27c31473`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:33:08,901::task::990::TaskManager.Task::(_decref) Task=`58e6b4ee-23d3-44e1-b1ba-a8ec27c31473`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:33:08,902::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:33:08,902::task::1185::TaskManager.Task::(prepare) Task=`58e6b4ee-23d3-44e1-b1ba-a8ec27c31473`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:33:08,902::task::595::TaskManager.Task::(_updateState) Task=`58e6b4ee-23d3-44e1-b1ba-a8ec27c31473`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:33:08,902::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:33:08,903::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:33:08,903::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:33:08,903::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:33:08,903::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:33:08,903::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:33:08,904::task::990::TaskManager.Task::(_decref) Task=`58e6b4ee-23d3-44e1-b1ba-a8ec27c31473`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:33:09,421::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:33:09,498::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034493 s, 29.7 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:33:10,853::task::595::TaskManager.Task::(_updateState) Task=`66dfbe63-1428-4fbf-a7b1-86e8e25bc3ee`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:33:10,854::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:33:10,854::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000670772', 'lastCheck': '2.8', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:33:10,854::task::1185::TaskManager.Task::(prepare) Task=`66dfbe63-1428-4fbf-a7b1-86e8e25bc3ee`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000670772', 'lastCheck': '2.8', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:33:10,855::task::595::TaskManager.Task::(_updateState) Task=`66dfbe63-1428-4fbf-a7b1-86e8e25bc3ee`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:33:10,855::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:33:10,856::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:33:10,856::task::990::TaskManager.Task::(_decref) Task=`66dfbe63-1428-4fbf-a7b1-86e8e25bc3ee`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:33:11,512::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:33:11,592::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361458 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:33:13,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:33:13,680::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335 s, 30.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:33:15,693::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:33:15,775::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0392403 s, 26.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:33:17,788::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:33:17,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331692 s, 30.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:33:18,024::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:33:18,035::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000712873 s, 5.7 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:33:18,980::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:33:18,996::task::595::TaskManager.Task::(_updateState) Task=`a92202cb-ed1f-456d-9903-50d65347b39e`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:33:18,997::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:33:18,997::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:33:18,997::task::1185::TaskManager.Task::(prepare) Task=`a92202cb-ed1f-456d-9903-50d65347b39e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:33:18,997::task::595::TaskManager.Task::(_updateState) Task=`a92202cb-ed1f-456d-9903-50d65347b39e`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:33:18,997::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:33:18,997::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:33:18,998::task::990::TaskManager.Task::(_decref) Task=`a92202cb-ed1f-456d-9903-50d65347b39e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:33:19,036::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:33:19,036::task::595::TaskManager.Task::(_updateState) Task=`b673cae4-1a6a-4478-9f0e-466691dac8e2`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:33:19,036::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:33:19,037::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c375c39e-16d0-4655-978f-a63305e869ee`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:33:19,037::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:33:19,037::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:33:19,037::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c375c39e-16d0-4655-978f-a63305e869ee`::Granted request >Thread-34::DEBUG::2014-07-24 11:33:19,038::task::827::TaskManager.Task::(resourceAcquired) Task=`b673cae4-1a6a-4478-9f0e-466691dac8e2`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:33:19,038::task::990::TaskManager.Task::(_decref) Task=`b673cae4-1a6a-4478-9f0e-466691dac8e2`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:33:19,038::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:33:19,039::task::1185::TaskManager.Task::(prepare) Task=`b673cae4-1a6a-4478-9f0e-466691dac8e2`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:33:19,039::task::595::TaskManager.Task::(_updateState) Task=`b673cae4-1a6a-4478-9f0e-466691dac8e2`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:33:19,039::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:33:19,039::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:33:19,039::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:33:19,040::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:33:19,040::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:33:19,040::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:33:19,040::task::990::TaskManager.Task::(_decref) Task=`b673cae4-1a6a-4478-9f0e-466691dac8e2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:33:19,875::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:33:19,955::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351827 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:33:21,968::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:33:22,046::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034212 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:33:24,058::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:33:24,152::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0511216 s, 20.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:33:26,165::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-13::DEBUG::2014-07-24 11:33:26,241::task::595::TaskManager.Task::(_updateState) Task=`ccbbc589-2e1a-42c2-8933-76f15202f002`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:33:26,243::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:33:26,245::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000712873', 'lastCheck': '8.2', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:33:26,247::task::1185::TaskManager.Task::(prepare) Task=`ccbbc589-2e1a-42c2-8933-76f15202f002`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000712873', 'lastCheck': '8.2', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:33:26,249::task::595::TaskManager.Task::(_updateState) Task=`ccbbc589-2e1a-42c2-8933-76f15202f002`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:33:26,250::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:33:26,251::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:33:26,253::task::990::TaskManager.Task::(_decref) Task=`ccbbc589-2e1a-42c2-8933-76f15202f002`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:33:26,285::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337025 s, 30.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:33:28,041::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:33:28,070::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0171809 s, 238 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:33:28,297::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:33:28,379::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368017 s, 27.8 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:33:29,103::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:33:29,115::task::595::TaskManager.Task::(_updateState) Task=`7e7c8c4f-c9b9-49f9-9ad5-6dc5ad7728c4`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:33:29,115::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:33:29,116::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:33:29,116::task::1185::TaskManager.Task::(prepare) Task=`7e7c8c4f-c9b9-49f9-9ad5-6dc5ad7728c4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:33:29,116::task::595::TaskManager.Task::(_updateState) Task=`7e7c8c4f-c9b9-49f9-9ad5-6dc5ad7728c4`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:33:29,116::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:33:29,116::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:33:29,117::task::990::TaskManager.Task::(_decref) Task=`7e7c8c4f-c9b9-49f9-9ad5-6dc5ad7728c4`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:33:29,146::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:33:29,147::task::595::TaskManager.Task::(_updateState) Task=`49f45cb0-ab7e-4625-9df5-0969e37af1d6`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:33:29,147::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:33:29,147::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e725e139-413c-49e5-9a41-7123850aa496`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:33:29,148::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:33:29,148::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:33:29,148::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e725e139-413c-49e5-9a41-7123850aa496`::Granted request >Thread-34::DEBUG::2014-07-24 11:33:29,148::task::827::TaskManager.Task::(resourceAcquired) Task=`49f45cb0-ab7e-4625-9df5-0969e37af1d6`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:33:29,149::task::990::TaskManager.Task::(_decref) Task=`49f45cb0-ab7e-4625-9df5-0969e37af1d6`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:33:29,149::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:33:29,149::task::1185::TaskManager.Task::(prepare) Task=`49f45cb0-ab7e-4625-9df5-0969e37af1d6`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:33:29,150::task::595::TaskManager.Task::(_updateState) Task=`49f45cb0-ab7e-4625-9df5-0969e37af1d6`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:33:29,150::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:33:29,150::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:33:29,150::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:33:29,150::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:33:29,151::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:33:29,151::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:33:29,151::task::990::TaskManager.Task::(_decref) Task=`49f45cb0-ab7e-4625-9df5-0969e37af1d6`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:33:30,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:33:30,471::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035868 s, 28.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:33:30,491::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:33:32,483::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:33:32,567::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343066 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:33:34,579::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:33:34,656::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335725 s, 30.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:33:36,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:33:36,745::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033357 s, 30.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:33:38,075::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:33:38,086::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0006788 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:33:38,757::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:33:38,831::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332564 s, 30.8 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:33:39,220::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:33:39,221::task::595::TaskManager.Task::(_updateState) Task=`9dee6493-13fb-47da-87da-a7636d976d57`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:33:39,221::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:33:39,222::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:33:39,222::task::1185::TaskManager.Task::(prepare) Task=`9dee6493-13fb-47da-87da-a7636d976d57`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:33:39,222::task::595::TaskManager.Task::(_updateState) Task=`9dee6493-13fb-47da-87da-a7636d976d57`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:33:39,222::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:33:39,222::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:33:39,222::task::990::TaskManager.Task::(_decref) Task=`9dee6493-13fb-47da-87da-a7636d976d57`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:33:39,257::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:33:39,257::task::595::TaskManager.Task::(_updateState) Task=`990bd75d-b500-46ff-bbed-666b15f9fc38`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:33:39,258::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:33:39,258::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`0ed523de-2aae-4d2d-8ed2-502e34dfe533`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:33:39,258::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:33:39,258::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:33:39,259::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`0ed523de-2aae-4d2d-8ed2-502e34dfe533`::Granted request >Thread-34::DEBUG::2014-07-24 11:33:39,259::task::827::TaskManager.Task::(resourceAcquired) Task=`990bd75d-b500-46ff-bbed-666b15f9fc38`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:33:39,259::task::990::TaskManager.Task::(_decref) Task=`990bd75d-b500-46ff-bbed-666b15f9fc38`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:33:39,260::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:33:39,260::task::1185::TaskManager.Task::(prepare) Task=`990bd75d-b500-46ff-bbed-666b15f9fc38`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:33:39,260::task::595::TaskManager.Task::(_updateState) Task=`990bd75d-b500-46ff-bbed-666b15f9fc38`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:33:39,260::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:33:39,260::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:33:39,261::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:33:39,261::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:33:39,261::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:33:39,261::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:33:39,261::task::990::TaskManager.Task::(_decref) Task=`990bd75d-b500-46ff-bbed-666b15f9fc38`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:33:40,844::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:33:40,920::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335284 s, 30.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:33:41,666::task::595::TaskManager.Task::(_updateState) Task=`e6f06ca0-94a1-4b25-920d-1f57d154120e`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:33:41,667::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:33:41,667::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0006788', 'lastCheck': '3.6', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:33:41,667::task::1185::TaskManager.Task::(prepare) Task=`e6f06ca0-94a1-4b25-920d-1f57d154120e`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0006788', 'lastCheck': '3.6', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:33:41,667::task::595::TaskManager.Task::(_updateState) Task=`e6f06ca0-94a1-4b25-920d-1f57d154120e`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:33:41,667::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:33:41,668::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:33:41,668::task::990::TaskManager.Task::(_decref) Task=`e6f06ca0-94a1-4b25-920d-1f57d154120e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:33:42,934::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:33:43,009::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330289 s, 31.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:33:45,022::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:33:45,102::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364175 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:33:47,114::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:33:47,190::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336592 s, 30.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:33:48,090::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:33:48,102::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00068704 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:33:49,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:33:49,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329862 s, 31.0 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:33:49,321::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:33:49,322::task::595::TaskManager.Task::(_updateState) Task=`24dd4f92-5157-4e4e-828b-098bd69348ef`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:33:49,322::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:33:49,322::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:33:49,322::task::1185::TaskManager.Task::(prepare) Task=`24dd4f92-5157-4e4e-828b-098bd69348ef`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:33:49,323::task::595::TaskManager.Task::(_updateState) Task=`24dd4f92-5157-4e4e-828b-098bd69348ef`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:33:49,323::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:33:49,323::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:33:49,323::task::990::TaskManager.Task::(_decref) Task=`24dd4f92-5157-4e4e-828b-098bd69348ef`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:33:49,366::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:33:49,366::task::595::TaskManager.Task::(_updateState) Task=`66797cfc-f0fb-4043-afae-1bd203380831`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:33:49,367::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:33:49,367::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d5bb223d-f373-4595-9883-e1aacebf10de`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:33:49,367::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:33:49,369::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:33:49,369::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d5bb223d-f373-4595-9883-e1aacebf10de`::Granted request >Thread-34::DEBUG::2014-07-24 11:33:49,369::task::827::TaskManager.Task::(resourceAcquired) Task=`66797cfc-f0fb-4043-afae-1bd203380831`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:33:49,369::task::990::TaskManager.Task::(_decref) Task=`66797cfc-f0fb-4043-afae-1bd203380831`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:33:49,370::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:33:49,370::task::1185::TaskManager.Task::(prepare) Task=`66797cfc-f0fb-4043-afae-1bd203380831`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:33:49,371::task::595::TaskManager.Task::(_updateState) Task=`66797cfc-f0fb-4043-afae-1bd203380831`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:33:49,371::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:33:49,371::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:33:49,371::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:33:49,371::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:33:49,371::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:33:49,372::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:33:49,372::task::990::TaskManager.Task::(_decref) Task=`66797cfc-f0fb-4043-afae-1bd203380831`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:33:51,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:33:51,367::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349645 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:33:53,380::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:33:53,458::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345543 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:33:55,470::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:33:55,549::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363541 s, 28.2 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:33:57,084::task::595::TaskManager.Task::(_updateState) Task=`63ad7f46-8565-43ed-9af8-810fae14f710`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:33:57,084::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:33:57,085::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00068704', 'lastCheck': '9.0', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:33:57,085::task::1185::TaskManager.Task::(prepare) Task=`63ad7f46-8565-43ed-9af8-810fae14f710`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00068704', 'lastCheck': '9.0', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:33:57,085::task::595::TaskManager.Task::(_updateState) Task=`63ad7f46-8565-43ed-9af8-810fae14f710`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:33:57,085::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:33:57,085::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:33:57,086::task::990::TaskManager.Task::(_decref) Task=`63ad7f46-8565-43ed-9af8-810fae14f710`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:33:57,561::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:33:57,637::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331578 s, 30.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:33:58,106::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:33:58,118::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000725934 s, 5.6 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:33:59,452::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:33:59,453::task::595::TaskManager.Task::(_updateState) Task=`9916e2cc-bdb0-4ef3-bb3a-1d3a804b9ef9`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:33:59,453::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:33:59,454::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:33:59,454::task::1185::TaskManager.Task::(prepare) Task=`9916e2cc-bdb0-4ef3-bb3a-1d3a804b9ef9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:33:59,454::task::595::TaskManager.Task::(_updateState) Task=`9916e2cc-bdb0-4ef3-bb3a-1d3a804b9ef9`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:33:59,454::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:33:59,454::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:33:59,454::task::990::TaskManager.Task::(_decref) Task=`9916e2cc-bdb0-4ef3-bb3a-1d3a804b9ef9`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:33:59,489::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:33:59,489::task::595::TaskManager.Task::(_updateState) Task=`9a012a18-f071-476f-b0a9-400abab365d2`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:33:59,489::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:33:59,490::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b145503f-eeaa-4711-89ec-4b4b588e711a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:33:59,490::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:33:59,490::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:33:59,490::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b145503f-eeaa-4711-89ec-4b4b588e711a`::Granted request >Thread-34::DEBUG::2014-07-24 11:33:59,491::task::827::TaskManager.Task::(resourceAcquired) Task=`9a012a18-f071-476f-b0a9-400abab365d2`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:33:59,491::task::990::TaskManager.Task::(_decref) Task=`9a012a18-f071-476f-b0a9-400abab365d2`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:33:59,492::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:33:59,492::task::1185::TaskManager.Task::(prepare) Task=`9a012a18-f071-476f-b0a9-400abab365d2`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:33:59,492::task::595::TaskManager.Task::(_updateState) Task=`9a012a18-f071-476f-b0a9-400abab365d2`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:33:59,492::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:33:59,492::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:33:59,492::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:33:59,493::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:33:59,493::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:33:59,493::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:33:59,493::task::990::TaskManager.Task::(_decref) Task=`9a012a18-f071-476f-b0a9-400abab365d2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:33:59,650::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:33:59,812::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.118719 s, 8.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:34:00,525::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:34:01,824::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:34:01,904::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361373 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:34:03,917::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:34:04,000::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336873 s, 30.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:34:06,013::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-37::DEBUG::2014-07-24 11:34:06,023::task::595::TaskManager.Task::(_updateState) Task=`d6330b10-1e82-4fc6-91c5-699af214c0bf`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:34:06,024::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:34:06,024::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:34:06,024::task::1185::TaskManager.Task::(prepare) Task=`d6330b10-1e82-4fc6-91c5-699af214c0bf`::finished: {'truesize': '3221225472', 'apparentsize': '3221225472'} >Thread-37::DEBUG::2014-07-24 11:34:06,025::task::595::TaskManager.Task::(_updateState) Task=`d6330b10-1e82-4fc6-91c5-699af214c0bf`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:34:06,025::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:34:06,025::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:34:06,025::task::990::TaskManager.Task::(_decref) Task=`d6330b10-1e82-4fc6-91c5-699af214c0bf`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:34:06,092::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363087 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:34:08,105::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-24 11:34:08,125::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:34:08,139::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000631721 s, 6.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:34:08,204::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0578582 s, 17.7 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:34:09,561::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:34:09,561::task::595::TaskManager.Task::(_updateState) Task=`cf3fb641-2e88-421c-b431-60fc6047e78d`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:34:09,561::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:34:09,562::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:34:09,562::task::1185::TaskManager.Task::(prepare) Task=`cf3fb641-2e88-421c-b431-60fc6047e78d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:34:09,562::task::595::TaskManager.Task::(_updateState) Task=`cf3fb641-2e88-421c-b431-60fc6047e78d`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:34:09,562::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:34:09,562::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:34:09,563::task::990::TaskManager.Task::(_decref) Task=`cf3fb641-2e88-421c-b431-60fc6047e78d`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:34:09,594::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:34:09,594::task::595::TaskManager.Task::(_updateState) Task=`3916f260-4377-4773-8e64-4845e22308c7`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:34:09,594::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:34:09,595::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`eb0e714d-3117-43b2-b9d8-4f056475b929`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:34:09,595::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:34:09,595::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:34:09,596::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`eb0e714d-3117-43b2-b9d8-4f056475b929`::Granted request >Thread-34::DEBUG::2014-07-24 11:34:09,596::task::827::TaskManager.Task::(resourceAcquired) Task=`3916f260-4377-4773-8e64-4845e22308c7`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:34:09,596::task::990::TaskManager.Task::(_decref) Task=`3916f260-4377-4773-8e64-4845e22308c7`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:34:09,597::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:34:09,597::task::1185::TaskManager.Task::(prepare) Task=`3916f260-4377-4773-8e64-4845e22308c7`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:34:09,597::task::595::TaskManager.Task::(_updateState) Task=`3916f260-4377-4773-8e64-4845e22308c7`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:34:09,597::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:34:09,597::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:34:09,598::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:34:09,598::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:34:09,598::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:34:09,598::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:34:09,598::task::990::TaskManager.Task::(_decref) Task=`3916f260-4377-4773-8e64-4845e22308c7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:34:10,217::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:34:10,313::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0410125 s, 25.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:34:12,330::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:34:12,406::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334244 s, 30.6 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:34:12,459::task::595::TaskManager.Task::(_updateState) Task=`5dbb5ab9-2369-43d7-abbc-6327bd7cd38d`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:34:12,460::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:34:12,460::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631721', 'lastCheck': '4.3', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:34:12,460::task::1185::TaskManager.Task::(prepare) Task=`5dbb5ab9-2369-43d7-abbc-6327bd7cd38d`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631721', 'lastCheck': '4.3', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:34:12,460::task::595::TaskManager.Task::(_updateState) Task=`5dbb5ab9-2369-43d7-abbc-6327bd7cd38d`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:34:12,460::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:34:12,461::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:34:12,461::task::990::TaskManager.Task::(_decref) Task=`5dbb5ab9-2369-43d7-abbc-6327bd7cd38d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:34:14,418::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:34:14,495::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346694 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:34:16,506::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:34:16,583::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347833 s, 29.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:34:18,154::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:34:18,165::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000600164 s, 6.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:34:18,596::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:34:18,671::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332656 s, 30.8 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:34:19,655::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:34:19,656::task::595::TaskManager.Task::(_updateState) Task=`32958261-561f-40cc-9258-8ea1413f8ee8`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:34:19,656::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:34:19,657::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:34:19,657::task::1185::TaskManager.Task::(prepare) Task=`32958261-561f-40cc-9258-8ea1413f8ee8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:34:19,658::task::595::TaskManager.Task::(_updateState) Task=`32958261-561f-40cc-9258-8ea1413f8ee8`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:34:19,658::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:34:19,658::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:34:19,658::task::990::TaskManager.Task::(_decref) Task=`32958261-561f-40cc-9258-8ea1413f8ee8`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:34:19,696::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:34:19,697::task::595::TaskManager.Task::(_updateState) Task=`a772f8ab-d876-4d0c-bebd-49c6ea9e43f2`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:34:19,697::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:34:19,697::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1c8712c7-4635-4cde-91d4-327472258cf3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:34:19,697::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:34:19,698::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:34:19,698::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1c8712c7-4635-4cde-91d4-327472258cf3`::Granted request >Thread-34::DEBUG::2014-07-24 11:34:19,698::task::827::TaskManager.Task::(resourceAcquired) Task=`a772f8ab-d876-4d0c-bebd-49c6ea9e43f2`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:34:19,698::task::990::TaskManager.Task::(_decref) Task=`a772f8ab-d876-4d0c-bebd-49c6ea9e43f2`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:34:19,699::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:34:19,699::task::1185::TaskManager.Task::(prepare) Task=`a772f8ab-d876-4d0c-bebd-49c6ea9e43f2`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '35165044736', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:34:19,699::task::595::TaskManager.Task::(_updateState) Task=`a772f8ab-d876-4d0c-bebd-49c6ea9e43f2`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:34:19,700::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:34:19,700::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:34:19,700::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:34:19,700::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:34:19,700::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:34:19,701::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:34:19,701::task::990::TaskManager.Task::(_decref) Task=`a772f8ab-d876-4d0c-bebd-49c6ea9e43f2`::ref 0 aborting False >Thread-37::INFO::2014-07-24 11:34:20,075::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 3221225472, capacity: 10737418240, allocated: 2740583936, physical: 3221225472) >Thread-37::DEBUG::2014-07-24 11:34:20,076::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 4096, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:34:20,076::task::595::TaskManager.Task::(_updateState) Task=`e8fbbb06-55a4-4573-91e5-3e5e606f5b2f`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:34:20,076::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 4096, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=4294967296, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:34:20,076::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:34:20,077::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-27::DEBUG::2014-07-24 11:34:20,077::storage_mailbox::426::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - start: 64, end: 128, len: 4096, message(1/63): '1xtnd\x8fE\x83\x19\xaa\x18\xaa\xa4\x82H\xc3\xed\x06\x06\xaa#\xe2\x9b\xed\xae\xc5bR\xb3\x85K\x9f\xe2\xee\xa0\x8c\xe1000000000000100000000000000' >Thread-37::DEBUG::2014-07-24 11:34:20,078::task::1185::TaskManager.Task::(prepare) Task=`e8fbbb06-55a4-4573-91e5-3e5e606f5b2f`::finished: None >Thread-37::DEBUG::2014-07-24 11:34:20,079::task::595::TaskManager.Task::(_updateState) Task=`e8fbbb06-55a4-4573-91e5-3e5e606f5b2f`::moving from state preparing -> state finished >Thread-27::DEBUG::2014-07-24 11:34:20,080::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-37::DEBUG::2014-07-24 11:34:20,089::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:34:20,090::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:34:20,090::task::990::TaskManager.Task::(_decref) Task=`e8fbbb06-55a4-4573-91e5-3e5e606f5b2f`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:34:20,352::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.260925 s, 15.7 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:34:20,353::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:34:20,353::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:34:20,368::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0047163 s, 868 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:34:20,683::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:34:20,762::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348385 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:34:20,762::storage_mailbox::658::Storage.MailBox.SpmMailMonitor::(_handleRequests) SPM_MailMonitor: Mailbox 1 validated, checking mail >Dummy-33::DEBUG::2014-07-24 11:34:20,763::storage_mailbox::698::Storage.MailBox.SpmMailMonitor::(_handleRequests) SPM_MailMonitor: processing request: '1xtnd\x8fE\x83\x19\xaa\x18\xaa\xa4\x82H\xc3\xed\x06\x06\xaa#\xe2\x9b\xed\xae\xc5bR\xb3\x85K\x9f\xe2\xee\xa0\x8c\xe1000000000000100000000000000' >c3d99393-cc31-4edb-a221-b44cb2c12e0e::DEBUG::2014-07-24 11:34:20,764::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >5425e4e2-1762-4684-95bb-ec8949ce3438::DEBUG::2014-07-24 11:34:20,766::threadPool::200::Misc.ThreadPool.WorkerThread::(_processNextTask) Task: 5425e4e2-1762-4684-95bb-ec8949ce3438 running: <function runTask at 0x149a500> with: (<functools.partial object at 0x15de890>, 65, '1xtnd\x8fE\x83\x19\xaa\x18\xaa\xa4\x82H\xc3\xed\x06\x06\xaa#\xe2\x9b\xed\xae\xc5bR\xb3\x85K\x9f\xe2\xee\xa0\x8c\xe1000000000000100000000000000') >5425e4e2-1762-4684-95bb-ec8949ce3438::DEBUG::2014-07-24 11:34:20,769::task::595::TaskManager.Task::(_updateState) Task=`0c659db0-9c03-4568-a42a-1f07ba378fb8`::moving from state init -> state preparing >5425e4e2-1762-4684-95bb-ec8949ce3438::DEBUG::2014-07-24 11:34:20,771::storage_mailbox::146::Storage.SPM.Messages.Extend::(processRequest) processRequest, payload:'1xtnd\x8fE\x83\x19\xaa\x18\xaa\xa4\x82H\xc3\xed\x06\x06\xaa#\xe2\x9b\xed\xae\xc5bR\xb3\x85K\x9f\xe2\xee\xa0\x8c\xe1000000000000100000000000000' >5425e4e2-1762-4684-95bb-ec8949ce3438::INFO::2014-07-24 11:34:20,772::storage_mailbox::161::Storage.SPM.Messages.Extend::(processRequest) processRequest: extending volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 in domain 23aa0606-edc3-4882-a4aa-18aa1983458f (pool 637ea13c-81a8-4b44-8cab-961458b01883) to size 4096 >5425e4e2-1762-4684-95bb-ec8949ce3438::DEBUG::2014-07-24 11:34:20,779::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvextend --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --size 4096m 23aa0606-edc3-4882-a4aa-18aa1983458f/e18ca0ee-e29f-4b85-b352-62c5aeed9be2' (cwd None) >5425e4e2-1762-4684-95bb-ec8949ce3438::DEBUG::2014-07-24 11:34:21,439::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >5425e4e2-1762-4684-95bb-ec8949ce3438::DEBUG::2014-07-24 11:34:21,441::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >5425e4e2-1762-4684-95bb-ec8949ce3438::DEBUG::2014-07-24 11:34:21,441::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >5425e4e2-1762-4684-95bb-ec8949ce3438::DEBUG::2014-07-24 11:34:21,441::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >5425e4e2-1762-4684-95bb-ec8949ce3438::DEBUG::2014-07-24 11:34:21,442::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >5425e4e2-1762-4684-95bb-ec8949ce3438::DEBUG::2014-07-24 11:34:21,442::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >5425e4e2-1762-4684-95bb-ec8949ce3438::DEBUG::2014-07-24 11:34:21,443::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) 'dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox oflag=direct iflag=fullblock conv=notrunc count=1 bs=4096 seek=1' (cwd None) >5425e4e2-1762-4684-95bb-ec8949ce3438::DEBUG::2014-07-24 11:34:21,455::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000830933 s, 4.9 MB/s\n'; <rc> = 0 >5425e4e2-1762-4684-95bb-ec8949ce3438::DEBUG::2014-07-24 11:34:21,456::task::1185::TaskManager.Task::(prepare) Task=`0c659db0-9c03-4568-a42a-1f07ba378fb8`::finished: {'status': {'message': 'Done', 'code': 0}} >5425e4e2-1762-4684-95bb-ec8949ce3438::DEBUG::2014-07-24 11:34:21,456::task::595::TaskManager.Task::(_updateState) Task=`0c659db0-9c03-4568-a42a-1f07ba378fb8`::moving from state preparing -> state finished >5425e4e2-1762-4684-95bb-ec8949ce3438::DEBUG::2014-07-24 11:34:21,456::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >5425e4e2-1762-4684-95bb-ec8949ce3438::DEBUG::2014-07-24 11:34:21,456::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >5425e4e2-1762-4684-95bb-ec8949ce3438::DEBUG::2014-07-24 11:34:21,456::task::990::TaskManager.Task::(_decref) Task=`0c659db0-9c03-4568-a42a-1f07ba378fb8`::ref 0 aborting False >5425e4e2-1762-4684-95bb-ec8949ce3438::DEBUG::2014-07-24 11:34:21,457::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-27::DEBUG::2014-07-24 11:34:22,371::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:34:22,742::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.360065 s, 11.4 kB/s\n'; <rc> = 0 >Thread-27::DEBUG::2014-07-24 11:34:22,743::storage_mailbox::342::Storage.MailBox.HsmMailMonitor::(_handleResponses) HSM_MailboxMonitor(1/63) - Checking reply: '1xtnd\x8fE\x83\x19\xaa\x18\xaa\xa4\x82H\xc3\xed\x06\x06\xaa#\xe2\x9b\xed\xae\xc5bR\xb3\x85K\x9f\xe2\xee\xa0\x8c\xe1000000000000100000000000000' >Thread-27::INFO::2014-07-24 11:34:22,743::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >4fa79bbd-a95b-45c4-8b4a-fca5e6f3b743::DEBUG::2014-07-24 11:34:22,743::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >27173d05-f675-4c8b-b75e-0675702f9260::DEBUG::2014-07-24 11:34:22,745::threadPool::200::Misc.ThreadPool.WorkerThread::(_processNextTask) Task: 27173d05-f675-4c8b-b75e-0675702f9260 running: <function runTask at 0x149a500> with: (<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>, {'newSize': 4096, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}) >Thread-27::DEBUG::2014-07-24 11:34:22,746::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >27173d05-f675-4c8b-b75e-0675702f9260::DEBUG::2014-07-24 11:34:22,756::task::595::TaskManager.Task::(_updateState) Task=`362e84e9-75aa-408d-9d1c-8a145dbe263c`::moving from state init -> state preparing >27173d05-f675-4c8b-b75e-0675702f9260::DEBUG::2014-07-24 11:34:22,759::vm::2543::vm.Vm::(__verifyVolumeExtension) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Refreshing drive volume for sda (domainID: 23aa0606-edc3-4882-a4aa-18aa1983458f, volumeID: e18ca0ee-e29f-4b85-b352-62c5aeed9be2) >27173d05-f675-4c8b-b75e-0675702f9260::DEBUG::2014-07-24 11:34:22,760::task::595::TaskManager.Task::(_updateState) Task=`b37c8e48-3098-4ffc-b0a2-e50f1026de46`::moving from state init -> state preparing >27173d05-f675-4c8b-b75e-0675702f9260::INFO::2014-07-24 11:34:22,761::logUtils::44::dispatcher::(wrapper) Run and protect: refreshVolume(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2') >27173d05-f675-4c8b-b75e-0675702f9260::DEBUG::2014-07-24 11:34:22,761::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >27173d05-f675-4c8b-b75e-0675702f9260::DEBUG::2014-07-24 11:34:22,762::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:34:22,801::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:34:22,878::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034738 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:34:22,879::storage_mailbox::658::Storage.MailBox.SpmMailMonitor::(_handleRequests) SPM_MailMonitor: Mailbox 1 validated, checking mail >Dummy-33::DEBUG::2014-07-24 11:34:22,889::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) 'dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox oflag=direct iflag=fullblock conv=notrunc count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:34:22,934::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340379 s, 30.1 MB/s\n'; <rc> = 0 >27173d05-f675-4c8b-b75e-0675702f9260::DEBUG::2014-07-24 11:34:22,981::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >27173d05-f675-4c8b-b75e-0675702f9260::DEBUG::2014-07-24 11:34:22,987::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >27173d05-f675-4c8b-b75e-0675702f9260::DEBUG::2014-07-24 11:34:22,987::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >27173d05-f675-4c8b-b75e-0675702f9260::DEBUG::2014-07-24 11:34:22,988::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --refresh 23aa0606-edc3-4882-a4aa-18aa1983458f/e18ca0ee-e29f-4b85-b352-62c5aeed9be2' (cwd None) >27173d05-f675-4c8b-b75e-0675702f9260::DEBUG::2014-07-24 11:34:23,514::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >27173d05-f675-4c8b-b75e-0675702f9260::DEBUG::2014-07-24 11:34:23,514::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >27173d05-f675-4c8b-b75e-0675702f9260::DEBUG::2014-07-24 11:34:23,514::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >27173d05-f675-4c8b-b75e-0675702f9260::INFO::2014-07-24 11:34:23,515::logUtils::47::dispatcher::(wrapper) Run and protect: refreshVolume, Return response: None >27173d05-f675-4c8b-b75e-0675702f9260::DEBUG::2014-07-24 11:34:23,515::task::1185::TaskManager.Task::(prepare) Task=`b37c8e48-3098-4ffc-b0a2-e50f1026de46`::finished: None >27173d05-f675-4c8b-b75e-0675702f9260::DEBUG::2014-07-24 11:34:23,515::task::595::TaskManager.Task::(_updateState) Task=`b37c8e48-3098-4ffc-b0a2-e50f1026de46`::moving from state preparing -> state finished >27173d05-f675-4c8b-b75e-0675702f9260::DEBUG::2014-07-24 11:34:23,515::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >27173d05-f675-4c8b-b75e-0675702f9260::DEBUG::2014-07-24 11:34:23,515::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >27173d05-f675-4c8b-b75e-0675702f9260::DEBUG::2014-07-24 11:34:23,515::task::990::TaskManager.Task::(_decref) Task=`b37c8e48-3098-4ffc-b0a2-e50f1026de46`::ref 0 aborting False >27173d05-f675-4c8b-b75e-0675702f9260::DEBUG::2014-07-24 11:34:23,516::task::595::TaskManager.Task::(_updateState) Task=`f938cb06-08c6-4e7a-97ae-49087976b775`::moving from state init -> state preparing >27173d05-f675-4c8b-b75e-0675702f9260::INFO::2014-07-24 11:34:23,516::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >27173d05-f675-4c8b-b75e-0675702f9260::INFO::2014-07-24 11:34:23,516::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >27173d05-f675-4c8b-b75e-0675702f9260::DEBUG::2014-07-24 11:34:23,517::task::1185::TaskManager.Task::(prepare) Task=`f938cb06-08c6-4e7a-97ae-49087976b775`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >27173d05-f675-4c8b-b75e-0675702f9260::DEBUG::2014-07-24 11:34:23,517::task::595::TaskManager.Task::(_updateState) Task=`f938cb06-08c6-4e7a-97ae-49087976b775`::moving from state preparing -> state finished >27173d05-f675-4c8b-b75e-0675702f9260::DEBUG::2014-07-24 11:34:23,517::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >27173d05-f675-4c8b-b75e-0675702f9260::DEBUG::2014-07-24 11:34:23,517::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >27173d05-f675-4c8b-b75e-0675702f9260::DEBUG::2014-07-24 11:34:23,517::task::990::TaskManager.Task::(_decref) Task=`f938cb06-08c6-4e7a-97ae-49087976b775`::ref 0 aborting False >27173d05-f675-4c8b-b75e-0675702f9260::DEBUG::2014-07-24 11:34:23,517::vm::2563::vm.Vm::(__verifyVolumeExtension) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Verifying extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2, requested size 4294967296, current size 4294967296 >27173d05-f675-4c8b-b75e-0675702f9260::DEBUG::2014-07-24 11:34:23,544::task::1185::TaskManager.Task::(prepare) Task=`362e84e9-75aa-408d-9d1c-8a145dbe263c`::finished: None >27173d05-f675-4c8b-b75e-0675702f9260::DEBUG::2014-07-24 11:34:23,545::task::595::TaskManager.Task::(_updateState) Task=`362e84e9-75aa-408d-9d1c-8a145dbe263c`::moving from state preparing -> state finished >27173d05-f675-4c8b-b75e-0675702f9260::DEBUG::2014-07-24 11:34:23,545::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >27173d05-f675-4c8b-b75e-0675702f9260::DEBUG::2014-07-24 11:34:23,545::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >27173d05-f675-4c8b-b75e-0675702f9260::DEBUG::2014-07-24 11:34:23,545::task::990::TaskManager.Task::(_decref) Task=`362e84e9-75aa-408d-9d1c-8a145dbe263c`::ref 0 aborting False >27173d05-f675-4c8b-b75e-0675702f9260::DEBUG::2014-07-24 11:34:23,545::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-27::DEBUG::2014-07-24 11:34:23,762::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.0034 s, 4.1 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:34:24,936::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:34:25,030::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0418598 s, 24.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:34:25,030::storage_mailbox::658::Storage.MailBox.SpmMailMonitor::(_handleRequests) SPM_MailMonitor: Mailbox 1 validated, checking mail >Dummy-33::DEBUG::2014-07-24 11:34:25,041::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) 'dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox oflag=direct iflag=fullblock conv=notrunc count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:34:25,141::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0885515 s, 11.6 MB/s\n'; <rc> = 0 >Thread-27::DEBUG::2014-07-24 11:34:25,764::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:34:26,096::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.318911 s, 12.8 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:34:26,096::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:34:26,097::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:34:26,113::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00462887 s, 885 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:34:27,144::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:34:27,223::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340566 s, 30.1 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:34:27,889::task::595::TaskManager.Task::(_updateState) Task=`a35ae573-bf13-4634-8b7d-d834cfdf85c5`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:34:27,889::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:34:27,889::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000600164', 'lastCheck': '9.7', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:34:27,889::task::1185::TaskManager.Task::(prepare) Task=`a35ae573-bf13-4634-8b7d-d834cfdf85c5`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000600164', 'lastCheck': '9.7', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:34:27,890::task::595::TaskManager.Task::(_updateState) Task=`a35ae573-bf13-4634-8b7d-d834cfdf85c5`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:34:27,890::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:34:27,890::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:34:27,890::task::990::TaskManager.Task::(_decref) Task=`a35ae573-bf13-4634-8b7d-d834cfdf85c5`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:34:28,170::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 11:34:28,171::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-18::DEBUG::2014-07-24 11:34:28,346::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:34:28,347::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 11:34:28,348::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:34:28,359::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000568219 s, 7.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:34:29,236::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:34:29,313::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333522 s, 30.7 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:34:29,763::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:34:29,763::task::595::TaskManager.Task::(_updateState) Task=`29e706ed-37b6-4bf5-8c53-7f052152b115`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:34:29,764::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:34:29,764::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:34:29,764::task::1185::TaskManager.Task::(prepare) Task=`29e706ed-37b6-4bf5-8c53-7f052152b115`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:34:29,764::task::595::TaskManager.Task::(_updateState) Task=`29e706ed-37b6-4bf5-8c53-7f052152b115`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:34:29,765::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:34:29,765::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:34:29,765::task::990::TaskManager.Task::(_decref) Task=`29e706ed-37b6-4bf5-8c53-7f052152b115`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:34:29,795::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:34:29,795::task::595::TaskManager.Task::(_updateState) Task=`33d9c788-dc34-445e-9bb1-29c6e47e2d8b`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:34:29,796::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:34:29,796::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`8961390f-3a4a-41f7-ae7c-e29b736b2e9c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:34:29,796::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:34:29,797::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:34:29,797::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`8961390f-3a4a-41f7-ae7c-e29b736b2e9c`::Granted request >Thread-34::DEBUG::2014-07-24 11:34:29,797::task::827::TaskManager.Task::(resourceAcquired) Task=`33d9c788-dc34-445e-9bb1-29c6e47e2d8b`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:34:29,797::task::990::TaskManager.Task::(_decref) Task=`33d9c788-dc34-445e-9bb1-29c6e47e2d8b`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:34:29,798::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '34091302912', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:34:29,798::task::1185::TaskManager.Task::(prepare) Task=`33d9c788-dc34-445e-9bb1-29c6e47e2d8b`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '34091302912', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:34:29,798::task::595::TaskManager.Task::(_updateState) Task=`33d9c788-dc34-445e-9bb1-29c6e47e2d8b`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:34:29,799::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:34:29,799::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:34:29,799::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:34:29,799::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:34:29,799::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:34:29,799::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:34:29,800::task::990::TaskManager.Task::(_decref) Task=`33d9c788-dc34-445e-9bb1-29c6e47e2d8b`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-07-24 11:34:30,561::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:34:31,325::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:34:31,401::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333997 s, 30.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:34:33,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:34:33,490::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336438 s, 30.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:34:35,503::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:34:35,580::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337482 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:34:37,593::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:34:37,671::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356621 s, 28.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:34:38,368::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:34:38,381::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000693341 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:34:39,683::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:34:39,758::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333276 s, 30.7 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:34:39,860::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:34:39,861::task::595::TaskManager.Task::(_updateState) Task=`0a6d8b66-fd31-4e4e-baa3-17b0f433415b`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:34:39,861::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:34:39,861::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:34:39,861::task::1185::TaskManager.Task::(prepare) Task=`0a6d8b66-fd31-4e4e-baa3-17b0f433415b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:34:39,862::task::595::TaskManager.Task::(_updateState) Task=`0a6d8b66-fd31-4e4e-baa3-17b0f433415b`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:34:39,862::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:34:39,862::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:34:39,862::task::990::TaskManager.Task::(_decref) Task=`0a6d8b66-fd31-4e4e-baa3-17b0f433415b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:34:39,896::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:34:39,896::task::595::TaskManager.Task::(_updateState) Task=`9878c87a-69cd-4b22-ab4c-80a1f340e47b`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:34:39,897::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:34:39,897::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`74e9f0a6-333c-4858-a643-bb54163b926c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:34:39,897::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:34:39,897::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:34:39,898::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`74e9f0a6-333c-4858-a643-bb54163b926c`::Granted request >Thread-34::DEBUG::2014-07-24 11:34:39,899::task::827::TaskManager.Task::(resourceAcquired) Task=`9878c87a-69cd-4b22-ab4c-80a1f340e47b`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:34:39,899::task::990::TaskManager.Task::(_decref) Task=`9878c87a-69cd-4b22-ab4c-80a1f340e47b`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:34:39,899::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '34091302912', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:34:39,900::task::1185::TaskManager.Task::(prepare) Task=`9878c87a-69cd-4b22-ab4c-80a1f340e47b`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '34091302912', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:34:39,900::task::595::TaskManager.Task::(_updateState) Task=`9878c87a-69cd-4b22-ab4c-80a1f340e47b`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:34:39,900::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:34:39,900::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:34:39,900::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:34:39,901::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:34:39,901::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:34:39,901::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:34:39,901::task::990::TaskManager.Task::(_decref) Task=`9878c87a-69cd-4b22-ab4c-80a1f340e47b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:34:41,771::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:34:41,847::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341421 s, 30.0 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:34:43,273::task::595::TaskManager.Task::(_updateState) Task=`0c57a06f-24d7-40f4-952f-1b7b2965e934`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:34:43,274::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:34:43,274::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693341', 'lastCheck': '4.9', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:34:43,274::task::1185::TaskManager.Task::(prepare) Task=`0c57a06f-24d7-40f4-952f-1b7b2965e934`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000693341', 'lastCheck': '4.9', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:34:43,274::task::595::TaskManager.Task::(_updateState) Task=`0c57a06f-24d7-40f4-952f-1b7b2965e934`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:34:43,275::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:34:43,275::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:34:43,275::task::990::TaskManager.Task::(_decref) Task=`0c57a06f-24d7-40f4-952f-1b7b2965e934`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:34:43,860::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:34:43,938::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349998 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:34:45,950::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:34:46,027::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033227 s, 30.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:34:48,040::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:34:48,115::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033363 s, 30.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:34:48,386::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:34:48,398::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000671133 s, 6.1 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:34:49,955::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:34:49,956::task::595::TaskManager.Task::(_updateState) Task=`6213e0a7-d8a0-4b9b-bedc-9ea7acb19c03`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:34:49,956::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:34:49,956::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:34:49,957::task::1185::TaskManager.Task::(prepare) Task=`6213e0a7-d8a0-4b9b-bedc-9ea7acb19c03`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:34:49,957::task::595::TaskManager.Task::(_updateState) Task=`6213e0a7-d8a0-4b9b-bedc-9ea7acb19c03`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:34:49,957::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:34:49,957::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:34:49,957::task::990::TaskManager.Task::(_decref) Task=`6213e0a7-d8a0-4b9b-bedc-9ea7acb19c03`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:34:49,989::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:34:49,989::task::595::TaskManager.Task::(_updateState) Task=`45a829ee-cda2-4328-b10a-d8a1bb4a531d`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:34:49,989::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:34:49,990::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`53688e74-34ab-4b8c-8dcb-5743f0bea008`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:34:49,990::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:34:49,990::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:34:49,990::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`53688e74-34ab-4b8c-8dcb-5743f0bea008`::Granted request >Thread-34::DEBUG::2014-07-24 11:34:49,991::task::827::TaskManager.Task::(resourceAcquired) Task=`45a829ee-cda2-4328-b10a-d8a1bb4a531d`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:34:49,991::task::990::TaskManager.Task::(_decref) Task=`45a829ee-cda2-4328-b10a-d8a1bb4a531d`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:34:49,991::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '34091302912', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:34:49,992::task::1185::TaskManager.Task::(prepare) Task=`45a829ee-cda2-4328-b10a-d8a1bb4a531d`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '34091302912', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:34:49,992::task::595::TaskManager.Task::(_updateState) Task=`45a829ee-cda2-4328-b10a-d8a1bb4a531d`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:34:49,992::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:34:49,993::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:34:49,993::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:34:49,994::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:34:49,994::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:34:49,994::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:34:49,995::task::990::TaskManager.Task::(_decref) Task=`45a829ee-cda2-4328-b10a-d8a1bb4a531d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:34:50,127::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:34:50,205::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348854 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:34:52,217::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:34:52,293::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331553 s, 30.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:34:54,305::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:34:54,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0476755 s, 21.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:34:56,435::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:34:56,515::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362925 s, 28.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:34:58,402::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:34:58,420::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000757721 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:34:58,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:34:58,604::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334058 s, 30.7 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:34:58,670::task::595::TaskManager.Task::(_updateState) Task=`22fefda2-ac3a-416a-a7eb-e159749db62d`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:34:58,670::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:34:58,670::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000757721', 'lastCheck': '0.2', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:34:58,670::task::1185::TaskManager.Task::(prepare) Task=`22fefda2-ac3a-416a-a7eb-e159749db62d`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000757721', 'lastCheck': '0.2', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:34:58,671::task::595::TaskManager.Task::(_updateState) Task=`22fefda2-ac3a-416a-a7eb-e159749db62d`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:34:58,671::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:34:58,671::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:34:58,671::task::990::TaskManager.Task::(_decref) Task=`22fefda2-ac3a-416a-a7eb-e159749db62d`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 11:35:00,053::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:35:00,054::task::595::TaskManager.Task::(_updateState) Task=`c4127bed-1130-4e75-b408-de27856e9649`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:35:00,055::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:35:00,055::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:35:00,055::task::1185::TaskManager.Task::(prepare) Task=`c4127bed-1130-4e75-b408-de27856e9649`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:35:00,056::task::595::TaskManager.Task::(_updateState) Task=`c4127bed-1130-4e75-b408-de27856e9649`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:35:00,056::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:35:00,056::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:35:00,057::task::990::TaskManager.Task::(_decref) Task=`c4127bed-1130-4e75-b408-de27856e9649`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:35:00,094::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:35:00,094::task::595::TaskManager.Task::(_updateState) Task=`e8278c46-ee29-4672-bc07-73d1e1d36bc4`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:35:00,094::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:35:00,095::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`3536f3a2-5682-4273-994f-ec3ad7873515`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:35:00,095::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:35:00,095::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:35:00,095::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`3536f3a2-5682-4273-994f-ec3ad7873515`::Granted request >Thread-34::DEBUG::2014-07-24 11:35:00,096::task::827::TaskManager.Task::(resourceAcquired) Task=`e8278c46-ee29-4672-bc07-73d1e1d36bc4`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:35:00,096::task::990::TaskManager.Task::(_decref) Task=`e8278c46-ee29-4672-bc07-73d1e1d36bc4`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:35:00,097::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '34091302912', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:35:00,097::task::1185::TaskManager.Task::(prepare) Task=`e8278c46-ee29-4672-bc07-73d1e1d36bc4`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '34091302912', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:35:00,097::task::595::TaskManager.Task::(_updateState) Task=`e8278c46-ee29-4672-bc07-73d1e1d36bc4`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:35:00,097::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:35:00,097::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:35:00,097::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:35:00,098::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:35:00,098::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:35:00,098::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:35:00,098::task::990::TaskManager.Task::(_decref) Task=`e8278c46-ee29-4672-bc07-73d1e1d36bc4`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-07-24 11:35:00,597::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:35:00,616::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:35:00,691::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332009 s, 30.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:35:02,703::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:35:02,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329655 s, 31.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:35:04,792::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:35:04,868::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335928 s, 30.5 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:35:06,207::task::595::TaskManager.Task::(_updateState) Task=`02dba100-e97a-4553-b643-d3bf31f806a9`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:35:06,207::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:35:06,207::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-37::DEBUG::2014-07-24 11:35:06,207::task::1185::TaskManager.Task::(prepare) Task=`02dba100-e97a-4553-b643-d3bf31f806a9`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-37::DEBUG::2014-07-24 11:35:06,208::task::595::TaskManager.Task::(_updateState) Task=`02dba100-e97a-4553-b643-d3bf31f806a9`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:35:06,208::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:35:06,208::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:35:06,208::task::990::TaskManager.Task::(_decref) Task=`02dba100-e97a-4553-b643-d3bf31f806a9`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:35:06,881::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:35:06,958::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033615 s, 30.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:35:08,440::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:35:08,452::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000867442 s, 4.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:35:08,970::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:35:09,047::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334899 s, 30.6 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:35:10,179::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:35:10,179::task::595::TaskManager.Task::(_updateState) Task=`73568ddd-3b03-4560-a6ee-b0c95654b0cc`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:35:10,180::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:35:10,180::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:35:10,180::task::1185::TaskManager.Task::(prepare) Task=`73568ddd-3b03-4560-a6ee-b0c95654b0cc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:35:10,180::task::595::TaskManager.Task::(_updateState) Task=`73568ddd-3b03-4560-a6ee-b0c95654b0cc`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:35:10,180::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:35:10,181::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:35:10,181::task::990::TaskManager.Task::(_decref) Task=`73568ddd-3b03-4560-a6ee-b0c95654b0cc`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:35:10,212::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:35:10,212::task::595::TaskManager.Task::(_updateState) Task=`f8d69022-695a-4706-854f-6fe05e8abf48`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:35:10,212::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:35:10,213::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7f705ba2-c68d-4435-9d35-d175157456cb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:35:10,213::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:35:10,213::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:35:10,213::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7f705ba2-c68d-4435-9d35-d175157456cb`::Granted request >Thread-34::DEBUG::2014-07-24 11:35:10,214::task::827::TaskManager.Task::(resourceAcquired) Task=`f8d69022-695a-4706-854f-6fe05e8abf48`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:35:10,214::task::990::TaskManager.Task::(_decref) Task=`f8d69022-695a-4706-854f-6fe05e8abf48`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:35:10,215::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '34091302912', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:35:10,215::task::1185::TaskManager.Task::(prepare) Task=`f8d69022-695a-4706-854f-6fe05e8abf48`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '34091302912', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:35:10,215::task::595::TaskManager.Task::(_updateState) Task=`f8d69022-695a-4706-854f-6fe05e8abf48`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:35:10,215::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:35:10,215::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:35:10,216::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:35:10,216::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:35:10,216::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:35:10,216::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:35:10,216::task::990::TaskManager.Task::(_decref) Task=`f8d69022-695a-4706-854f-6fe05e8abf48`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:35:11,065::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:35:11,141::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335468 s, 30.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:35:13,153::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:35:13,244::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0464262 s, 22.1 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:35:14,112::task::595::TaskManager.Task::(_updateState) Task=`27d7d7a4-6983-4b2d-9b4d-c8349f27c260`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:35:14,112::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:35:14,112::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000867442', 'lastCheck': '5.7', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:35:14,112::task::1185::TaskManager.Task::(prepare) Task=`27d7d7a4-6983-4b2d-9b4d-c8349f27c260`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000867442', 'lastCheck': '5.7', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:35:14,113::task::595::TaskManager.Task::(_updateState) Task=`27d7d7a4-6983-4b2d-9b4d-c8349f27c260`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:35:14,113::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:35:14,113::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:35:14,113::task::990::TaskManager.Task::(_decref) Task=`27d7d7a4-6983-4b2d-9b4d-c8349f27c260`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:35:15,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:35:15,333::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332668 s, 30.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:35:17,346::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:35:17,664::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.274085 s, 3.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:35:18,457::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:35:18,470::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000690904 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:35:19,676::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:35:19,752::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332037 s, 30.8 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:35:20,282::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:35:20,282::task::595::TaskManager.Task::(_updateState) Task=`522ff73c-b28c-4be4-aab2-2320f1b9c806`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:35:20,282::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:35:20,283::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:35:20,283::task::1185::TaskManager.Task::(prepare) Task=`522ff73c-b28c-4be4-aab2-2320f1b9c806`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:35:20,283::task::595::TaskManager.Task::(_updateState) Task=`522ff73c-b28c-4be4-aab2-2320f1b9c806`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:35:20,283::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:35:20,283::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:35:20,284::task::990::TaskManager.Task::(_decref) Task=`522ff73c-b28c-4be4-aab2-2320f1b9c806`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:35:20,331::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:35:20,331::task::595::TaskManager.Task::(_updateState) Task=`23098da7-e70f-4f9b-bf2c-864c89f0587a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:35:20,331::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:35:20,332::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`abacd84b-6de6-4181-b6cb-0c3851d4ed8a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:35:20,332::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:35:20,332::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:35:20,332::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`abacd84b-6de6-4181-b6cb-0c3851d4ed8a`::Granted request >Thread-34::DEBUG::2014-07-24 11:35:20,333::task::827::TaskManager.Task::(resourceAcquired) Task=`23098da7-e70f-4f9b-bf2c-864c89f0587a`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:35:20,333::task::990::TaskManager.Task::(_decref) Task=`23098da7-e70f-4f9b-bf2c-864c89f0587a`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:35:20,334::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '34091302912', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:35:20,334::task::1185::TaskManager.Task::(prepare) Task=`23098da7-e70f-4f9b-bf2c-864c89f0587a`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '34091302912', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:35:20,334::task::595::TaskManager.Task::(_updateState) Task=`23098da7-e70f-4f9b-bf2c-864c89f0587a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:35:20,334::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:35:20,334::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:35:20,335::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:35:20,335::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:35:20,335::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:35:20,335::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:35:20,335::task::990::TaskManager.Task::(_decref) Task=`23098da7-e70f-4f9b-bf2c-864c89f0587a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:35:21,765::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:35:21,842::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034202 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:35:23,855::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:35:23,931::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335061 s, 30.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:35:25,943::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:35:26,026::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379921 s, 27.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:35:28,038::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:35:28,116::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352758 s, 29.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:35:28,477::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:35:28,488::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000618483 s, 6.6 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:35:29,515::task::595::TaskManager.Task::(_updateState) Task=`9904d803-1feb-463c-8d72-0e4dc6fd2dd7`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:35:29,515::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:35:29,515::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000618483', 'lastCheck': '1.0', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:35:29,516::task::1185::TaskManager.Task::(prepare) Task=`9904d803-1feb-463c-8d72-0e4dc6fd2dd7`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000618483', 'lastCheck': '1.0', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:35:29,516::task::595::TaskManager.Task::(_updateState) Task=`9904d803-1feb-463c-8d72-0e4dc6fd2dd7`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:35:29,516::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:35:29,516::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:35:29,517::task::990::TaskManager.Task::(_decref) Task=`9904d803-1feb-463c-8d72-0e4dc6fd2dd7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:35:30,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:35:30,207::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346678 s, 29.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:35:30,446::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:35:30,446::task::595::TaskManager.Task::(_updateState) Task=`654f85f8-62df-46f5-b6ba-809e36f7de1d`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:35:30,447::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:35:30,447::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:35:30,447::task::1185::TaskManager.Task::(prepare) Task=`654f85f8-62df-46f5-b6ba-809e36f7de1d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:35:30,447::task::595::TaskManager.Task::(_updateState) Task=`654f85f8-62df-46f5-b6ba-809e36f7de1d`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:35:30,447::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:35:30,448::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:35:30,448::task::990::TaskManager.Task::(_decref) Task=`654f85f8-62df-46f5-b6ba-809e36f7de1d`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:35:30,490::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:35:30,491::task::595::TaskManager.Task::(_updateState) Task=`8e101b08-4d48-457c-ba6c-99d97012d5e9`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:35:30,491::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:35:30,491::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1969a93a-fa78-457f-8d87-ad587ffe7e67`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:35:30,491::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:35:30,492::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:35:30,492::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1969a93a-fa78-457f-8d87-ad587ffe7e67`::Granted request >Thread-34::DEBUG::2014-07-24 11:35:30,492::task::827::TaskManager.Task::(resourceAcquired) Task=`8e101b08-4d48-457c-ba6c-99d97012d5e9`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:35:30,492::task::990::TaskManager.Task::(_decref) Task=`8e101b08-4d48-457c-ba6c-99d97012d5e9`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:35:30,493::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '34091302912', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:35:30,493::task::1185::TaskManager.Task::(prepare) Task=`8e101b08-4d48-457c-ba6c-99d97012d5e9`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '34091302912', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:35:30,494::task::595::TaskManager.Task::(_updateState) Task=`8e101b08-4d48-457c-ba6c-99d97012d5e9`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:35:30,494::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:35:30,494::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:35:30,494::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:35:30,494::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:35:30,494::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:35:30,495::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:35:30,495::task::990::TaskManager.Task::(_decref) Task=`8e101b08-4d48-457c-ba6c-99d97012d5e9`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-07-24 11:35:30,637::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:35:32,220::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:35:32,298::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336646 s, 30.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:35:34,310::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:35:34,393::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.040207 s, 25.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:35:36,405::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:35:36,496::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0467972 s, 21.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:35:38,493::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:35:38,504::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000699863 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:35:38,508::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:35:38,606::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339641 s, 30.1 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:35:40,588::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:35:40,588::task::595::TaskManager.Task::(_updateState) Task=`c083239f-bab3-4141-aee4-bcee993334a0`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:35:40,588::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:35:40,589::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:35:40,589::task::1185::TaskManager.Task::(prepare) Task=`c083239f-bab3-4141-aee4-bcee993334a0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:35:40,589::task::595::TaskManager.Task::(_updateState) Task=`c083239f-bab3-4141-aee4-bcee993334a0`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:35:40,589::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:35:40,589::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:35:40,590::task::990::TaskManager.Task::(_decref) Task=`c083239f-bab3-4141-aee4-bcee993334a0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:35:40,618::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-34::DEBUG::2014-07-24 11:35:40,650::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:35:40,652::task::595::TaskManager.Task::(_updateState) Task=`ce6d5d78-a6ab-48b8-a512-1d7668634f7e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:35:40,654::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:35:40,657::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`a70eb5a1-9586-4677-b553-5dcf4b054e07`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:35:40,658::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:35:40,660::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:35:40,662::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`a70eb5a1-9586-4677-b553-5dcf4b054e07`::Granted request >Thread-34::DEBUG::2014-07-24 11:35:40,665::task::827::TaskManager.Task::(resourceAcquired) Task=`ce6d5d78-a6ab-48b8-a512-1d7668634f7e`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:35:40,666::task::990::TaskManager.Task::(_decref) Task=`ce6d5d78-a6ab-48b8-a512-1d7668634f7e`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:35:40,672::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '34091302912', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:35:40,674::task::1185::TaskManager.Task::(prepare) Task=`ce6d5d78-a6ab-48b8-a512-1d7668634f7e`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '34091302912', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:35:40,675::task::595::TaskManager.Task::(_updateState) Task=`ce6d5d78-a6ab-48b8-a512-1d7668634f7e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:35:40,676::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:35:40,678::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:35:40,680::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:35:40,682::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:35:40,682::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:35:40,684::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:35:40,685::task::990::TaskManager.Task::(_decref) Task=`ce6d5d78-a6ab-48b8-a512-1d7668634f7e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:35:40,736::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0751422 s, 13.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:35:42,749::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:35:42,826::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03381 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:35:44,838::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:35:44,916::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337867 s, 30.3 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:35:45,187::task::595::TaskManager.Task::(_updateState) Task=`4f082029-da54-4a79-b7aa-ae823069c04f`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:35:45,187::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:35:45,188::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000699863', 'lastCheck': '6.7', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:35:45,188::task::1185::TaskManager.Task::(prepare) Task=`4f082029-da54-4a79-b7aa-ae823069c04f`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000699863', 'lastCheck': '6.7', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:35:45,188::task::595::TaskManager.Task::(_updateState) Task=`4f082029-da54-4a79-b7aa-ae823069c04f`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:35:45,188::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:35:45,188::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:35:45,188::task::990::TaskManager.Task::(_decref) Task=`4f082029-da54-4a79-b7aa-ae823069c04f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:35:46,928::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:35:47,011::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0398032 s, 25.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:35:48,509::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:35:48,521::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000618645 s, 6.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:35:49,023::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:35:49,099::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334253 s, 30.6 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:35:50,773::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:35:50,773::task::595::TaskManager.Task::(_updateState) Task=`1e92e4e2-43b6-4fee-aa64-4e1298305c49`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:35:50,773::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:35:50,774::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:35:50,774::task::1185::TaskManager.Task::(prepare) Task=`1e92e4e2-43b6-4fee-aa64-4e1298305c49`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:35:50,774::task::595::TaskManager.Task::(_updateState) Task=`1e92e4e2-43b6-4fee-aa64-4e1298305c49`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:35:50,774::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:35:50,774::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:35:50,775::task::990::TaskManager.Task::(_decref) Task=`1e92e4e2-43b6-4fee-aa64-4e1298305c49`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:35:50,853::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:35:50,854::task::595::TaskManager.Task::(_updateState) Task=`3b452240-6e29-4254-8c5e-2b3fe5d21d1e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:35:50,854::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:35:50,854::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c22c74e4-0be9-4adb-a929-062fe44fd6a6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:35:50,855::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:35:50,856::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:35:50,856::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c22c74e4-0be9-4adb-a929-062fe44fd6a6`::Granted request >Thread-34::DEBUG::2014-07-24 11:35:50,856::task::827::TaskManager.Task::(resourceAcquired) Task=`3b452240-6e29-4254-8c5e-2b3fe5d21d1e`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:35:50,856::task::990::TaskManager.Task::(_decref) Task=`3b452240-6e29-4254-8c5e-2b3fe5d21d1e`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:35:50,857::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '34091302912', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:35:50,857::task::1185::TaskManager.Task::(prepare) Task=`3b452240-6e29-4254-8c5e-2b3fe5d21d1e`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '34091302912', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:35:50,857::task::595::TaskManager.Task::(_updateState) Task=`3b452240-6e29-4254-8c5e-2b3fe5d21d1e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:35:50,857::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:35:50,858::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:35:50,858::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:35:50,858::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:35:50,858::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:35:50,858::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:35:50,859::task::990::TaskManager.Task::(_decref) Task=`3b452240-6e29-4254-8c5e-2b3fe5d21d1e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:35:51,117::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:35:51,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033459 s, 30.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:35:53,204::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:35:53,283::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341136 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:35:55,296::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:35:55,372::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333797 s, 30.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:35:57,384::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:35:57,462::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349242 s, 29.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:35:58,526::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:35:58,537::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000625915 s, 6.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:35:59,475::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:35:59,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337944 s, 30.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:36:00,673::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-13::DEBUG::2014-07-24 11:36:00,711::task::595::TaskManager.Task::(_updateState) Task=`0a302205-8c69-4d43-844f-8aa209f2703b`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:36:00,711::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:36:00,712::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000625915', 'lastCheck': '2.2', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:36:00,712::task::1185::TaskManager.Task::(prepare) Task=`0a302205-8c69-4d43-844f-8aa209f2703b`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000625915', 'lastCheck': '2.2', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:36:00,712::task::595::TaskManager.Task::(_updateState) Task=`0a302205-8c69-4d43-844f-8aa209f2703b`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:36:00,712::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:36:00,712::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:36:00,712::task::990::TaskManager.Task::(_decref) Task=`0a302205-8c69-4d43-844f-8aa209f2703b`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 11:36:01,033::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:36:01,034::task::595::TaskManager.Task::(_updateState) Task=`76c490e6-393b-4fea-ab70-33a0576b69b1`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:36:01,034::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:36:01,034::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:36:01,034::task::1185::TaskManager.Task::(prepare) Task=`76c490e6-393b-4fea-ab70-33a0576b69b1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:36:01,035::task::595::TaskManager.Task::(_updateState) Task=`76c490e6-393b-4fea-ab70-33a0576b69b1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:36:01,035::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:36:01,035::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:36:01,035::task::990::TaskManager.Task::(_decref) Task=`76c490e6-393b-4fea-ab70-33a0576b69b1`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:36:01,126::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:36:01,126::task::595::TaskManager.Task::(_updateState) Task=`9e5614cb-e4f1-4f80-95e1-bdceb1fd4c49`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:36:01,126::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:36:01,127::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7c83fb14-2c62-4d70-b1df-66243f5ce213`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:36:01,127::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:36:01,127::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:36:01,127::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7c83fb14-2c62-4d70-b1df-66243f5ce213`::Granted request >Thread-34::DEBUG::2014-07-24 11:36:01,128::task::827::TaskManager.Task::(resourceAcquired) Task=`9e5614cb-e4f1-4f80-95e1-bdceb1fd4c49`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:36:01,128::task::990::TaskManager.Task::(_decref) Task=`9e5614cb-e4f1-4f80-95e1-bdceb1fd4c49`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:36:01,128::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '34091302912', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:36:01,129::task::1185::TaskManager.Task::(prepare) Task=`9e5614cb-e4f1-4f80-95e1-bdceb1fd4c49`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '34091302912', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:36:01,129::task::595::TaskManager.Task::(_updateState) Task=`9e5614cb-e4f1-4f80-95e1-bdceb1fd4c49`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:36:01,129::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:36:01,129::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:36:01,129::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:36:01,130::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:36:01,130::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:36:01,130::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:36:01,130::task::990::TaskManager.Task::(_decref) Task=`9e5614cb-e4f1-4f80-95e1-bdceb1fd4c49`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:36:01,563::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:36:01,638::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332671 s, 30.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:36:03,651::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:36:03,730::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370221 s, 27.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:36:05,743::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:36:05,820::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342488 s, 29.9 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:36:06,364::task::595::TaskManager.Task::(_updateState) Task=`e0feba5c-8265-45c2-a5f5-fe455e78d335`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:36:06,364::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:36:06,364::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-37::DEBUG::2014-07-24 11:36:06,365::task::1185::TaskManager.Task::(prepare) Task=`e0feba5c-8265-45c2-a5f5-fe455e78d335`::finished: {'truesize': '4294967296', 'apparentsize': '4294967296'} >Thread-37::DEBUG::2014-07-24 11:36:06,365::task::595::TaskManager.Task::(_updateState) Task=`e0feba5c-8265-45c2-a5f5-fe455e78d335`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:36:06,365::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:36:06,365::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:36:06,365::task::990::TaskManager.Task::(_decref) Task=`e0feba5c-8265-45c2-a5f5-fe455e78d335`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:36:07,833::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:36:07,911::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340245 s, 30.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:36:08,542::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:36:08,554::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000699683 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:36:09,923::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:36:10,000::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331994 s, 30.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:36:11,218::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:36:11,218::task::595::TaskManager.Task::(_updateState) Task=`55847618-bdfc-4c6b-b9a7-c56442f9a9e3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:36:11,219::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:36:11,219::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:36:11,219::task::1185::TaskManager.Task::(prepare) Task=`55847618-bdfc-4c6b-b9a7-c56442f9a9e3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:36:11,219::task::595::TaskManager.Task::(_updateState) Task=`55847618-bdfc-4c6b-b9a7-c56442f9a9e3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:36:11,220::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:36:11,220::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:36:11,220::task::990::TaskManager.Task::(_decref) Task=`55847618-bdfc-4c6b-b9a7-c56442f9a9e3`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:36:11,270::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:36:11,270::task::595::TaskManager.Task::(_updateState) Task=`9b609344-392e-4843-9c0a-98776b6b8eb7`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:36:11,270::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:36:11,271::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c9215975-40c1-447f-a986-bcf7f57be24b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:36:11,271::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:36:11,271::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:36:11,271::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c9215975-40c1-447f-a986-bcf7f57be24b`::Granted request >Thread-34::DEBUG::2014-07-24 11:36:11,271::task::827::TaskManager.Task::(resourceAcquired) Task=`9b609344-392e-4843-9c0a-98776b6b8eb7`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:36:11,272::task::990::TaskManager.Task::(_decref) Task=`9b609344-392e-4843-9c0a-98776b6b8eb7`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:36:11,272::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '34091302912', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:36:11,272::task::1185::TaskManager.Task::(prepare) Task=`9b609344-392e-4843-9c0a-98776b6b8eb7`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '34091302912', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:36:11,273::task::595::TaskManager.Task::(_updateState) Task=`9b609344-392e-4843-9c0a-98776b6b8eb7`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:36:11,273::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:36:11,273::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:36:11,273::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:36:11,273::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:36:11,274::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:36:11,274::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:36:11,274::task::990::TaskManager.Task::(_decref) Task=`9b609344-392e-4843-9c0a-98776b6b8eb7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:36:12,013::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:36:12,090::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333548 s, 30.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:36:14,103::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:36:14,184::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0386646 s, 26.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:36:16,197::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:36:16,273::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335864 s, 30.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:36:16,903::task::595::TaskManager.Task::(_updateState) Task=`3cfdc7e9-6bf2-4b90-b5fe-78b88d6dccaf`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:36:16,904::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:36:16,904::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000699683', 'lastCheck': '8.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:36:16,904::task::1185::TaskManager.Task::(prepare) Task=`3cfdc7e9-6bf2-4b90-b5fe-78b88d6dccaf`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000699683', 'lastCheck': '8.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:36:16,904::task::595::TaskManager.Task::(_updateState) Task=`3cfdc7e9-6bf2-4b90-b5fe-78b88d6dccaf`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:36:16,905::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:36:16,905::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:36:16,905::task::990::TaskManager.Task::(_decref) Task=`3cfdc7e9-6bf2-4b90-b5fe-78b88d6dccaf`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:36:18,285::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:36:18,362::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334977 s, 30.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:36:18,558::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 23aa0606-edc3-4882-a4aa-18aa1983458f >Thread-18::DEBUG::2014-07-24 11:36:18,559::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-18::DEBUG::2014-07-24 11:36:18,559::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:36:18,571::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000549346 s, 3.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:36:18,571::misc::264::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000549346 s, 3.7 MB/s'], size: 2048 >Thread-18::DEBUG::2014-07-24 11:36:18,571::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-18::WARNING::2014-07-24 11:36:18,571::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-18::DEBUG::2014-07-24 11:36:18,571::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-18::DEBUG::2014-07-24 11:36:18,572::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 11:36:18,572::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 11:36:18,572::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 11:36:18,572::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 11:36:18,573::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 11:36:18,573::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-18::DEBUG::2014-07-24 11:36:18,809::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:36:18,810::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 11:36:18,810::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'LOCKPOLICY=', 'POOL_DOMAINS=23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'POOL_DESCRIPTION=DS1', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_UUID=637ea13c-81a8-4b44-8cab-961458b01883', 'POOL_SPM_ID=1', '_SHA_CKSUM=a749afdc7119a2d6aad840af5c63c9b28c0b612c', 'POOL_SPM_LVER=0'] >Thread-18::INFO::2014-07-24 11:36:18,811::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_imageNS already registered >Thread-18::INFO::2014-07-24 11:36:18,811::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_volumeNS already registered >Thread-18::INFO::2014-07-24 11:36:18,811::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_lvmActivationNS already registered >Thread-18::DEBUG::2014-07-24 11:36:18,812::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-18::DEBUG::2014-07-24 11:36:18,975::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:36:18,975::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:36:18,986::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000660379 s, 6.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:36:20,375::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:36:20,452::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035715 s, 28.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:36:21,338::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:36:21,339::task::595::TaskManager.Task::(_updateState) Task=`8d6fcc81-9af7-4167-89a9-fcdc8d14b232`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:36:21,339::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:36:21,339::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:36:21,339::task::1185::TaskManager.Task::(prepare) Task=`8d6fcc81-9af7-4167-89a9-fcdc8d14b232`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:36:21,340::task::595::TaskManager.Task::(_updateState) Task=`8d6fcc81-9af7-4167-89a9-fcdc8d14b232`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:36:21,340::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:36:21,340::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:36:21,340::task::990::TaskManager.Task::(_decref) Task=`8d6fcc81-9af7-4167-89a9-fcdc8d14b232`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:36:21,377::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:36:21,377::task::595::TaskManager.Task::(_updateState) Task=`ee6e34e2-f899-4a09-9288-a0698b672505`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:36:21,377::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:36:21,378::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c32c4efd-5346-4e96-9962-78bc67338866`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:36:21,378::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:36:21,378::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:36:21,378::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`c32c4efd-5346-4e96-9962-78bc67338866`::Granted request >Thread-34::DEBUG::2014-07-24 11:36:21,379::task::827::TaskManager.Task::(resourceAcquired) Task=`ee6e34e2-f899-4a09-9288-a0698b672505`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:36:21,379::task::990::TaskManager.Task::(_decref) Task=`ee6e34e2-f899-4a09-9288-a0698b672505`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:36:21,380::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '34091302912', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:36:21,380::task::1185::TaskManager.Task::(prepare) Task=`ee6e34e2-f899-4a09-9288-a0698b672505`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '34091302912', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:36:21,380::task::595::TaskManager.Task::(_updateState) Task=`ee6e34e2-f899-4a09-9288-a0698b672505`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:36:21,381::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:36:21,381::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:36:21,381::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:36:21,381::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:36:21,381::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:36:21,381::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:36:21,382::task::990::TaskManager.Task::(_decref) Task=`ee6e34e2-f899-4a09-9288-a0698b672505`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:36:22,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:36:22,542::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336685 s, 30.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:36:24,555::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:36:24,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338292 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:36:26,644::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:36:26,802::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.116011 s, 8.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:36:28,815::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:36:28,893::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342208 s, 29.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:36:28,991::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:36:29,004::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000695168 s, 5.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:36:30,709::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:36:30,905::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:36:30,984::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362229 s, 28.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:36:31,450::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:36:31,462::task::595::TaskManager.Task::(_updateState) Task=`88db08a0-8101-4ca0-9074-19f1beb8aa52`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:36:31,463::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:36:31,463::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:36:31,463::task::1185::TaskManager.Task::(prepare) Task=`88db08a0-8101-4ca0-9074-19f1beb8aa52`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:36:31,463::task::595::TaskManager.Task::(_updateState) Task=`88db08a0-8101-4ca0-9074-19f1beb8aa52`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:36:31,463::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:36:31,464::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:36:31,464::task::990::TaskManager.Task::(_decref) Task=`88db08a0-8101-4ca0-9074-19f1beb8aa52`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:36:31,498::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:36:31,498::task::595::TaskManager.Task::(_updateState) Task=`026c0668-c7fb-4736-8282-0d92a1b851fd`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:36:31,498::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:36:31,499::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4206b21a-1680-4c36-a24d-5706ac8ec3bb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:36:31,499::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:36:31,499::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:36:31,499::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4206b21a-1680-4c36-a24d-5706ac8ec3bb`::Granted request >Thread-34::DEBUG::2014-07-24 11:36:31,500::task::827::TaskManager.Task::(resourceAcquired) Task=`026c0668-c7fb-4736-8282-0d92a1b851fd`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:36:31,500::task::990::TaskManager.Task::(_decref) Task=`026c0668-c7fb-4736-8282-0d92a1b851fd`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:36:31,501::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '34091302912', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:36:31,501::task::1185::TaskManager.Task::(prepare) Task=`026c0668-c7fb-4736-8282-0d92a1b851fd`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '34091302912', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:36:31,501::task::595::TaskManager.Task::(_updateState) Task=`026c0668-c7fb-4736-8282-0d92a1b851fd`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:36:31,501::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:36:31,501::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:36:31,502::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:36:31,502::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:36:31,502::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:36:31,502::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:36:31,502::task::990::TaskManager.Task::(_decref) Task=`026c0668-c7fb-4736-8282-0d92a1b851fd`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 11:36:32,368::task::595::TaskManager.Task::(_updateState) Task=`8da173c4-9255-44ed-a901-6d83d149d01d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:36:32,369::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:36:32,369::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000695168', 'lastCheck': '3.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:36:32,369::task::1185::TaskManager.Task::(prepare) Task=`8da173c4-9255-44ed-a901-6d83d149d01d`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000695168', 'lastCheck': '3.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:36:32,369::task::595::TaskManager.Task::(_updateState) Task=`8da173c4-9255-44ed-a901-6d83d149d01d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:36:32,369::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:36:32,370::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:36:32,370::task::990::TaskManager.Task::(_decref) Task=`8da173c4-9255-44ed-a901-6d83d149d01d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:36:32,997::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:36:33,072::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335609 s, 30.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:36:35,085::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:36:35,161::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333435 s, 30.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:36:37,173::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:36:37,250::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334214 s, 30.6 MB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:36:38,491::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 4294967296, capacity: 10737418240, allocated: 3811835392, physical: 4294967296) >Thread-37::DEBUG::2014-07-24 11:36:38,491::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 5120, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:36:38,492::task::595::TaskManager.Task::(_updateState) Task=`aa01066b-4a6a-408d-82f1-d6b825c1e07a`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:36:38,492::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 5120, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=5368709120, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:36:38,493::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:36:38,493::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:36:38,494::task::1185::TaskManager.Task::(prepare) Task=`aa01066b-4a6a-408d-82f1-d6b825c1e07a`::finished: None >Thread-27::DEBUG::2014-07-24 11:36:38,494::storage_mailbox::426::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - start: 64, end: 128, len: 4096, message(1/63): '1xtnd\x8fE\x83\x19\xaa\x18\xaa\xa4\x82H\xc3\xed\x06\x06\xaa#\xe2\x9b\xed\xae\xc5bR\xb3\x85K\x9f\xe2\xee\xa0\x8c\xe1000000000000140000000000000' >Thread-37::DEBUG::2014-07-24 11:36:38,495::task::595::TaskManager.Task::(_updateState) Task=`aa01066b-4a6a-408d-82f1-d6b825c1e07a`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:36:38,496::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:36:38,497::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-27::DEBUG::2014-07-24 11:36:38,498::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-37::DEBUG::2014-07-24 11:36:38,507::task::990::TaskManager.Task::(_decref) Task=`aa01066b-4a6a-408d-82f1-d6b825c1e07a`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:36:38,549::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0387051 s, 106 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:36:38,549::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:36:38,549::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:36:38,608::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0478986 s, 85.5 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:36:39,010::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:36:39,023::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00067086 s, 6.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:36:39,262::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:36:39,345::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360631 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:36:39,345::storage_mailbox::658::Storage.MailBox.SpmMailMonitor::(_handleRequests) SPM_MailMonitor: Mailbox 1 validated, checking mail >Dummy-33::DEBUG::2014-07-24 11:36:39,346::storage_mailbox::698::Storage.MailBox.SpmMailMonitor::(_handleRequests) SPM_MailMonitor: processing request: '1xtnd\x8fE\x83\x19\xaa\x18\xaa\xa4\x82H\xc3\xed\x06\x06\xaa#\xe2\x9b\xed\xae\xc5bR\xb3\x85K\x9f\xe2\xee\xa0\x8c\xe1000000000000140000000000000' >5425e4e2-1762-4684-95bb-ec8949ce3438::DEBUG::2014-07-24 11:36:39,346::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >d3ed0e2a-160c-4b6f-b7d6-48a4321ba61d::DEBUG::2014-07-24 11:36:39,348::threadPool::200::Misc.ThreadPool.WorkerThread::(_processNextTask) Task: d3ed0e2a-160c-4b6f-b7d6-48a4321ba61d running: <function runTask at 0x149a500> with: (<functools.partial object at 0x15de890>, 65, '1xtnd\x8fE\x83\x19\xaa\x18\xaa\xa4\x82H\xc3\xed\x06\x06\xaa#\xe2\x9b\xed\xae\xc5bR\xb3\x85K\x9f\xe2\xee\xa0\x8c\xe1000000000000140000000000000') >d3ed0e2a-160c-4b6f-b7d6-48a4321ba61d::DEBUG::2014-07-24 11:36:39,350::task::595::TaskManager.Task::(_updateState) Task=`24d1b67e-e692-40bf-903a-8178e80fcf60`::moving from state init -> state preparing >d3ed0e2a-160c-4b6f-b7d6-48a4321ba61d::DEBUG::2014-07-24 11:36:39,352::storage_mailbox::146::Storage.SPM.Messages.Extend::(processRequest) processRequest, payload:'1xtnd\x8fE\x83\x19\xaa\x18\xaa\xa4\x82H\xc3\xed\x06\x06\xaa#\xe2\x9b\xed\xae\xc5bR\xb3\x85K\x9f\xe2\xee\xa0\x8c\xe1000000000000140000000000000' >d3ed0e2a-160c-4b6f-b7d6-48a4321ba61d::INFO::2014-07-24 11:36:39,353::storage_mailbox::161::Storage.SPM.Messages.Extend::(processRequest) processRequest: extending volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 in domain 23aa0606-edc3-4882-a4aa-18aa1983458f (pool 637ea13c-81a8-4b44-8cab-961458b01883) to size 5120 >d3ed0e2a-160c-4b6f-b7d6-48a4321ba61d::DEBUG::2014-07-24 11:36:39,358::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvextend --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --size 5120m 23aa0606-edc3-4882-a4aa-18aa1983458f/e18ca0ee-e29f-4b85-b352-62c5aeed9be2' (cwd None) >d3ed0e2a-160c-4b6f-b7d6-48a4321ba61d::DEBUG::2014-07-24 11:36:39,996::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >d3ed0e2a-160c-4b6f-b7d6-48a4321ba61d::DEBUG::2014-07-24 11:36:39,997::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >d3ed0e2a-160c-4b6f-b7d6-48a4321ba61d::DEBUG::2014-07-24 11:36:39,997::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >d3ed0e2a-160c-4b6f-b7d6-48a4321ba61d::DEBUG::2014-07-24 11:36:39,997::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >d3ed0e2a-160c-4b6f-b7d6-48a4321ba61d::DEBUG::2014-07-24 11:36:39,997::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >d3ed0e2a-160c-4b6f-b7d6-48a4321ba61d::DEBUG::2014-07-24 11:36:39,998::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >d3ed0e2a-160c-4b6f-b7d6-48a4321ba61d::DEBUG::2014-07-24 11:36:39,999::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) 'dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox oflag=direct iflag=fullblock conv=notrunc count=1 bs=4096 seek=1' (cwd None) >d3ed0e2a-160c-4b6f-b7d6-48a4321ba61d::DEBUG::2014-07-24 11:36:40,011::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000886735 s, 4.6 MB/s\n'; <rc> = 0 >d3ed0e2a-160c-4b6f-b7d6-48a4321ba61d::DEBUG::2014-07-24 11:36:40,012::task::1185::TaskManager.Task::(prepare) Task=`24d1b67e-e692-40bf-903a-8178e80fcf60`::finished: {'status': {'message': 'Done', 'code': 0}} >d3ed0e2a-160c-4b6f-b7d6-48a4321ba61d::DEBUG::2014-07-24 11:36:40,012::task::595::TaskManager.Task::(_updateState) Task=`24d1b67e-e692-40bf-903a-8178e80fcf60`::moving from state preparing -> state finished >d3ed0e2a-160c-4b6f-b7d6-48a4321ba61d::DEBUG::2014-07-24 11:36:40,012::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >d3ed0e2a-160c-4b6f-b7d6-48a4321ba61d::DEBUG::2014-07-24 11:36:40,012::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >d3ed0e2a-160c-4b6f-b7d6-48a4321ba61d::DEBUG::2014-07-24 11:36:40,012::task::990::TaskManager.Task::(_decref) Task=`24d1b67e-e692-40bf-903a-8178e80fcf60`::ref 0 aborting False >d3ed0e2a-160c-4b6f-b7d6-48a4321ba61d::DEBUG::2014-07-24 11:36:40,013::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-27::DEBUG::2014-07-24 11:36:40,610::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:36:40,926::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.304666 s, 13.4 kB/s\n'; <rc> = 0 >Thread-27::DEBUG::2014-07-24 11:36:40,926::storage_mailbox::342::Storage.MailBox.HsmMailMonitor::(_handleResponses) HSM_MailboxMonitor(1/63) - Checking reply: '1xtnd\x8fE\x83\x19\xaa\x18\xaa\xa4\x82H\xc3\xed\x06\x06\xaa#\xe2\x9b\xed\xae\xc5bR\xb3\x85K\x9f\xe2\xee\xa0\x8c\xe1000000000000140000000000000' >Thread-27::INFO::2014-07-24 11:36:40,927::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >27173d05-f675-4c8b-b75e-0675702f9260::DEBUG::2014-07-24 11:36:40,927::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-27::DEBUG::2014-07-24 11:36:40,929::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >09e29166-990d-4b74-bc6d-c580afb066e8::DEBUG::2014-07-24 11:36:40,929::threadPool::200::Misc.ThreadPool.WorkerThread::(_processNextTask) Task: 09e29166-990d-4b74-bc6d-c580afb066e8 running: <function runTask at 0x149a500> with: (<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>, {'newSize': 5120, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}) >09e29166-990d-4b74-bc6d-c580afb066e8::DEBUG::2014-07-24 11:36:40,939::task::595::TaskManager.Task::(_updateState) Task=`0b0c71b1-bfe2-4da3-8ad2-c840e4f705fa`::moving from state init -> state preparing >09e29166-990d-4b74-bc6d-c580afb066e8::DEBUG::2014-07-24 11:36:40,939::vm::2543::vm.Vm::(__verifyVolumeExtension) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Refreshing drive volume for sda (domainID: 23aa0606-edc3-4882-a4aa-18aa1983458f, volumeID: e18ca0ee-e29f-4b85-b352-62c5aeed9be2) >09e29166-990d-4b74-bc6d-c580afb066e8::DEBUG::2014-07-24 11:36:40,940::task::595::TaskManager.Task::(_updateState) Task=`4ff94df7-fa85-4eb5-8dc4-e10c433dc632`::moving from state init -> state preparing >09e29166-990d-4b74-bc6d-c580afb066e8::INFO::2014-07-24 11:36:40,940::logUtils::44::dispatcher::(wrapper) Run and protect: refreshVolume(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2') >09e29166-990d-4b74-bc6d-c580afb066e8::DEBUG::2014-07-24 11:36:40,941::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >09e29166-990d-4b74-bc6d-c580afb066e8::DEBUG::2014-07-24 11:36:40,943::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-27::DEBUG::2014-07-24 11:36:40,953::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00589316 s, 695 kB/s\n'; <rc> = 0 >09e29166-990d-4b74-bc6d-c580afb066e8::DEBUG::2014-07-24 11:36:41,167::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >09e29166-990d-4b74-bc6d-c580afb066e8::DEBUG::2014-07-24 11:36:41,174::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >09e29166-990d-4b74-bc6d-c580afb066e8::DEBUG::2014-07-24 11:36:41,174::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >09e29166-990d-4b74-bc6d-c580afb066e8::DEBUG::2014-07-24 11:36:41,175::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --refresh 23aa0606-edc3-4882-a4aa-18aa1983458f/e18ca0ee-e29f-4b85-b352-62c5aeed9be2' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:36:41,380::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:36:41,459::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356168 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:36:41,459::storage_mailbox::658::Storage.MailBox.SpmMailMonitor::(_handleRequests) SPM_MailMonitor: Mailbox 1 validated, checking mail >Dummy-33::DEBUG::2014-07-24 11:36:41,470::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) 'dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox oflag=direct iflag=fullblock conv=notrunc count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:36:41,519::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0375362 s, 27.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:36:41,561::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:36:41,561::task::595::TaskManager.Task::(_updateState) Task=`b6e89179-8375-4c84-b310-359a2692411a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:36:41,562::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:36:41,562::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:36:41,562::task::1185::TaskManager.Task::(prepare) Task=`b6e89179-8375-4c84-b310-359a2692411a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:36:41,562::task::595::TaskManager.Task::(_updateState) Task=`b6e89179-8375-4c84-b310-359a2692411a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:36:41,563::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:36:41,563::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:36:41,563::task::990::TaskManager.Task::(_decref) Task=`b6e89179-8375-4c84-b310-359a2692411a`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:36:41,594::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:36:41,595::task::595::TaskManager.Task::(_updateState) Task=`c429f52b-5718-4606-a7dc-f1472e2698e9`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:36:41,595::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:36:41,595::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`a2e55f93-c64b-4296-bf79-35d0cc010e18`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:36:41,596::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:36:41,596::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:36:41,596::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`a2e55f93-c64b-4296-bf79-35d0cc010e18`::Granted request >Thread-34::DEBUG::2014-07-24 11:36:41,596::task::827::TaskManager.Task::(resourceAcquired) Task=`c429f52b-5718-4606-a7dc-f1472e2698e9`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:36:41,597::task::990::TaskManager.Task::(_decref) Task=`c429f52b-5718-4606-a7dc-f1472e2698e9`::ref 1 aborting False >Thread-34::DEBUG::2014-07-24 11:36:41,597::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-34::DEBUG::2014-07-24 11:36:41,598::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >09e29166-990d-4b74-bc6d-c580afb066e8::DEBUG::2014-07-24 11:36:41,700::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >09e29166-990d-4b74-bc6d-c580afb066e8::DEBUG::2014-07-24 11:36:41,700::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm reload operation' is holding the operation mutex, waiting... >Thread-34::DEBUG::2014-07-24 11:36:41,767::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-34::DEBUG::2014-07-24 11:36:41,768::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >09e29166-990d-4b74-bc6d-c580afb066e8::DEBUG::2014-07-24 11:36:41,770::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-34::INFO::2014-07-24 11:36:41,772::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '34091302912', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >09e29166-990d-4b74-bc6d-c580afb066e8::DEBUG::2014-07-24 11:36:41,773::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-34::DEBUG::2014-07-24 11:36:41,774::task::1185::TaskManager.Task::(prepare) Task=`c429f52b-5718-4606-a7dc-f1472e2698e9`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '34091302912', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >09e29166-990d-4b74-bc6d-c580afb066e8::INFO::2014-07-24 11:36:41,775::logUtils::47::dispatcher::(wrapper) Run and protect: refreshVolume, Return response: None >Thread-34::DEBUG::2014-07-24 11:36:41,776::task::595::TaskManager.Task::(_updateState) Task=`c429f52b-5718-4606-a7dc-f1472e2698e9`::moving from state preparing -> state finished >09e29166-990d-4b74-bc6d-c580afb066e8::DEBUG::2014-07-24 11:36:41,777::task::1185::TaskManager.Task::(prepare) Task=`4ff94df7-fa85-4eb5-8dc4-e10c433dc632`::finished: None >Thread-34::DEBUG::2014-07-24 11:36:41,777::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >09e29166-990d-4b74-bc6d-c580afb066e8::DEBUG::2014-07-24 11:36:41,779::task::595::TaskManager.Task::(_updateState) Task=`4ff94df7-fa85-4eb5-8dc4-e10c433dc632`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:36:41,779::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >09e29166-990d-4b74-bc6d-c580afb066e8::DEBUG::2014-07-24 11:36:41,781::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-34::DEBUG::2014-07-24 11:36:41,782::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >09e29166-990d-4b74-bc6d-c580afb066e8::DEBUG::2014-07-24 11:36:41,783::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:36:41,784::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >09e29166-990d-4b74-bc6d-c580afb066e8::DEBUG::2014-07-24 11:36:41,785::task::990::TaskManager.Task::(_decref) Task=`4ff94df7-fa85-4eb5-8dc4-e10c433dc632`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:36:41,785::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:36:41,787::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >09e29166-990d-4b74-bc6d-c580afb066e8::DEBUG::2014-07-24 11:36:41,788::task::595::TaskManager.Task::(_updateState) Task=`e4017fbb-d1b0-4d5c-8d5d-5fbe21ef5832`::moving from state init -> state preparing >Thread-34::DEBUG::2014-07-24 11:36:41,789::task::990::TaskManager.Task::(_decref) Task=`c429f52b-5718-4606-a7dc-f1472e2698e9`::ref 0 aborting False >09e29166-990d-4b74-bc6d-c580afb066e8::INFO::2014-07-24 11:36:41,791::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >09e29166-990d-4b74-bc6d-c580afb066e8::INFO::2014-07-24 11:36:41,794::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >09e29166-990d-4b74-bc6d-c580afb066e8::DEBUG::2014-07-24 11:36:41,794::task::1185::TaskManager.Task::(prepare) Task=`e4017fbb-d1b0-4d5c-8d5d-5fbe21ef5832`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >09e29166-990d-4b74-bc6d-c580afb066e8::DEBUG::2014-07-24 11:36:41,794::task::595::TaskManager.Task::(_updateState) Task=`e4017fbb-d1b0-4d5c-8d5d-5fbe21ef5832`::moving from state preparing -> state finished >09e29166-990d-4b74-bc6d-c580afb066e8::DEBUG::2014-07-24 11:36:41,795::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >09e29166-990d-4b74-bc6d-c580afb066e8::DEBUG::2014-07-24 11:36:41,795::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >09e29166-990d-4b74-bc6d-c580afb066e8::DEBUG::2014-07-24 11:36:41,795::task::990::TaskManager.Task::(_decref) Task=`e4017fbb-d1b0-4d5c-8d5d-5fbe21ef5832`::ref 0 aborting False >09e29166-990d-4b74-bc6d-c580afb066e8::DEBUG::2014-07-24 11:36:41,795::vm::2563::vm.Vm::(__verifyVolumeExtension) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Verifying extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2, requested size 5368709120, current size 5368709120 >09e29166-990d-4b74-bc6d-c580afb066e8::DEBUG::2014-07-24 11:36:41,829::task::1185::TaskManager.Task::(prepare) Task=`0b0c71b1-bfe2-4da3-8ad2-c840e4f705fa`::finished: None >09e29166-990d-4b74-bc6d-c580afb066e8::DEBUG::2014-07-24 11:36:41,829::task::595::TaskManager.Task::(_updateState) Task=`0b0c71b1-bfe2-4da3-8ad2-c840e4f705fa`::moving from state preparing -> state finished >09e29166-990d-4b74-bc6d-c580afb066e8::DEBUG::2014-07-24 11:36:41,829::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >09e29166-990d-4b74-bc6d-c580afb066e8::DEBUG::2014-07-24 11:36:41,829::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >09e29166-990d-4b74-bc6d-c580afb066e8::DEBUG::2014-07-24 11:36:41,829::task::990::TaskManager.Task::(_decref) Task=`0b0c71b1-bfe2-4da3-8ad2-c840e4f705fa`::ref 0 aborting False >09e29166-990d-4b74-bc6d-c580afb066e8::DEBUG::2014-07-24 11:36:41,830::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-27::DEBUG::2014-07-24 11:36:42,956::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:36:43,276::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.30865 s, 13.3 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:36:43,276::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:36:43,277::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:36:43,342::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0535334 s, 76.5 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:36:43,521::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:36:43,612::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0467269 s, 21.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:36:45,625::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:36:45,706::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0376113 s, 27.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:36:47,718::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-24 11:36:47,786::task::595::TaskManager.Task::(_updateState) Task=`4ed4c4cb-f29d-4452-91d6-8f07767a2f6c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:36:47,788::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:36:47,790::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00067086', 'lastCheck': '8.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:36:47,792::task::1185::TaskManager.Task::(prepare) Task=`4ed4c4cb-f29d-4452-91d6-8f07767a2f6c`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00067086', 'lastCheck': '8.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:36:47,793::task::595::TaskManager.Task::(_updateState) Task=`4ed4c4cb-f29d-4452-91d6-8f07767a2f6c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:36:47,795::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:36:47,796::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:36:47,798::task::990::TaskManager.Task::(_decref) Task=`4ed4c4cb-f29d-4452-91d6-8f07767a2f6c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:36:47,844::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034968 s, 29.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:36:49,027::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:36:49,047::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00881947 s, 464 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:36:49,857::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:36:49,938::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360567 s, 28.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:36:51,860::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:36:51,861::task::595::TaskManager.Task::(_updateState) Task=`44653c49-4e75-4f83-95af-c9d521d94d68`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:36:51,861::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:36:51,861::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:36:51,861::task::1185::TaskManager.Task::(prepare) Task=`44653c49-4e75-4f83-95af-c9d521d94d68`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:36:51,862::task::595::TaskManager.Task::(_updateState) Task=`44653c49-4e75-4f83-95af-c9d521d94d68`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:36:51,862::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:36:51,862::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:36:51,862::task::990::TaskManager.Task::(_decref) Task=`44653c49-4e75-4f83-95af-c9d521d94d68`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:36:51,896::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:36:51,896::task::595::TaskManager.Task::(_updateState) Task=`05f3db59-0631-41d6-96cb-1909c44e78f1`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:36:51,897::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:36:51,897::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`bac39a3c-852d-46fe-9b73-52482397334f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:36:51,897::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:36:51,897::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:36:51,898::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`bac39a3c-852d-46fe-9b73-52482397334f`::Granted request >Thread-34::DEBUG::2014-07-24 11:36:51,898::task::827::TaskManager.Task::(resourceAcquired) Task=`05f3db59-0631-41d6-96cb-1909c44e78f1`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:36:51,898::task::990::TaskManager.Task::(_decref) Task=`05f3db59-0631-41d6-96cb-1909c44e78f1`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:36:51,899::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:36:51,899::task::1185::TaskManager.Task::(prepare) Task=`05f3db59-0631-41d6-96cb-1909c44e78f1`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:36:51,899::task::595::TaskManager.Task::(_updateState) Task=`05f3db59-0631-41d6-96cb-1909c44e78f1`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:36:51,899::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:36:51,900::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:36:51,900::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:36:51,900::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:36:51,900::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:36:51,900::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:36:51,900::task::990::TaskManager.Task::(_decref) Task=`05f3db59-0631-41d6-96cb-1909c44e78f1`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:36:51,952::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:36:52,032::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359845 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:36:54,045::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:36:54,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0414881 s, 24.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:36:56,142::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:36:56,229::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0439257 s, 23.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:36:58,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:36:58,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353898 s, 28.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:36:59,053::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:36:59,073::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00854971 s, 479 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:37:00,333::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:37:00,410::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333389 s, 30.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:37:00,746::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-14::DEBUG::2014-07-24 11:37:01,964::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:37:01,965::task::595::TaskManager.Task::(_updateState) Task=`45e5b7c8-d2bc-4c77-82b8-f9a95e67ab64`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:37:01,965::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:37:01,966::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:37:01,966::task::1185::TaskManager.Task::(prepare) Task=`45e5b7c8-d2bc-4c77-82b8-f9a95e67ab64`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:37:01,966::task::595::TaskManager.Task::(_updateState) Task=`45e5b7c8-d2bc-4c77-82b8-f9a95e67ab64`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:37:01,966::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:37:01,966::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:37:01,966::task::990::TaskManager.Task::(_decref) Task=`45e5b7c8-d2bc-4c77-82b8-f9a95e67ab64`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:37:02,004::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:37:02,005::task::595::TaskManager.Task::(_updateState) Task=`122e0f4b-a196-4ce8-b9bb-b152237064f8`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:37:02,005::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:37:02,005::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`9fef55c7-7916-461e-a1be-25d85f6a7307`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:37:02,005::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:37:02,006::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:37:02,006::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`9fef55c7-7916-461e-a1be-25d85f6a7307`::Granted request >Thread-34::DEBUG::2014-07-24 11:37:02,006::task::827::TaskManager.Task::(resourceAcquired) Task=`122e0f4b-a196-4ce8-b9bb-b152237064f8`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:37:02,006::task::990::TaskManager.Task::(_decref) Task=`122e0f4b-a196-4ce8-b9bb-b152237064f8`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:37:02,007::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:37:02,007::task::1185::TaskManager.Task::(prepare) Task=`122e0f4b-a196-4ce8-b9bb-b152237064f8`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:37:02,007::task::595::TaskManager.Task::(_updateState) Task=`122e0f4b-a196-4ce8-b9bb-b152237064f8`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:37:02,008::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:37:02,008::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:37:02,008::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:37:02,008::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:37:02,008::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:37:02,009::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:37:02,009::task::990::TaskManager.Task::(_decref) Task=`122e0f4b-a196-4ce8-b9bb-b152237064f8`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:37:02,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:37:02,500::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340025 s, 30.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:37:03,190::task::595::TaskManager.Task::(_updateState) Task=`bbb3d0e4-de5d-4a31-bddb-9e09ffd992ef`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:37:03,190::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:37:03,190::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00854971', 'lastCheck': '4.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:37:03,190::task::1185::TaskManager.Task::(prepare) Task=`bbb3d0e4-de5d-4a31-bddb-9e09ffd992ef`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00854971', 'lastCheck': '4.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:37:03,191::task::595::TaskManager.Task::(_updateState) Task=`bbb3d0e4-de5d-4a31-bddb-9e09ffd992ef`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:37:03,191::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:37:03,191::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:37:03,191::task::990::TaskManager.Task::(_decref) Task=`bbb3d0e4-de5d-4a31-bddb-9e09ffd992ef`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:37:04,513::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:37:04,591::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345408 s, 29.6 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:37:06,559::task::595::TaskManager.Task::(_updateState) Task=`2a3396af-45b9-4fed-abb6-287b149e1c27`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:37:06,559::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:37:06,559::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-37::DEBUG::2014-07-24 11:37:06,560::task::1185::TaskManager.Task::(prepare) Task=`2a3396af-45b9-4fed-abb6-287b149e1c27`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-37::DEBUG::2014-07-24 11:37:06,560::task::595::TaskManager.Task::(_updateState) Task=`2a3396af-45b9-4fed-abb6-287b149e1c27`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:37:06,560::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:37:06,560::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:37:06,560::task::990::TaskManager.Task::(_decref) Task=`2a3396af-45b9-4fed-abb6-287b149e1c27`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:37:06,604::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:37:06,682::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347106 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:37:08,695::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:37:08,784::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0434826 s, 23.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:37:09,077::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:37:09,089::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000680618 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:37:10,797::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:37:10,895::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336439 s, 30.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:37:12,134::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:37:12,135::task::595::TaskManager.Task::(_updateState) Task=`1adb9310-8f84-4a26-95bc-a11fc04092e1`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:37:12,135::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:37:12,135::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:37:12,135::task::1185::TaskManager.Task::(prepare) Task=`1adb9310-8f84-4a26-95bc-a11fc04092e1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:37:12,136::task::595::TaskManager.Task::(_updateState) Task=`1adb9310-8f84-4a26-95bc-a11fc04092e1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:37:12,136::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:37:12,136::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:37:12,136::task::990::TaskManager.Task::(_decref) Task=`1adb9310-8f84-4a26-95bc-a11fc04092e1`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:37:12,181::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:37:12,181::task::595::TaskManager.Task::(_updateState) Task=`0b79a308-e327-4aaf-8300-b742820eb32b`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:37:12,181::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:37:12,182::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`3b2d1eb1-1ce3-4b9b-ac68-4404a884e6c8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:37:12,182::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:37:12,182::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:37:12,182::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`3b2d1eb1-1ce3-4b9b-ac68-4404a884e6c8`::Granted request >Thread-34::DEBUG::2014-07-24 11:37:12,183::task::827::TaskManager.Task::(resourceAcquired) Task=`0b79a308-e327-4aaf-8300-b742820eb32b`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:37:12,183::task::990::TaskManager.Task::(_decref) Task=`0b79a308-e327-4aaf-8300-b742820eb32b`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:37:12,184::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:37:12,184::task::1185::TaskManager.Task::(prepare) Task=`0b79a308-e327-4aaf-8300-b742820eb32b`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:37:12,184::task::595::TaskManager.Task::(_updateState) Task=`0b79a308-e327-4aaf-8300-b742820eb32b`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:37:12,184::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:37:12,184::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:37:12,185::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:37:12,185::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:37:12,185::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:37:12,185::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:37:12,185::task::990::TaskManager.Task::(_decref) Task=`0b79a308-e327-4aaf-8300-b742820eb32b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:37:12,908::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:37:12,994::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0401265 s, 25.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:37:15,007::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:37:15,084::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333769 s, 30.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:37:17,097::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:37:17,177::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373475 s, 27.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:37:18,552::task::595::TaskManager.Task::(_updateState) Task=`3b35e0ed-25fa-420e-aa33-f98e41947776`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:37:18,553::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:37:18,553::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000680618', 'lastCheck': '9.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:37:18,553::task::1185::TaskManager.Task::(prepare) Task=`3b35e0ed-25fa-420e-aa33-f98e41947776`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000680618', 'lastCheck': '9.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:37:18,553::task::595::TaskManager.Task::(_updateState) Task=`3b35e0ed-25fa-420e-aa33-f98e41947776`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:37:18,554::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:37:18,554::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:37:18,554::task::990::TaskManager.Task::(_decref) Task=`3b35e0ed-25fa-420e-aa33-f98e41947776`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:37:19,094::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:37:19,106::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000672703 s, 6.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:37:19,190::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:37:19,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0443819 s, 23.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:37:21,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:37:21,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036072 s, 28.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:37:22,240::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [6bfd44d8] >Thread-14::DEBUG::2014-07-24 11:37:22,241::task::595::TaskManager.Task::(_updateState) Task=`0d634d5d-e9fa-4627-86b6-3bc32810468b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:37:22,241::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:37:22,242::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:37:22,242::task::1185::TaskManager.Task::(prepare) Task=`0d634d5d-e9fa-4627-86b6-3bc32810468b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:37:22,242::task::595::TaskManager.Task::(_updateState) Task=`0d634d5d-e9fa-4627-86b6-3bc32810468b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:37:22,242::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:37:22,242::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:37:22,242::task::990::TaskManager.Task::(_decref) Task=`0d634d5d-e9fa-4627-86b6-3bc32810468b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:37:22,276::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [6bfd44d8] >Thread-34::DEBUG::2014-07-24 11:37:22,277::task::595::TaskManager.Task::(_updateState) Task=`7978ea3c-2af6-4f69-94b6-c77c9b20c37e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:37:22,277::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:37:22,277::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`488dc661-49ed-4277-b7b9-2e87cb889d30`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:37:22,278::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:37:22,278::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:37:22,278::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`488dc661-49ed-4277-b7b9-2e87cb889d30`::Granted request >Thread-34::DEBUG::2014-07-24 11:37:22,278::task::827::TaskManager.Task::(resourceAcquired) Task=`7978ea3c-2af6-4f69-94b6-c77c9b20c37e`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:37:22,278::task::990::TaskManager.Task::(_decref) Task=`7978ea3c-2af6-4f69-94b6-c77c9b20c37e`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:37:22,279::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:37:22,279::task::1185::TaskManager.Task::(prepare) Task=`7978ea3c-2af6-4f69-94b6-c77c9b20c37e`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:37:22,280::task::595::TaskManager.Task::(_updateState) Task=`7978ea3c-2af6-4f69-94b6-c77c9b20c37e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:37:22,280::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:37:22,280::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:37:22,280::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:37:22,280::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:37:22,280::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:37:22,281::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:37:22,281::task::990::TaskManager.Task::(_decref) Task=`7978ea3c-2af6-4f69-94b6-c77c9b20c37e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:37:23,381::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:37:23,460::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363938 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:37:25,473::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:37:25,552::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353765 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:37:27,565::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:37:27,644::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351236 s, 29.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:37:29,111::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:37:29,122::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000626969 s, 6.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:37:29,656::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:37:29,737::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036218 s, 28.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:37:30,782::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:37:31,750::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:37:31,833::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0405752 s, 25.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:37:32,338::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:37:32,339::task::595::TaskManager.Task::(_updateState) Task=`aaa1397f-6a71-440a-a98c-ba9f2ab8f033`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:37:32,339::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:37:32,340::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:37:32,340::task::1185::TaskManager.Task::(prepare) Task=`aaa1397f-6a71-440a-a98c-ba9f2ab8f033`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:37:32,340::task::595::TaskManager.Task::(_updateState) Task=`aaa1397f-6a71-440a-a98c-ba9f2ab8f033`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:37:32,340::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:37:32,340::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:37:32,340::task::990::TaskManager.Task::(_decref) Task=`aaa1397f-6a71-440a-a98c-ba9f2ab8f033`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:37:32,374::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:37:32,374::task::595::TaskManager.Task::(_updateState) Task=`20b7f9a0-7dae-4410-8ee8-7086c4202c34`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:37:32,375::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:37:32,375::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`6fcaddbc-fe82-498e-acc2-fa0722624d34`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:37:32,375::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:37:32,376::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:37:32,376::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`6fcaddbc-fe82-498e-acc2-fa0722624d34`::Granted request >Thread-34::DEBUG::2014-07-24 11:37:32,376::task::827::TaskManager.Task::(resourceAcquired) Task=`20b7f9a0-7dae-4410-8ee8-7086c4202c34`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:37:32,376::task::990::TaskManager.Task::(_decref) Task=`20b7f9a0-7dae-4410-8ee8-7086c4202c34`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:37:32,377::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:37:32,377::task::1185::TaskManager.Task::(prepare) Task=`20b7f9a0-7dae-4410-8ee8-7086c4202c34`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:37:32,377::task::595::TaskManager.Task::(_updateState) Task=`20b7f9a0-7dae-4410-8ee8-7086c4202c34`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:37:32,377::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:37:32,378::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:37:32,378::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:37:32,378::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:37:32,378::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:37:32,378::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:37:32,379::task::990::TaskManager.Task::(_decref) Task=`20b7f9a0-7dae-4410-8ee8-7086c4202c34`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:37:33,845::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-24 11:37:33,918::task::595::TaskManager.Task::(_updateState) Task=`b584ef06-7acb-41c2-9f59-e76ad0fb083f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:37:33,919::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:37:33,921::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000626969', 'lastCheck': '4.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:37:33,922::task::1185::TaskManager.Task::(prepare) Task=`b584ef06-7acb-41c2-9f59-e76ad0fb083f`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000626969', 'lastCheck': '4.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:37:33,923::task::595::TaskManager.Task::(_updateState) Task=`b584ef06-7acb-41c2-9f59-e76ad0fb083f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:37:33,923::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:37:33,924::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:37:33,926::task::990::TaskManager.Task::(_decref) Task=`b584ef06-7acb-41c2-9f59-e76ad0fb083f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:37:33,952::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0378655 s, 27.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:37:35,965::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:37:36,046::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0387117 s, 26.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:37:38,059::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:37:38,139::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369165 s, 27.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:37:39,127::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:37:39,145::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000704217 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:37:40,152::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:37:40,231::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370333 s, 27.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:37:42,247::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:37:42,324::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345263 s, 29.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:37:42,432::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:37:42,433::task::595::TaskManager.Task::(_updateState) Task=`efd6b0ab-7741-41d0-af56-d0997ba486de`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:37:42,433::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:37:42,433::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:37:42,434::task::1185::TaskManager.Task::(prepare) Task=`efd6b0ab-7741-41d0-af56-d0997ba486de`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:37:42,434::task::595::TaskManager.Task::(_updateState) Task=`efd6b0ab-7741-41d0-af56-d0997ba486de`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:37:42,434::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:37:42,434::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:37:42,434::task::990::TaskManager.Task::(_decref) Task=`efd6b0ab-7741-41d0-af56-d0997ba486de`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:37:42,465::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:37:42,466::task::595::TaskManager.Task::(_updateState) Task=`7f03c125-4519-4bcd-8fd3-0e65f8e22f67`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:37:42,466::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:37:42,466::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`50c754e7-9e69-42e5-828c-8d85eb6c3b98`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:37:42,466::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:37:42,467::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:37:42,467::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`50c754e7-9e69-42e5-828c-8d85eb6c3b98`::Granted request >Thread-34::DEBUG::2014-07-24 11:37:42,467::task::827::TaskManager.Task::(resourceAcquired) Task=`7f03c125-4519-4bcd-8fd3-0e65f8e22f67`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:37:42,467::task::990::TaskManager.Task::(_decref) Task=`7f03c125-4519-4bcd-8fd3-0e65f8e22f67`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:37:42,468::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:37:42,468::task::1185::TaskManager.Task::(prepare) Task=`7f03c125-4519-4bcd-8fd3-0e65f8e22f67`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:37:42,468::task::595::TaskManager.Task::(_updateState) Task=`7f03c125-4519-4bcd-8fd3-0e65f8e22f67`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:37:42,469::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:37:42,469::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:37:42,469::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:37:42,469::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:37:42,469::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:37:42,469::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:37:42,470::task::990::TaskManager.Task::(_decref) Task=`7f03c125-4519-4bcd-8fd3-0e65f8e22f67`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:37:44,337::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:37:44,420::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0411552 s, 24.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:37:46,433::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:37:46,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359196 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:37:48,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:37:48,601::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339364 s, 30.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:37:49,150::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:37:49,162::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000654117 s, 6.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:37:49,358::task::595::TaskManager.Task::(_updateState) Task=`b7d9f38b-560a-42f7-8dcf-74aac0692ca3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:37:49,359::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:37:49,359::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000654117', 'lastCheck': '0.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:37:49,359::task::1185::TaskManager.Task::(prepare) Task=`b7d9f38b-560a-42f7-8dcf-74aac0692ca3`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000654117', 'lastCheck': '0.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:37:49,360::task::595::TaskManager.Task::(_updateState) Task=`b7d9f38b-560a-42f7-8dcf-74aac0692ca3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:37:49,360::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:37:49,360::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:37:49,360::task::990::TaskManager.Task::(_decref) Task=`b7d9f38b-560a-42f7-8dcf-74aac0692ca3`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:37:50,613::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:37:50,688::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333895 s, 30.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:37:52,535::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:37:52,536::task::595::TaskManager.Task::(_updateState) Task=`b44a7173-75ca-4cdb-b918-1ddb56a51c9c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:37:52,536::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:37:52,536::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:37:52,536::task::1185::TaskManager.Task::(prepare) Task=`b44a7173-75ca-4cdb-b918-1ddb56a51c9c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:37:52,537::task::595::TaskManager.Task::(_updateState) Task=`b44a7173-75ca-4cdb-b918-1ddb56a51c9c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:37:52,537::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:37:52,537::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:37:52,537::task::990::TaskManager.Task::(_decref) Task=`b44a7173-75ca-4cdb-b918-1ddb56a51c9c`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:37:52,568::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:37:52,568::task::595::TaskManager.Task::(_updateState) Task=`053a9eaa-668b-48ae-a8f4-2827e9d4de73`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:37:52,568::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:37:52,569::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`579a25fb-adc1-45ac-b24f-d1ff2a608e1d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:37:52,569::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:37:52,569::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:37:52,569::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`579a25fb-adc1-45ac-b24f-d1ff2a608e1d`::Granted request >Thread-34::DEBUG::2014-07-24 11:37:52,570::task::827::TaskManager.Task::(resourceAcquired) Task=`053a9eaa-668b-48ae-a8f4-2827e9d4de73`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:37:52,570::task::990::TaskManager.Task::(_decref) Task=`053a9eaa-668b-48ae-a8f4-2827e9d4de73`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:37:52,571::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:37:52,571::task::1185::TaskManager.Task::(prepare) Task=`053a9eaa-668b-48ae-a8f4-2827e9d4de73`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:37:52,571::task::595::TaskManager.Task::(_updateState) Task=`053a9eaa-668b-48ae-a8f4-2827e9d4de73`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:37:52,571::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:37:52,571::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:37:52,571::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:37:52,572::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:37:52,572::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:37:52,572::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:37:52,572::task::990::TaskManager.Task::(_decref) Task=`053a9eaa-668b-48ae-a8f4-2827e9d4de73`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:37:52,701::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:37:52,711::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:37:52,712::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Dummy-33::DEBUG::2014-07-24 11:37:54,715::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:37:54,725::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:37:54,725::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Dummy-33::DEBUG::2014-07-24 11:37:56,728::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:37:56,738::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:37:56,738::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Dummy-33::DEBUG::2014-07-24 11:37:58,741::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:37:58,751::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:37:58,751::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-18::DEBUG::2014-07-24 11:37:59,166::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:37:59,179::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000653638 s, 6.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:38:00,754::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:38:00,764::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:38:00,765::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >VM Channels Listener::DEBUG::2014-07-24 11:38:00,819::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-14::DEBUG::2014-07-24 11:38:02,634::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:38:02,635::task::595::TaskManager.Task::(_updateState) Task=`c6916899-4e9f-4848-9014-ab17cd90f5bf`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:38:02,635::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:38:02,635::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:38:02,636::task::1185::TaskManager.Task::(prepare) Task=`c6916899-4e9f-4848-9014-ab17cd90f5bf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:38:02,636::task::595::TaskManager.Task::(_updateState) Task=`c6916899-4e9f-4848-9014-ab17cd90f5bf`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:38:02,636::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:38:02,636::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:38:02,636::task::990::TaskManager.Task::(_decref) Task=`c6916899-4e9f-4848-9014-ab17cd90f5bf`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:38:02,684::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:38:02,684::task::595::TaskManager.Task::(_updateState) Task=`31a25a7d-9c77-4631-8571-6376da3c222b`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:38:02,685::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:38:02,685::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`256e20a8-4872-4ba9-9e21-fed711c891c4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:38:02,685::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:38:02,685::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:38:02,686::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`256e20a8-4872-4ba9-9e21-fed711c891c4`::Granted request >Thread-34::DEBUG::2014-07-24 11:38:02,686::task::827::TaskManager.Task::(resourceAcquired) Task=`31a25a7d-9c77-4631-8571-6376da3c222b`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:38:02,686::task::990::TaskManager.Task::(_decref) Task=`31a25a7d-9c77-4631-8571-6376da3c222b`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:38:02,687::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:38:02,687::task::1185::TaskManager.Task::(prepare) Task=`31a25a7d-9c77-4631-8571-6376da3c222b`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:38:02,687::task::595::TaskManager.Task::(_updateState) Task=`31a25a7d-9c77-4631-8571-6376da3c222b`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:38:02,687::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:38:02,687::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:38:02,688::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:38:02,688::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:38:02,688::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:38:02,688::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:38:02,688::task::990::TaskManager.Task::(_decref) Task=`31a25a7d-9c77-4631-8571-6376da3c222b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:38:02,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:38:02,777::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:38:02,778::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-14::DEBUG::2014-07-24 11:38:04,777::task::595::TaskManager.Task::(_updateState) Task=`1230690d-9dd3-4e13-b6b7-6bfc8491940a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:38:04,778::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:38:04,778::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000653638', 'lastCheck': '5.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:38:04,779::task::1185::TaskManager.Task::(prepare) Task=`1230690d-9dd3-4e13-b6b7-6bfc8491940a`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000653638', 'lastCheck': '5.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:38:04,779::task::595::TaskManager.Task::(_updateState) Task=`1230690d-9dd3-4e13-b6b7-6bfc8491940a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:38:04,780::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:38:04,780::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Dummy-33::DEBUG::2014-07-24 11:38:04,781::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-24 11:38:04,781::task::990::TaskManager.Task::(_decref) Task=`1230690d-9dd3-4e13-b6b7-6bfc8491940a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:38:04,794::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:38:04,796::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-37::DEBUG::2014-07-24 11:38:06,752::task::595::TaskManager.Task::(_updateState) Task=`b1900dca-2437-40e3-a26e-61474f634935`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:38:06,753::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:38:06,753::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-37::DEBUG::2014-07-24 11:38:06,753::task::1185::TaskManager.Task::(prepare) Task=`b1900dca-2437-40e3-a26e-61474f634935`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-37::DEBUG::2014-07-24 11:38:06,753::task::595::TaskManager.Task::(_updateState) Task=`b1900dca-2437-40e3-a26e-61474f634935`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:38:06,753::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:38:06,754::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:38:06,754::task::990::TaskManager.Task::(_decref) Task=`b1900dca-2437-40e3-a26e-61474f634935`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:38:06,799::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:38:06,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:38:06,809::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Dummy-33::DEBUG::2014-07-24 11:38:08,812::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:38:08,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:38:08,822::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-18::DEBUG::2014-07-24 11:38:09,186::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:38:09,207::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.010548 s, 388 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:38:10,825::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:38:10,835::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:38:10,836::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-14::DEBUG::2014-07-24 11:38:12,776::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:38:12,776::task::595::TaskManager.Task::(_updateState) Task=`d73cded7-8804-4f5b-a98d-3e5c235029ad`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:38:12,777::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:38:12,777::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:38:12,777::task::1185::TaskManager.Task::(prepare) Task=`d73cded7-8804-4f5b-a98d-3e5c235029ad`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:38:12,777::task::595::TaskManager.Task::(_updateState) Task=`d73cded7-8804-4f5b-a98d-3e5c235029ad`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:38:12,777::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:38:12,778::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:38:12,778::task::990::TaskManager.Task::(_decref) Task=`d73cded7-8804-4f5b-a98d-3e5c235029ad`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:38:12,812::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:38:12,813::task::595::TaskManager.Task::(_updateState) Task=`06635950-0504-4417-a9a7-d5dbd66d0ce6`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:38:12,813::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:38:12,813::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`8ba1d2be-844b-4a14-8923-8a2853a31555`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:38:12,813::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:38:12,814::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:38:12,814::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`8ba1d2be-844b-4a14-8923-8a2853a31555`::Granted request >Thread-34::DEBUG::2014-07-24 11:38:12,814::task::827::TaskManager.Task::(resourceAcquired) Task=`06635950-0504-4417-a9a7-d5dbd66d0ce6`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:38:12,814::task::990::TaskManager.Task::(_decref) Task=`06635950-0504-4417-a9a7-d5dbd66d0ce6`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:38:12,815::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:38:12,815::task::1185::TaskManager.Task::(prepare) Task=`06635950-0504-4417-a9a7-d5dbd66d0ce6`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:38:12,815::task::595::TaskManager.Task::(_updateState) Task=`06635950-0504-4417-a9a7-d5dbd66d0ce6`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:38:12,815::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:38:12,816::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:38:12,816::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:38:12,816::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:38:12,816::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:38:12,816::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:38:12,817::task::990::TaskManager.Task::(_decref) Task=`06635950-0504-4417-a9a7-d5dbd66d0ce6`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:38:12,838::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:38:12,848::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:38:12,848::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Dummy-33::DEBUG::2014-07-24 11:38:14,851::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:38:14,860::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:38:14,861::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Dummy-33::DEBUG::2014-07-24 11:38:16,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:38:16,873::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:38:16,873::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Dummy-33::DEBUG::2014-07-24 11:38:18,876::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:38:18,886::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:38:18,887::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-18::DEBUG::2014-07-24 11:38:19,212::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:38:19,224::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000730805 s, 5.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:38:20,219::task::595::TaskManager.Task::(_updateState) Task=`20286733-8cf7-402a-b8ea-8cfd80570f5e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:38:20,220::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:38:20,220::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000730805', 'lastCheck': '1.0', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:38:20,220::task::1185::TaskManager.Task::(prepare) Task=`20286733-8cf7-402a-b8ea-8cfd80570f5e`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000730805', 'lastCheck': '1.0', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:38:20,220::task::595::TaskManager.Task::(_updateState) Task=`20286733-8cf7-402a-b8ea-8cfd80570f5e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:38:20,220::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:38:20,220::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:38:20,221::task::990::TaskManager.Task::(_decref) Task=`20286733-8cf7-402a-b8ea-8cfd80570f5e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:38:20,889::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:38:20,899::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:38:20,900::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-14::DEBUG::2014-07-24 11:38:22,876::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:38:22,876::task::595::TaskManager.Task::(_updateState) Task=`a992db31-cf58-4843-b9a9-90c37345caf2`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:38:22,877::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:38:22,877::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:38:22,877::task::1185::TaskManager.Task::(prepare) Task=`a992db31-cf58-4843-b9a9-90c37345caf2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:38:22,877::task::595::TaskManager.Task::(_updateState) Task=`a992db31-cf58-4843-b9a9-90c37345caf2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:38:22,878::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:38:22,878::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:38:22,878::task::990::TaskManager.Task::(_decref) Task=`a992db31-cf58-4843-b9a9-90c37345caf2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:38:22,902::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:38:22,914::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:38:22,916::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-34::DEBUG::2014-07-24 11:38:22,916::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:38:22,918::task::595::TaskManager.Task::(_updateState) Task=`c0d703bd-ffcd-42d2-ac34-f1a54c307da5`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:38:22,918::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:38:22,919::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1770c353-971e-44b4-aa01-31358297d19b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:38:22,919::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:38:22,919::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:38:22,920::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1770c353-971e-44b4-aa01-31358297d19b`::Granted request >Thread-34::DEBUG::2014-07-24 11:38:22,920::task::827::TaskManager.Task::(resourceAcquired) Task=`c0d703bd-ffcd-42d2-ac34-f1a54c307da5`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:38:22,920::task::990::TaskManager.Task::(_decref) Task=`c0d703bd-ffcd-42d2-ac34-f1a54c307da5`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:38:22,921::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:38:22,921::task::1185::TaskManager.Task::(prepare) Task=`c0d703bd-ffcd-42d2-ac34-f1a54c307da5`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:38:22,921::task::595::TaskManager.Task::(_updateState) Task=`c0d703bd-ffcd-42d2-ac34-f1a54c307da5`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:38:22,922::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:38:22,922::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:38:22,922::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:38:22,922::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:38:22,922::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:38:22,922::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:38:22,923::task::990::TaskManager.Task::(_decref) Task=`c0d703bd-ffcd-42d2-ac34-f1a54c307da5`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:38:24,919::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:38:24,929::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:38:24,930::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Dummy-33::DEBUG::2014-07-24 11:38:26,932::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:38:26,942::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:38:26,943::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Dummy-33::DEBUG::2014-07-24 11:38:28,945::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:38:28,956::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:38:28,956::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-18::DEBUG::2014-07-24 11:38:29,229::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:38:29,240::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0006065 s, 6.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:38:30,859::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:38:30,959::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:38:30,969::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:38:30,969::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Dummy-33::DEBUG::2014-07-24 11:38:32,972::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:38:32,982::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:38:32,982::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-14::DEBUG::2014-07-24 11:38:32,983::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:38:32,984::task::595::TaskManager.Task::(_updateState) Task=`62e13d3f-4307-494e-aceb-24a571b943ab`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:38:32,984::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:38:32,984::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:38:32,985::task::1185::TaskManager.Task::(prepare) Task=`62e13d3f-4307-494e-aceb-24a571b943ab`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:38:32,985::task::595::TaskManager.Task::(_updateState) Task=`62e13d3f-4307-494e-aceb-24a571b943ab`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:38:32,985::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:38:32,985::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:38:32,985::task::990::TaskManager.Task::(_decref) Task=`62e13d3f-4307-494e-aceb-24a571b943ab`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:38:33,016::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:38:33,016::task::595::TaskManager.Task::(_updateState) Task=`27269931-4079-486d-85b7-fea7c22e91de`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:38:33,017::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:38:33,017::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ac7e836b-84f3-44ea-ac92-f87001ebbc53`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:38:33,017::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:38:33,017::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:38:33,018::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ac7e836b-84f3-44ea-ac92-f87001ebbc53`::Granted request >Thread-34::DEBUG::2014-07-24 11:38:33,018::task::827::TaskManager.Task::(resourceAcquired) Task=`27269931-4079-486d-85b7-fea7c22e91de`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:38:33,018::task::990::TaskManager.Task::(_decref) Task=`27269931-4079-486d-85b7-fea7c22e91de`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:38:33,019::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:38:33,019::task::1185::TaskManager.Task::(prepare) Task=`27269931-4079-486d-85b7-fea7c22e91de`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:38:33,019::task::595::TaskManager.Task::(_updateState) Task=`27269931-4079-486d-85b7-fea7c22e91de`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:38:33,019::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:38:33,019::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:38:33,020::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:38:33,020::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:38:33,020::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:38:33,020::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:38:33,021::task::990::TaskManager.Task::(_decref) Task=`27269931-4079-486d-85b7-fea7c22e91de`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:38:34,985::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:38:34,995::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:38:34,995::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-14::DEBUG::2014-07-24 11:38:35,612::task::595::TaskManager.Task::(_updateState) Task=`df590b81-1828-489b-a157-5cedf47797fd`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:38:35,612::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:38:35,613::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0006065', 'lastCheck': '6.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:38:35,613::task::1185::TaskManager.Task::(prepare) Task=`df590b81-1828-489b-a157-5cedf47797fd`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0006065', 'lastCheck': '6.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:38:35,613::task::595::TaskManager.Task::(_updateState) Task=`df590b81-1828-489b-a157-5cedf47797fd`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:38:35,613::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:38:35,613::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:38:35,613::task::990::TaskManager.Task::(_decref) Task=`df590b81-1828-489b-a157-5cedf47797fd`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:38:36,998::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:38:37,008::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:38:37,008::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Dummy-33::DEBUG::2014-07-24 11:38:39,011::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:38:39,021::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:38:39,021::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-18::DEBUG::2014-07-24 11:38:39,245::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:38:39,259::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00238377 s, 1.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:38:41,024::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:38:41,034::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:38:41,035::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Dummy-33::DEBUG::2014-07-24 11:38:43,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:38:43,047::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:38:43,048::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-14::DEBUG::2014-07-24 11:38:43,078::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:38:43,078::task::595::TaskManager.Task::(_updateState) Task=`f0a7bfff-a95c-42d3-a25d-c093f85eba48`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:38:43,078::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:38:43,079::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:38:43,079::task::1185::TaskManager.Task::(prepare) Task=`f0a7bfff-a95c-42d3-a25d-c093f85eba48`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:38:43,079::task::595::TaskManager.Task::(_updateState) Task=`f0a7bfff-a95c-42d3-a25d-c093f85eba48`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:38:43,079::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:38:43,079::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:38:43,080::task::990::TaskManager.Task::(_decref) Task=`f0a7bfff-a95c-42d3-a25d-c093f85eba48`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:38:43,111::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:38:43,111::task::595::TaskManager.Task::(_updateState) Task=`f3ae217c-e034-4885-a862-baa4954df5b2`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:38:43,111::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:38:43,112::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`bb790d3a-2cc5-4407-a282-3ef9cba1721c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:38:43,112::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:38:43,112::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:38:43,112::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`bb790d3a-2cc5-4407-a282-3ef9cba1721c`::Granted request >Thread-34::DEBUG::2014-07-24 11:38:43,113::task::827::TaskManager.Task::(resourceAcquired) Task=`f3ae217c-e034-4885-a862-baa4954df5b2`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:38:43,113::task::990::TaskManager.Task::(_decref) Task=`f3ae217c-e034-4885-a862-baa4954df5b2`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:38:43,114::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:38:43,114::task::1185::TaskManager.Task::(prepare) Task=`f3ae217c-e034-4885-a862-baa4954df5b2`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:38:43,114::task::595::TaskManager.Task::(_updateState) Task=`f3ae217c-e034-4885-a862-baa4954df5b2`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:38:43,114::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:38:43,114::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:38:43,115::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:38:43,115::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:38:43,115::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:38:43,115::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:38:43,115::task::990::TaskManager.Task::(_decref) Task=`f3ae217c-e034-4885-a862-baa4954df5b2`::ref 0 aborting False >Thread-37::INFO::2014-07-24 11:38:44,860::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 4847631872, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:38:44,861::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:38:44,861::task::595::TaskManager.Task::(_updateState) Task=`3e72f0d9-fbc7-4c39-90e2-eb7d392eca42`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:38:44,862::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:38:44,862::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:38:44,862::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:38:44,863::task::1185::TaskManager.Task::(prepare) Task=`3e72f0d9-fbc7-4c39-90e2-eb7d392eca42`::finished: None >Thread-27::DEBUG::2014-07-24 11:38:44,863::storage_mailbox::426::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - start: 64, end: 128, len: 4096, message(1/63): '1xtnd\x8fE\x83\x19\xaa\x18\xaa\xa4\x82H\xc3\xed\x06\x06\xaa#\xe2\x9b\xed\xae\xc5bR\xb3\x85K\x9f\xe2\xee\xa0\x8c\xe1000000000000180000000000000' >Thread-37::DEBUG::2014-07-24 11:38:44,863::task::595::TaskManager.Task::(_updateState) Task=`3e72f0d9-fbc7-4c39-90e2-eb7d392eca42`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:38:44,864::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:38:44,865::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-27::DEBUG::2014-07-24 11:38:44,865::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-37::DEBUG::2014-07-24 11:38:44,873::task::990::TaskManager.Task::(_decref) Task=`3e72f0d9-fbc7-4c39-90e2-eb7d392eca42`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:38:45,050::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:38:45,060::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:38:45,061::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:38:45,087::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.210009 s, 19.5 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:38:45,087::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:38:45,087::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:38:45,104::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00573661 s, 714 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:38:46,878::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 4847631872, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:38:46,879::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:38:46,880::task::595::TaskManager.Task::(_updateState) Task=`9aabd523-0382-4f75-8c48-eb9d697b189c`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:38:46,880::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:38:46,880::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:38:46,881::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:38:46,881::task::1185::TaskManager.Task::(prepare) Task=`9aabd523-0382-4f75-8c48-eb9d697b189c`::finished: None >Thread-37::DEBUG::2014-07-24 11:38:46,881::task::595::TaskManager.Task::(_updateState) Task=`9aabd523-0382-4f75-8c48-eb9d697b189c`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:38:46,881::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:38:46,881::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:38:46,881::task::990::TaskManager.Task::(_decref) Task=`9aabd523-0382-4f75-8c48-eb9d697b189c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:38:47,063::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:38:47,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:38:47,074::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:38:47,107::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b28056248> >Thread-27::DEBUG::2014-07-24 11:38:47,107::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:38:47,478::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.360217 s, 11.4 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:38:47,479::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:38:47,479::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:38:47,494::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00463156 s, 884 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:38:48,885::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 4847631872, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:38:48,885::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:38:48,886::task::595::TaskManager.Task::(_updateState) Task=`29641cce-ce7a-4c07-b55f-16dec7c4381c`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:38:48,886::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:38:48,886::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:38:48,886::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:38:48,886::task::1185::TaskManager.Task::(prepare) Task=`29641cce-ce7a-4c07-b55f-16dec7c4381c`::finished: None >Thread-37::DEBUG::2014-07-24 11:38:48,887::task::595::TaskManager.Task::(_updateState) Task=`29641cce-ce7a-4c07-b55f-16dec7c4381c`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:38:48,887::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:38:48,887::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:38:48,887::task::990::TaskManager.Task::(_decref) Task=`29641cce-ce7a-4c07-b55f-16dec7c4381c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:38:49,076::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:38:49,087::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:38:49,088::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-18::DEBUG::2014-07-24 11:38:49,264::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:38:49,292::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0172864 s, 237 kB/s\n'; <rc> = 0 >Thread-27::DEBUG::2014-07-24 11:38:49,497::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b281376c8> >Thread-27::DEBUG::2014-07-24 11:38:49,497::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:38:49,709::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.200976 s, 20.4 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:38:49,710::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:38:49,710::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:38:49,724::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00429427 s, 954 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:38:50,891::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 4847631872, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:38:50,891::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:38:50,891::task::595::TaskManager.Task::(_updateState) Task=`5012e426-2b54-4b0d-aca1-9567b8adf2d8`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:38:50,892::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:38:50,892::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:38:50,892::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:38:50,892::task::1185::TaskManager.Task::(prepare) Task=`5012e426-2b54-4b0d-aca1-9567b8adf2d8`::finished: None >Thread-37::DEBUG::2014-07-24 11:38:50,892::task::595::TaskManager.Task::(_updateState) Task=`5012e426-2b54-4b0d-aca1-9567b8adf2d8`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:38:50,893::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:38:50,893::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:38:50,893::task::990::TaskManager.Task::(_decref) Task=`5012e426-2b54-4b0d-aca1-9567b8adf2d8`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 11:38:50,989::task::595::TaskManager.Task::(_updateState) Task=`ab43481c-0527-4127-98e4-321370c92b48`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:38:50,989::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:38:50,989::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0172864', 'lastCheck': '1.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:38:50,990::task::1185::TaskManager.Task::(prepare) Task=`ab43481c-0527-4127-98e4-321370c92b48`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0172864', 'lastCheck': '1.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:38:50,990::task::595::TaskManager.Task::(_updateState) Task=`ab43481c-0527-4127-98e4-321370c92b48`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:38:50,990::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:38:50,990::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:38:50,990::task::990::TaskManager.Task::(_decref) Task=`ab43481c-0527-4127-98e4-321370c92b48`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:38:51,090::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:38:51,101::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:38:51,102::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:38:51,727::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b28127a28> >Thread-27::DEBUG::2014-07-24 11:38:51,727::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:38:52,098::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.359943 s, 11.4 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:38:52,099::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:38:52,099::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:38:52,113::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0042274 s, 969 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:38:52,902::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 4847631872, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:38:52,902::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:38:52,903::task::595::TaskManager.Task::(_updateState) Task=`c01e573e-2a1c-4aae-91e4-1150a477d414`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:38:52,903::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:38:52,903::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:38:52,903::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:38:52,903::task::1185::TaskManager.Task::(prepare) Task=`c01e573e-2a1c-4aae-91e4-1150a477d414`::finished: None >Thread-37::DEBUG::2014-07-24 11:38:52,904::task::595::TaskManager.Task::(_updateState) Task=`c01e573e-2a1c-4aae-91e4-1150a477d414`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:38:52,904::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:38:52,904::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:38:52,904::task::990::TaskManager.Task::(_decref) Task=`c01e573e-2a1c-4aae-91e4-1150a477d414`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:38:53,105::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:38:53,116::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:38:53,117::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-14::DEBUG::2014-07-24 11:38:53,172::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:38:53,172::task::595::TaskManager.Task::(_updateState) Task=`40b40d42-5a0f-4fe9-97fb-e92482b6ebd3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:38:53,172::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:38:53,173::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:38:53,173::task::1185::TaskManager.Task::(prepare) Task=`40b40d42-5a0f-4fe9-97fb-e92482b6ebd3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:38:53,173::task::595::TaskManager.Task::(_updateState) Task=`40b40d42-5a0f-4fe9-97fb-e92482b6ebd3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:38:53,173::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:38:53,174::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:38:53,174::task::990::TaskManager.Task::(_decref) Task=`40b40d42-5a0f-4fe9-97fb-e92482b6ebd3`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:38:53,204::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:38:53,204::task::595::TaskManager.Task::(_updateState) Task=`d5802ced-dcb6-4897-a92f-c47777265889`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:38:53,205::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:38:53,206::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`392c2952-66a1-416d-b28f-1c064eeb714d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:38:53,206::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:38:53,206::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:38:53,207::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`392c2952-66a1-416d-b28f-1c064eeb714d`::Granted request >Thread-34::DEBUG::2014-07-24 11:38:53,207::task::827::TaskManager.Task::(resourceAcquired) Task=`d5802ced-dcb6-4897-a92f-c47777265889`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:38:53,207::task::990::TaskManager.Task::(_decref) Task=`d5802ced-dcb6-4897-a92f-c47777265889`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:38:53,208::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:38:53,208::task::1185::TaskManager.Task::(prepare) Task=`d5802ced-dcb6-4897-a92f-c47777265889`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:38:53,208::task::595::TaskManager.Task::(_updateState) Task=`d5802ced-dcb6-4897-a92f-c47777265889`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:38:53,208::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:38:53,209::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:38:53,209::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:38:53,209::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:38:53,209::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:38:53,209::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:38:53,210::task::990::TaskManager.Task::(_decref) Task=`d5802ced-dcb6-4897-a92f-c47777265889`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:38:54,116::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8ac83183b0> >Thread-27::DEBUG::2014-07-24 11:38:54,116::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:38:54,326::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.198267 s, 20.7 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:38:54,326::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:38:54,326::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:38:54,341::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00436344 s, 939 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:38:54,908::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 4847631872, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:38:54,908::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:38:54,909::task::595::TaskManager.Task::(_updateState) Task=`b36f27b7-c0a6-4bef-a436-c4ab292c0e31`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:38:54,909::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:38:54,909::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:38:54,909::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:38:54,909::task::1185::TaskManager.Task::(prepare) Task=`b36f27b7-c0a6-4bef-a436-c4ab292c0e31`::finished: None >Thread-37::DEBUG::2014-07-24 11:38:54,910::task::595::TaskManager.Task::(_updateState) Task=`b36f27b7-c0a6-4bef-a436-c4ab292c0e31`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:38:54,910::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:38:54,910::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:38:54,910::task::990::TaskManager.Task::(_decref) Task=`b36f27b7-c0a6-4bef-a436-c4ab292c0e31`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:38:55,119::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:38:55,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:38:55,130::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:38:56,344::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b28137f38> >Thread-27::DEBUG::2014-07-24 11:38:56,344::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:38:56,389::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0336114 s, 122 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:38:56,390::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:38:56,390::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:38:56,410::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00994564 s, 412 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:38:56,914::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 4900781568, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:38:56,914::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:38:56,914::task::595::TaskManager.Task::(_updateState) Task=`d9a82627-48f9-4104-9280-69b32c21494a`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:38:56,915::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:38:56,915::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:38:56,915::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:38:56,915::task::1185::TaskManager.Task::(prepare) Task=`d9a82627-48f9-4104-9280-69b32c21494a`::finished: None >Thread-37::DEBUG::2014-07-24 11:38:56,915::task::595::TaskManager.Task::(_updateState) Task=`d9a82627-48f9-4104-9280-69b32c21494a`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:38:56,915::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:38:56,916::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:38:56,916::task::990::TaskManager.Task::(_decref) Task=`d9a82627-48f9-4104-9280-69b32c21494a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:38:57,132::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:38:57,144::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:38:57,144::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:38:58,413::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b141a6cb0> >Thread-27::DEBUG::2014-07-24 11:38:58,413::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:38:58,745::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.321195 s, 12.8 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:38:58,746::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:38:58,746::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:38:58,761::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00438977 s, 933 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:38:58,920::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 4942200320, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:38:58,920::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:38:58,921::task::595::TaskManager.Task::(_updateState) Task=`2c1d692c-affc-428d-b137-26dfeadbe083`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:38:58,921::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:38:58,921::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:38:58,921::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:38:58,921::task::1185::TaskManager.Task::(prepare) Task=`2c1d692c-affc-428d-b137-26dfeadbe083`::finished: None >Thread-37::DEBUG::2014-07-24 11:38:58,922::task::595::TaskManager.Task::(_updateState) Task=`2c1d692c-affc-428d-b137-26dfeadbe083`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:38:58,922::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:38:58,922::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:38:58,922::task::990::TaskManager.Task::(_decref) Task=`2c1d692c-affc-428d-b137-26dfeadbe083`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:38:59,147::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:38:59,157::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:38:59,158::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-18::DEBUG::2014-07-24 11:38:59,297::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:38:59,308::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000631002 s, 6.5 MB/s\n'; <rc> = 0 >Thread-27::DEBUG::2014-07-24 11:39:00,763::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b280b4560> >Thread-27::DEBUG::2014-07-24 11:39:00,764::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >VM Channels Listener::DEBUG::2014-07-24 11:39:00,896::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-37::INFO::2014-07-24 11:39:00,926::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 4942200320, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:39:00,926::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:39:00,927::task::595::TaskManager.Task::(_updateState) Task=`aae2b2b6-f184-4455-a60e-bdbda68fa6b9`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:39:00,927::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:39:00,927::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:39:00,927::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:39:00,927::task::1185::TaskManager.Task::(prepare) Task=`aae2b2b6-f184-4455-a60e-bdbda68fa6b9`::finished: None >Thread-37::DEBUG::2014-07-24 11:39:00,928::task::595::TaskManager.Task::(_updateState) Task=`aae2b2b6-f184-4455-a60e-bdbda68fa6b9`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:39:00,928::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:39:00,928::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:39:00,928::task::990::TaskManager.Task::(_decref) Task=`aae2b2b6-f184-4455-a60e-bdbda68fa6b9`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:39:01,015::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.240594 s, 17.0 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:39:01,015::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:39:01,016::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:01,033::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00684043 s, 599 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:39:01,160::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:39:01,170::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:39:01,170::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-37::INFO::2014-07-24 11:39:02,932::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 4982504960, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:39:02,932::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:39:02,932::task::595::TaskManager.Task::(_updateState) Task=`771b15d1-ca67-4920-bdc8-2095e072b6b6`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:39:02,933::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:39:02,933::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:39:02,933::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:39:02,933::task::1185::TaskManager.Task::(prepare) Task=`771b15d1-ca67-4920-bdc8-2095e072b6b6`::finished: None >Thread-37::DEBUG::2014-07-24 11:39:02,933::task::595::TaskManager.Task::(_updateState) Task=`771b15d1-ca67-4920-bdc8-2095e072b6b6`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:39:02,934::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:39:02,934::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:39:02,934::task::990::TaskManager.Task::(_decref) Task=`771b15d1-ca67-4920-bdc8-2095e072b6b6`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:39:03,036::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b28052320> >Thread-27::DEBUG::2014-07-24 11:39:03,036::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b28052758> >Thread-27::DEBUG::2014-07-24 11:39:03,036::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:39:03,173::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:39:03,184::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:39:03,184::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-14::DEBUG::2014-07-24 11:39:03,262::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:39:03,263::task::595::TaskManager.Task::(_updateState) Task=`76321127-a943-434d-85dc-87f663823fc4`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:39:03,263::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:39:03,263::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:39:03,264::task::1185::TaskManager.Task::(prepare) Task=`76321127-a943-434d-85dc-87f663823fc4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:39:03,264::task::595::TaskManager.Task::(_updateState) Task=`76321127-a943-434d-85dc-87f663823fc4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:39:03,264::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:39:03,264::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:39:03,264::task::990::TaskManager.Task::(_decref) Task=`76321127-a943-434d-85dc-87f663823fc4`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:39:03,296::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:39:03,296::task::595::TaskManager.Task::(_updateState) Task=`156896ba-65f3-49f0-8343-497ce0e80989`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:39:03,296::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:39:03,297::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e9b2e053-e5cf-4bf2-890b-31ffbdeb2f5e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:39:03,297::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:39:03,297::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:39:03,297::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e9b2e053-e5cf-4bf2-890b-31ffbdeb2f5e`::Granted request >Thread-34::DEBUG::2014-07-24 11:39:03,298::task::827::TaskManager.Task::(resourceAcquired) Task=`156896ba-65f3-49f0-8343-497ce0e80989`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:39:03,298::task::990::TaskManager.Task::(_decref) Task=`156896ba-65f3-49f0-8343-497ce0e80989`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:39:03,299::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:39:03,299::task::1185::TaskManager.Task::(prepare) Task=`156896ba-65f3-49f0-8343-497ce0e80989`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:39:03,299::task::595::TaskManager.Task::(_updateState) Task=`156896ba-65f3-49f0-8343-497ce0e80989`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:39:03,299::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:39:03,299::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:39:03,300::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:39:03,300::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:39:03,300::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:39:03,300::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:39:03,300::task::990::TaskManager.Task::(_decref) Task=`156896ba-65f3-49f0-8343-497ce0e80989`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:39:03,407::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.360153 s, 11.4 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:39:03,407::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:39:03,408::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:03,423::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00425493 s, 963 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:39:04,937::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 4982504960, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:39:04,938::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:39:04,938::task::595::TaskManager.Task::(_updateState) Task=`72a8e037-67e9-49ff-81ac-44aa7143831f`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:39:04,938::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:39:04,939::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:39:04,939::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:39:04,939::task::1185::TaskManager.Task::(prepare) Task=`72a8e037-67e9-49ff-81ac-44aa7143831f`::finished: None >Thread-37::DEBUG::2014-07-24 11:39:04,939::task::595::TaskManager.Task::(_updateState) Task=`72a8e037-67e9-49ff-81ac-44aa7143831f`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:39:04,939::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:39:04,939::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:39:04,940::task::990::TaskManager.Task::(_decref) Task=`72a8e037-67e9-49ff-81ac-44aa7143831f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:39:05,187::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:39:05,197::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:39:05,197::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:39:05,426::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b28063a28> >Thread-27::DEBUG::2014-07-24 11:39:05,426::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:05,678::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.241238 s, 17.0 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:39:05,679::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:39:05,679::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:05,694::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00461725 s, 887 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:39:06,412::task::595::TaskManager.Task::(_updateState) Task=`08dbf4cc-c1b7-4deb-8667-092082ea87ee`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:39:06,412::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:39:06,412::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631002', 'lastCheck': '7.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:39:06,412::task::1185::TaskManager.Task::(prepare) Task=`08dbf4cc-c1b7-4deb-8667-092082ea87ee`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000631002', 'lastCheck': '7.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:39:06,413::task::595::TaskManager.Task::(_updateState) Task=`08dbf4cc-c1b7-4deb-8667-092082ea87ee`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:39:06,413::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:39:06,413::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:39:06,413::task::990::TaskManager.Task::(_decref) Task=`08dbf4cc-c1b7-4deb-8667-092082ea87ee`::ref 0 aborting False >Thread-37::INFO::2014-07-24 11:39:06,943::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 4982504960, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:39:06,943::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:39:06,944::task::595::TaskManager.Task::(_updateState) Task=`0fad8fcb-1dce-4db8-9460-0e6aa0fe940c`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:39:06,944::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:39:06,944::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:39:06,944::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:39:06,944::task::1185::TaskManager.Task::(prepare) Task=`0fad8fcb-1dce-4db8-9460-0e6aa0fe940c`::finished: None >Thread-37::DEBUG::2014-07-24 11:39:06,945::task::595::TaskManager.Task::(_updateState) Task=`0fad8fcb-1dce-4db8-9460-0e6aa0fe940c`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:39:06,945::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:39:06,945::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:39:06,945::task::990::TaskManager.Task::(_decref) Task=`0fad8fcb-1dce-4db8-9460-0e6aa0fe940c`::ref 0 aborting False >Thread-37::DEBUG::2014-07-24 11:39:06,946::task::595::TaskManager.Task::(_updateState) Task=`0cd5cf0e-f354-44ec-b2cf-0d8f43cea632`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:39:06,946::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:39:06,946::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-37::DEBUG::2014-07-24 11:39:06,946::task::1185::TaskManager.Task::(prepare) Task=`0cd5cf0e-f354-44ec-b2cf-0d8f43cea632`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-37::DEBUG::2014-07-24 11:39:06,946::task::595::TaskManager.Task::(_updateState) Task=`0cd5cf0e-f354-44ec-b2cf-0d8f43cea632`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:39:06,947::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:39:06,947::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:39:06,947::task::990::TaskManager.Task::(_decref) Task=`0cd5cf0e-f354-44ec-b2cf-0d8f43cea632`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:39:07,200::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:39:07,210::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:39:07,210::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:39:07,696::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b28063638> >Thread-27::DEBUG::2014-07-24 11:39:07,697::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:07,933::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.225244 s, 18.2 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:39:07,934::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:39:07,943::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:07,958::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0041269 s, 993 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:39:08,978::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 4982504960, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:39:08,978::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:39:08,978::task::595::TaskManager.Task::(_updateState) Task=`5cc0299a-7749-4483-bca5-5df05cd21f65`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:39:08,979::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:39:08,979::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:39:08,979::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:39:08,979::task::1185::TaskManager.Task::(prepare) Task=`5cc0299a-7749-4483-bca5-5df05cd21f65`::finished: None >Thread-37::DEBUG::2014-07-24 11:39:08,979::task::595::TaskManager.Task::(_updateState) Task=`5cc0299a-7749-4483-bca5-5df05cd21f65`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:39:08,980::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:39:08,980::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:39:08,980::task::990::TaskManager.Task::(_decref) Task=`5cc0299a-7749-4483-bca5-5df05cd21f65`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:39:09,213::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:39:09,224::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:39:09,224::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-18::DEBUG::2014-07-24 11:39:09,313::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:39:09,324::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0006377 s, 6.4 MB/s\n'; <rc> = 0 >Thread-27::DEBUG::2014-07-24 11:39:09,960::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b280564d0> >Thread-27::DEBUG::2014-07-24 11:39:09,960::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:10,172::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.201183 s, 20.4 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:39:10,173::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:39:10,173::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:10,188::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00416828 s, 983 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:39:10,984::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 4997316096, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:39:10,984::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:39:10,984::task::595::TaskManager.Task::(_updateState) Task=`24296729-82f9-4ae6-a49d-cdc05a4fe270`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:39:10,985::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:39:10,985::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:39:10,985::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:39:10,985::task::1185::TaskManager.Task::(prepare) Task=`24296729-82f9-4ae6-a49d-cdc05a4fe270`::finished: None >Thread-37::DEBUG::2014-07-24 11:39:10,985::task::595::TaskManager.Task::(_updateState) Task=`24296729-82f9-4ae6-a49d-cdc05a4fe270`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:39:10,986::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:39:10,986::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:39:10,986::task::990::TaskManager.Task::(_decref) Task=`24296729-82f9-4ae6-a49d-cdc05a4fe270`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:39:11,227::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:39:11,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:39:11,243::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:39:12,191::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b280ad4d0> >Thread-27::DEBUG::2014-07-24 11:39:12,191::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:12,563::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.360212 s, 11.4 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:39:12,563::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:39:12,563::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:12,579::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00533562 s, 768 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:39:12,998::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 4997316096, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:39:12,999::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:39:12,999::task::595::TaskManager.Task::(_updateState) Task=`1ec6b2ac-d781-4709-90c6-473a007ae3ca`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:39:12,999::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:39:13,000::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:39:13,000::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:39:13,000::task::1185::TaskManager.Task::(prepare) Task=`1ec6b2ac-d781-4709-90c6-473a007ae3ca`::finished: None >Thread-37::DEBUG::2014-07-24 11:39:13,000::task::595::TaskManager.Task::(_updateState) Task=`1ec6b2ac-d781-4709-90c6-473a007ae3ca`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:39:13,000::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:39:13,000::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:39:13,001::task::990::TaskManager.Task::(_decref) Task=`1ec6b2ac-d781-4709-90c6-473a007ae3ca`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:39:13,247::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:39:13,261::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:39:13,263::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-14::DEBUG::2014-07-24 11:39:13,357::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:39:13,357::task::595::TaskManager.Task::(_updateState) Task=`80ea2125-c9a9-44f3-b8f1-b285dacda5fe`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:39:13,357::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:39:13,358::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:39:13,358::task::1185::TaskManager.Task::(prepare) Task=`80ea2125-c9a9-44f3-b8f1-b285dacda5fe`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:39:13,358::task::595::TaskManager.Task::(_updateState) Task=`80ea2125-c9a9-44f3-b8f1-b285dacda5fe`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:39:13,358::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:39:13,358::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:39:13,359::task::990::TaskManager.Task::(_decref) Task=`80ea2125-c9a9-44f3-b8f1-b285dacda5fe`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:39:13,391::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:39:13,391::task::595::TaskManager.Task::(_updateState) Task=`dbc440af-51f0-48a0-995e-b349bbd8a56a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:39:13,391::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:39:13,392::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`2fabeaef-0a41-4106-a508-df918a3ef3f7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:39:13,392::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:39:13,392::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:39:13,392::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`2fabeaef-0a41-4106-a508-df918a3ef3f7`::Granted request >Thread-34::DEBUG::2014-07-24 11:39:13,393::task::827::TaskManager.Task::(resourceAcquired) Task=`dbc440af-51f0-48a0-995e-b349bbd8a56a`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:39:13,393::task::990::TaskManager.Task::(_decref) Task=`dbc440af-51f0-48a0-995e-b349bbd8a56a`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:39:13,393::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:39:13,394::task::1185::TaskManager.Task::(prepare) Task=`dbc440af-51f0-48a0-995e-b349bbd8a56a`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:39:13,394::task::595::TaskManager.Task::(_updateState) Task=`dbc440af-51f0-48a0-995e-b349bbd8a56a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:39:13,394::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:39:13,394::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:39:13,394::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:39:13,395::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:39:13,395::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:39:13,395::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:39:13,395::task::990::TaskManager.Task::(_decref) Task=`dbc440af-51f0-48a0-995e-b349bbd8a56a`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:39:14,581::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b28052ea8> >Thread-27::DEBUG::2014-07-24 11:39:14,582::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:14,599::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00545907 s, 750 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:39:14,599::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:39:14,600::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:14,667::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0563275 s, 72.7 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:39:15,004::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5029363200, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:39:15,004::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:39:15,005::task::595::TaskManager.Task::(_updateState) Task=`2735051c-b588-4827-b650-50af7daba01b`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:39:15,005::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:39:15,005::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:39:15,006::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:39:15,006::task::1185::TaskManager.Task::(prepare) Task=`2735051c-b588-4827-b650-50af7daba01b`::finished: None >Thread-37::DEBUG::2014-07-24 11:39:15,006::task::595::TaskManager.Task::(_updateState) Task=`2735051c-b588-4827-b650-50af7daba01b`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:39:15,006::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:39:15,006::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:39:15,007::task::990::TaskManager.Task::(_decref) Task=`2735051c-b588-4827-b650-50af7daba01b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:39:15,267::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:39:15,279::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:39:15,280::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:39:16,669::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b280d9ef0> >Thread-27::DEBUG::2014-07-24 11:39:16,670::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-37::INFO::2014-07-24 11:39:17,010::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5029363200, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:39:17,010::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:39:17,011::task::595::TaskManager.Task::(_updateState) Task=`e2e88203-61ed-4c9e-8c73-0d39944b8721`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:39:17,011::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:39:17,011::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:39:17,011::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:39:17,012::task::1185::TaskManager.Task::(prepare) Task=`e2e88203-61ed-4c9e-8c73-0d39944b8721`::finished: None >Thread-37::DEBUG::2014-07-24 11:39:17,012::task::595::TaskManager.Task::(_updateState) Task=`e2e88203-61ed-4c9e-8c73-0d39944b8721`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:39:17,012::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:39:17,012::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:39:17,012::task::990::TaskManager.Task::(_decref) Task=`e2e88203-61ed-4c9e-8c73-0d39944b8721`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:39:17,041::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.360134 s, 11.4 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:39:17,041::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:39:17,042::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:17,057::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0045365 s, 903 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:39:17,284::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:39:17,296::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:39:17,298::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-37::INFO::2014-07-24 11:39:19,016::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5029363200, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:39:19,016::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:39:19,017::task::595::TaskManager.Task::(_updateState) Task=`66dd2e7d-96a2-4300-8e1b-852c2580e778`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:39:19,017::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:39:19,017::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:39:19,017::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:39:19,017::task::1185::TaskManager.Task::(prepare) Task=`66dd2e7d-96a2-4300-8e1b-852c2580e778`::finished: None >Thread-37::DEBUG::2014-07-24 11:39:19,018::task::595::TaskManager.Task::(_updateState) Task=`66dd2e7d-96a2-4300-8e1b-852c2580e778`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:39:19,018::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:39:19,018::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:39:19,018::task::990::TaskManager.Task::(_decref) Task=`66dd2e7d-96a2-4300-8e1b-852c2580e778`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:39:19,059::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b2813c710> >Thread-27::DEBUG::2014-07-24 11:39:19,060::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b28063e18> >Thread-27::DEBUG::2014-07-24 11:39:19,060::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:39:19,301::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:39:19,315::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:39:19,316::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-18::DEBUG::2014-07-24 11:39:19,329::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:39:19,342::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000539937 s, 7.6 MB/s\n'; <rc> = 0 >Thread-27::DEBUG::2014-07-24 11:39:19,346::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.269783 s, 15.2 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:39:19,348::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:39:19,350::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:20,363::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00247 s, 4.1 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:39:21,022::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5029363200, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:39:21,022::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:39:21,023::task::595::TaskManager.Task::(_updateState) Task=`067bcf3e-6fae-4574-a940-a74b8c7f5058`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:39:21,023::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:39:21,023::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:39:21,023::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:39:21,024::task::1185::TaskManager.Task::(prepare) Task=`067bcf3e-6fae-4574-a940-a74b8c7f5058`::finished: None >Thread-37::DEBUG::2014-07-24 11:39:21,024::task::595::TaskManager.Task::(_updateState) Task=`067bcf3e-6fae-4574-a940-a74b8c7f5058`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:39:21,024::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:39:21,024::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:39:21,024::task::990::TaskManager.Task::(_decref) Task=`067bcf3e-6fae-4574-a940-a74b8c7f5058`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:39:21,319::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:39:21,332::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:39:21,333::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-14::DEBUG::2014-07-24 11:39:21,776::task::595::TaskManager.Task::(_updateState) Task=`e67acaa9-9eb8-4e8e-9846-83e2be7ed29b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:39:21,776::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:39:21,776::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000539937', 'lastCheck': '2.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:39:21,776::task::1185::TaskManager.Task::(prepare) Task=`e67acaa9-9eb8-4e8e-9846-83e2be7ed29b`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000539937', 'lastCheck': '2.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:39:21,776::task::595::TaskManager.Task::(_updateState) Task=`e67acaa9-9eb8-4e8e-9846-83e2be7ed29b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:39:21,777::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:39:21,777::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:39:21,777::task::990::TaskManager.Task::(_decref) Task=`e67acaa9-9eb8-4e8e-9846-83e2be7ed29b`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:39:22,366::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b2809c638> >Thread-27::DEBUG::2014-07-24 11:39:22,366::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:22,657::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.279993 s, 14.6 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:39:22,658::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:39:22,658::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:22,672::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00441733 s, 927 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:39:23,033::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5029363200, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:39:23,034::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:39:23,034::task::595::TaskManager.Task::(_updateState) Task=`15232de5-2ae4-4b35-b5bf-e1ee8099bf0b`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:39:23,035::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:39:23,035::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:39:23,035::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:39:23,035::task::1185::TaskManager.Task::(prepare) Task=`15232de5-2ae4-4b35-b5bf-e1ee8099bf0b`::finished: None >Thread-37::DEBUG::2014-07-24 11:39:23,035::task::595::TaskManager.Task::(_updateState) Task=`15232de5-2ae4-4b35-b5bf-e1ee8099bf0b`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:39:23,035::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:39:23,036::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:39:23,036::task::990::TaskManager.Task::(_decref) Task=`15232de5-2ae4-4b35-b5bf-e1ee8099bf0b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:39:23,337::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:39:23,350::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:39:23,351::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-14::DEBUG::2014-07-24 11:39:23,450::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:39:23,450::task::595::TaskManager.Task::(_updateState) Task=`8bffcdbf-e82f-4af9-9e73-3f090e533077`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:39:23,451::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:39:23,451::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:39:23,451::task::1185::TaskManager.Task::(prepare) Task=`8bffcdbf-e82f-4af9-9e73-3f090e533077`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:39:23,451::task::595::TaskManager.Task::(_updateState) Task=`8bffcdbf-e82f-4af9-9e73-3f090e533077`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:39:23,451::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:39:23,452::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:39:23,452::task::990::TaskManager.Task::(_decref) Task=`8bffcdbf-e82f-4af9-9e73-3f090e533077`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:39:23,482::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:39:23,482::task::595::TaskManager.Task::(_updateState) Task=`2f49f8fa-dbd1-4c0f-9dc0-e8d1fd633ccb`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:39:23,482::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:39:23,483::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1d9d3e9d-51a2-4aec-9611-91c9b980b1cf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:39:23,483::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:39:23,483::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:39:23,483::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1d9d3e9d-51a2-4aec-9611-91c9b980b1cf`::Granted request >Thread-34::DEBUG::2014-07-24 11:39:23,483::task::827::TaskManager.Task::(resourceAcquired) Task=`2f49f8fa-dbd1-4c0f-9dc0-e8d1fd633ccb`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:39:23,484::task::990::TaskManager.Task::(_decref) Task=`2f49f8fa-dbd1-4c0f-9dc0-e8d1fd633ccb`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:39:23,484::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:39:23,485::task::1185::TaskManager.Task::(prepare) Task=`2f49f8fa-dbd1-4c0f-9dc0-e8d1fd633ccb`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:39:23,485::task::595::TaskManager.Task::(_updateState) Task=`2f49f8fa-dbd1-4c0f-9dc0-e8d1fd633ccb`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:39:23,485::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:39:23,485::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:39:23,485::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:39:23,485::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:39:23,486::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:39:23,486::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:39:23,486::task::990::TaskManager.Task::(_decref) Task=`2f49f8fa-dbd1-4c0f-9dc0-e8d1fd633ccb`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:39:24,675::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8ac8043ab8> >Thread-27::DEBUG::2014-07-24 11:39:24,675::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-37::INFO::2014-07-24 11:39:25,040::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5029363200, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:39:25,040::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:39:25,040::task::595::TaskManager.Task::(_updateState) Task=`63192d09-1a99-498b-b4e5-46dcf515906a`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:39:25,041::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:39:25,041::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:39:25,041::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:39:25,041::task::1185::TaskManager.Task::(prepare) Task=`63192d09-1a99-498b-b4e5-46dcf515906a`::finished: None >Thread-37::DEBUG::2014-07-24 11:39:25,041::task::595::TaskManager.Task::(_updateState) Task=`63192d09-1a99-498b-b4e5-46dcf515906a`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:39:25,041::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:39:25,042::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:39:25,042::task::990::TaskManager.Task::(_decref) Task=`63192d09-1a99-498b-b4e5-46dcf515906a`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:39:25,047::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.360705 s, 11.4 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:39:25,047::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:39:25,048::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:25,064::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00582783 s, 703 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:39:25,355::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:39:25,367::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:39:25,368::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-37::INFO::2014-07-24 11:39:27,045::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5029363200, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:39:27,046::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:39:27,046::task::595::TaskManager.Task::(_updateState) Task=`03c4b983-ed89-4aa2-9154-2cf00591f52c`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:39:27,046::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:39:27,047::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:39:27,047::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:39:27,047::task::1185::TaskManager.Task::(prepare) Task=`03c4b983-ed89-4aa2-9154-2cf00591f52c`::finished: None >Thread-37::DEBUG::2014-07-24 11:39:27,047::task::595::TaskManager.Task::(_updateState) Task=`03c4b983-ed89-4aa2-9154-2cf00591f52c`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:39:27,047::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:39:27,047::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:39:27,048::task::990::TaskManager.Task::(_decref) Task=`03c4b983-ed89-4aa2-9154-2cf00591f52c`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:39:27,067::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8ac8318f80> >Thread-27::DEBUG::2014-07-24 11:39:27,067::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b28055fc8> >Thread-27::DEBUG::2014-07-24 11:39:27,067::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:39:27,372::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:39:27,385::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:39:27,386::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:39:27,438::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.360051 s, 11.4 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:39:27,438::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:39:27,439::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:27,455::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00471877 s, 868 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:39:29,051::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5029363200, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:39:29,051::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:39:29,052::task::595::TaskManager.Task::(_updateState) Task=`d1b0ba17-c244-4597-bfc4-bde2309a6ea8`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:39:29,052::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:39:29,052::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:39:29,053::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:39:29,053::task::1185::TaskManager.Task::(prepare) Task=`d1b0ba17-c244-4597-bfc4-bde2309a6ea8`::finished: None >Thread-37::DEBUG::2014-07-24 11:39:29,053::task::595::TaskManager.Task::(_updateState) Task=`d1b0ba17-c244-4597-bfc4-bde2309a6ea8`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:39:29,053::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:39:29,053::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:39:29,053::task::990::TaskManager.Task::(_decref) Task=`d1b0ba17-c244-4597-bfc4-bde2309a6ea8`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:39:29,369::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:39:29,386::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000660521 s, 6.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:39:29,394::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:39:29,415::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:39:29,418::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:39:29,457::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b280523f8> >Thread-27::DEBUG::2014-07-24 11:39:29,458::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:29,482::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0137121 s, 299 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:39:29,483::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:39:29,483::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:29,498::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00459815 s, 891 kB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:39:30,934::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-37::INFO::2014-07-24 11:39:31,057::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5029363200, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:39:31,057::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:39:31,058::task::595::TaskManager.Task::(_updateState) Task=`3992c946-8d25-4bf6-93a7-26265f35fcc0`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:39:31,058::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:39:31,058::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:39:31,058::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:39:31,059::task::1185::TaskManager.Task::(prepare) Task=`3992c946-8d25-4bf6-93a7-26265f35fcc0`::finished: None >Thread-37::DEBUG::2014-07-24 11:39:31,059::task::595::TaskManager.Task::(_updateState) Task=`3992c946-8d25-4bf6-93a7-26265f35fcc0`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:39:31,059::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:39:31,059::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:39:31,059::task::990::TaskManager.Task::(_decref) Task=`3992c946-8d25-4bf6-93a7-26265f35fcc0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:39:31,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:39:31,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:39:31,439::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:39:31,501::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x19b6248> >Thread-27::DEBUG::2014-07-24 11:39:31,501::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:31,533::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.019463 s, 210 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:39:31,533::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:39:31,533::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:31,555::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0111935 s, 366 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:39:33,063::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:39:33,064::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:39:33,064::task::595::TaskManager.Task::(_updateState) Task=`ce01aadc-6c61-4a37-9d35-8f37b254f3fb`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:39:33,064::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:39:33,065::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:39:33,065::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:39:33,065::task::1185::TaskManager.Task::(prepare) Task=`ce01aadc-6c61-4a37-9d35-8f37b254f3fb`::finished: None >Thread-37::DEBUG::2014-07-24 11:39:33,065::task::595::TaskManager.Task::(_updateState) Task=`ce01aadc-6c61-4a37-9d35-8f37b254f3fb`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:39:33,065::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:39:33,065::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:39:33,066::task::990::TaskManager.Task::(_decref) Task=`ce01aadc-6c61-4a37-9d35-8f37b254f3fb`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:39:33,443::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:39:33,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:39:33,457::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-14::DEBUG::2014-07-24 11:39:33,540::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:39:33,541::task::595::TaskManager.Task::(_updateState) Task=`6cd604e6-e04f-4508-9170-44c363a7b21a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:39:33,541::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:39:33,541::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:39:33,541::task::1185::TaskManager.Task::(prepare) Task=`6cd604e6-e04f-4508-9170-44c363a7b21a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:39:33,542::task::595::TaskManager.Task::(_updateState) Task=`6cd604e6-e04f-4508-9170-44c363a7b21a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:39:33,542::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:39:33,542::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:39:33,542::task::990::TaskManager.Task::(_decref) Task=`6cd604e6-e04f-4508-9170-44c363a7b21a`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:39:33,558::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b280523f8> >Thread-27::DEBUG::2014-07-24 11:39:33,558::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-34::DEBUG::2014-07-24 11:39:33,573::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:39:33,574::task::595::TaskManager.Task::(_updateState) Task=`bed8d44f-6018-4c10-a24e-b4b131e4ebec`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:39:33,574::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:39:33,575::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1276cdf0-0d7b-454c-ad01-6db4e8a6dfe4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:39:33,575::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:39:33,575::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:39:33,575::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1276cdf0-0d7b-454c-ad01-6db4e8a6dfe4`::Granted request >Thread-34::DEBUG::2014-07-24 11:39:33,576::task::827::TaskManager.Task::(resourceAcquired) Task=`bed8d44f-6018-4c10-a24e-b4b131e4ebec`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:39:33,576::task::990::TaskManager.Task::(_decref) Task=`bed8d44f-6018-4c10-a24e-b4b131e4ebec`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:39:33,577::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:39:33,577::task::1185::TaskManager.Task::(prepare) Task=`bed8d44f-6018-4c10-a24e-b4b131e4ebec`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:39:33,577::task::595::TaskManager.Task::(_updateState) Task=`bed8d44f-6018-4c10-a24e-b4b131e4ebec`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:39:33,577::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:39:33,578::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:39:33,578::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:39:33,578::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:39:33,578::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:39:33,578::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:39:33,578::task::990::TaskManager.Task::(_decref) Task=`bed8d44f-6018-4c10-a24e-b4b131e4ebec`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:39:33,929::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.360081 s, 11.4 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:39:33,929::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:39:33,930::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:33,945::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00469802 s, 872 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:39:35,069::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:39:35,070::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:39:35,070::task::595::TaskManager.Task::(_updateState) Task=`cb90b107-7e91-41cd-b778-91b5aa27eae9`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:39:35,070::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:39:35,071::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:39:35,071::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:39:35,071::task::1185::TaskManager.Task::(prepare) Task=`cb90b107-7e91-41cd-b778-91b5aa27eae9`::finished: None >Thread-37::DEBUG::2014-07-24 11:39:35,071::task::595::TaskManager.Task::(_updateState) Task=`cb90b107-7e91-41cd-b778-91b5aa27eae9`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:39:35,071::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:39:35,071::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:39:35,071::task::990::TaskManager.Task::(_decref) Task=`cb90b107-7e91-41cd-b778-91b5aa27eae9`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:39:35,461::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:39:35,473::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:39:35,474::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:39:35,947::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8ac8318a28> >Thread-27::DEBUG::2014-07-24 11:39:35,948::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:36,323::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.360193 s, 11.4 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:39:36,324::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:39:36,324::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:36,339::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00466091 s, 879 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:39:37,075::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:39:37,075::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:39:37,076::task::595::TaskManager.Task::(_updateState) Task=`fea16747-38c4-4cc9-9196-4f51fd57dc2e`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:39:37,076::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:39:37,076::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:39:37,077::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:39:37,077::task::1185::TaskManager.Task::(prepare) Task=`fea16747-38c4-4cc9-9196-4f51fd57dc2e`::finished: None >Thread-37::DEBUG::2014-07-24 11:39:37,077::task::595::TaskManager.Task::(_updateState) Task=`fea16747-38c4-4cc9-9196-4f51fd57dc2e`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:39:37,077::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:39:37,077::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:39:37,077::task::990::TaskManager.Task::(_decref) Task=`fea16747-38c4-4cc9-9196-4f51fd57dc2e`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 11:39:37,181::task::595::TaskManager.Task::(_updateState) Task=`0b474ece-ff92-4a17-a0df-d7f3285149d0`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:39:37,181::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:39:37,181::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000660521', 'lastCheck': '7.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:39:37,181::task::1185::TaskManager.Task::(prepare) Task=`0b474ece-ff92-4a17-a0df-d7f3285149d0`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000660521', 'lastCheck': '7.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:39:37,181::task::595::TaskManager.Task::(_updateState) Task=`0b474ece-ff92-4a17-a0df-d7f3285149d0`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:39:37,182::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:39:37,182::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:39:37,182::task::990::TaskManager.Task::(_decref) Task=`0b474ece-ff92-4a17-a0df-d7f3285149d0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:39:37,478::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:39:37,491::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:39:37,492::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:39:38,342::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8ac8318998> >Thread-27::DEBUG::2014-07-24 11:39:38,342::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:38,571::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.218351 s, 18.8 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:39:38,572::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:39:38,572::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:38,589::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00687128 s, 596 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:39:39,086::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:39:39,087::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:39:39,087::task::595::TaskManager.Task::(_updateState) Task=`5e557254-a5b2-4196-b243-990de73ecbd6`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:39:39,087::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:39:39,088::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:39:39,088::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:39:39,088::task::1185::TaskManager.Task::(prepare) Task=`5e557254-a5b2-4196-b243-990de73ecbd6`::finished: None >Thread-37::DEBUG::2014-07-24 11:39:39,088::task::595::TaskManager.Task::(_updateState) Task=`5e557254-a5b2-4196-b243-990de73ecbd6`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:39:39,088::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:39:39,088::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:39:39,089::task::990::TaskManager.Task::(_decref) Task=`5e557254-a5b2-4196-b243-990de73ecbd6`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:39:39,424::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:39:39,435::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000724609 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:39:39,496::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:39:39,508::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:39:39,509::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:39:40,592::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b280522d8> >Thread-27::DEBUG::2014-07-24 11:39:40,593::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:40,964::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.360328 s, 11.4 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:39:40,965::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:39:40,970::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:40,986::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00455931 s, 898 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:39:41,092::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:39:41,093::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:39:41,093::task::595::TaskManager.Task::(_updateState) Task=`fc5fda8f-7fae-4bab-ae13-c27395b19b43`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:39:41,093::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:39:41,094::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:39:41,094::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:39:41,094::task::1185::TaskManager.Task::(prepare) Task=`fc5fda8f-7fae-4bab-ae13-c27395b19b43`::finished: None >Thread-37::DEBUG::2014-07-24 11:39:41,094::task::595::TaskManager.Task::(_updateState) Task=`fc5fda8f-7fae-4bab-ae13-c27395b19b43`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:39:41,094::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:39:41,094::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:39:41,095::task::990::TaskManager.Task::(_decref) Task=`fc5fda8f-7fae-4bab-ae13-c27395b19b43`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:39:41,513::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:39:41,525::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:39:41,527::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:39:42,989::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b28056200> >Thread-27::DEBUG::2014-07-24 11:39:42,990::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-37::INFO::2014-07-24 11:39:43,098::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:39:43,098::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:39:43,099::task::595::TaskManager.Task::(_updateState) Task=`484a0191-fffc-4935-84a1-b468f5509bd6`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:39:43,099::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:39:43,099::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:39:43,100::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:39:43,100::task::1185::TaskManager.Task::(prepare) Task=`484a0191-fffc-4935-84a1-b468f5509bd6`::finished: None >Thread-37::DEBUG::2014-07-24 11:39:43,100::task::595::TaskManager.Task::(_updateState) Task=`484a0191-fffc-4935-84a1-b468f5509bd6`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:39:43,100::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:39:43,100::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:39:43,100::task::990::TaskManager.Task::(_decref) Task=`484a0191-fffc-4935-84a1-b468f5509bd6`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:39:43,281::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.280236 s, 14.6 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:39:43,281::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:39:43,282::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:43,297::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00443058 s, 924 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:39:43,530::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:39:43,543::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:39:43,544::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-14::DEBUG::2014-07-24 11:39:43,634::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [6bfd44d8] >Thread-14::DEBUG::2014-07-24 11:39:43,634::task::595::TaskManager.Task::(_updateState) Task=`59bdb6bc-1999-4a9a-be35-5e3a7d861284`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:39:43,634::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:39:43,635::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:39:43,635::task::1185::TaskManager.Task::(prepare) Task=`59bdb6bc-1999-4a9a-be35-5e3a7d861284`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:39:43,635::task::595::TaskManager.Task::(_updateState) Task=`59bdb6bc-1999-4a9a-be35-5e3a7d861284`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:39:43,635::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:39:43,635::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:39:43,636::task::990::TaskManager.Task::(_decref) Task=`59bdb6bc-1999-4a9a-be35-5e3a7d861284`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:39:43,678::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [6bfd44d8] >Thread-34::DEBUG::2014-07-24 11:39:43,678::task::595::TaskManager.Task::(_updateState) Task=`22993e9f-d94a-4276-8b8d-b8d89fe1f009`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:39:43,678::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:39:43,678::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7ef931c9-a8e2-4c61-b9ca-64544a696b92`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:39:43,679::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:39:43,679::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:39:43,679::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7ef931c9-a8e2-4c61-b9ca-64544a696b92`::Granted request >Thread-34::DEBUG::2014-07-24 11:39:43,679::task::827::TaskManager.Task::(resourceAcquired) Task=`22993e9f-d94a-4276-8b8d-b8d89fe1f009`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:39:43,680::task::990::TaskManager.Task::(_decref) Task=`22993e9f-d94a-4276-8b8d-b8d89fe1f009`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:39:43,680::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:39:43,680::task::1185::TaskManager.Task::(prepare) Task=`22993e9f-d94a-4276-8b8d-b8d89fe1f009`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:39:43,681::task::595::TaskManager.Task::(_updateState) Task=`22993e9f-d94a-4276-8b8d-b8d89fe1f009`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:39:43,681::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:39:43,681::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:39:43,681::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:39:43,681::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:39:43,681::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:39:43,682::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:39:43,682::task::990::TaskManager.Task::(_decref) Task=`22993e9f-d94a-4276-8b8d-b8d89fe1f009`::ref 0 aborting False >Thread-37::INFO::2014-07-24 11:39:45,104::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:39:45,104::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:39:45,105::task::595::TaskManager.Task::(_updateState) Task=`419d355f-9cfe-43f8-ae9a-e9e8ad0e5a4b`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:39:45,105::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:39:45,105::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:39:45,105::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:39:45,106::task::1185::TaskManager.Task::(prepare) Task=`419d355f-9cfe-43f8-ae9a-e9e8ad0e5a4b`::finished: None >Thread-37::DEBUG::2014-07-24 11:39:45,106::task::595::TaskManager.Task::(_updateState) Task=`419d355f-9cfe-43f8-ae9a-e9e8ad0e5a4b`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:39:45,106::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:39:45,106::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:39:45,106::task::990::TaskManager.Task::(_decref) Task=`419d355f-9cfe-43f8-ae9a-e9e8ad0e5a4b`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:39:45,299::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b280567e8> >Thread-27::DEBUG::2014-07-24 11:39:45,299::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b28056e18> >Thread-27::DEBUG::2014-07-24 11:39:45,300::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:39:45,548::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:39:45,560::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:39:45,561::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:39:45,671::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.360301 s, 11.4 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:39:45,671::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:39:45,672::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:45,688::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00438675 s, 934 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:39:47,110::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:39:47,110::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:39:47,111::task::595::TaskManager.Task::(_updateState) Task=`80b76958-9af6-4b9c-aa58-1245a7bc789b`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:39:47,111::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:39:47,111::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:39:47,111::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:39:47,111::task::1185::TaskManager.Task::(prepare) Task=`80b76958-9af6-4b9c-aa58-1245a7bc789b`::finished: None >Thread-37::DEBUG::2014-07-24 11:39:47,112::task::595::TaskManager.Task::(_updateState) Task=`80b76958-9af6-4b9c-aa58-1245a7bc789b`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:39:47,112::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:39:47,112::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:39:47,112::task::990::TaskManager.Task::(_decref) Task=`80b76958-9af6-4b9c-aa58-1245a7bc789b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:39:47,565::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:39:47,577::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:39:47,579::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:39:47,690::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b2803f3b0> >Thread-27::DEBUG::2014-07-24 11:39:47,691::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:48,062::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.360542 s, 11.4 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:39:48,063::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:39:48,063::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:48,078::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00444608 s, 921 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:39:49,116::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:39:49,116::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:39:49,116::task::595::TaskManager.Task::(_updateState) Task=`16962f35-4560-4e35-8f32-efd941991e8a`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:39:49,117::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:39:49,117::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:39:49,117::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:39:49,117::task::1185::TaskManager.Task::(prepare) Task=`16962f35-4560-4e35-8f32-efd941991e8a`::finished: None >Thread-37::DEBUG::2014-07-24 11:39:49,117::task::595::TaskManager.Task::(_updateState) Task=`16962f35-4560-4e35-8f32-efd941991e8a`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:39:49,118::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:39:49,118::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:39:49,118::task::990::TaskManager.Task::(_decref) Task=`16962f35-4560-4e35-8f32-efd941991e8a`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:39:49,439::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:39:49,450::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000647324 s, 6.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:39:49,582::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:39:49,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:39:49,596::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:39:50,080::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8ac83183b0> >Thread-27::DEBUG::2014-07-24 11:39:50,081::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:50,328::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.236265 s, 17.3 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:39:50,329::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:39:50,329::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:50,344::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00444601 s, 921 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:39:51,122::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:39:51,122::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:39:51,122::task::595::TaskManager.Task::(_updateState) Task=`be98113a-836c-4639-8bae-22fe44d025d1`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:39:51,123::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:39:51,123::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:39:51,123::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:39:51,123::task::1185::TaskManager.Task::(prepare) Task=`be98113a-836c-4639-8bae-22fe44d025d1`::finished: None >Thread-37::DEBUG::2014-07-24 11:39:51,124::task::595::TaskManager.Task::(_updateState) Task=`be98113a-836c-4639-8bae-22fe44d025d1`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:39:51,124::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:39:51,124::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:39:51,124::task::990::TaskManager.Task::(_decref) Task=`be98113a-836c-4639-8bae-22fe44d025d1`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:39:51,600::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:39:51,613::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:39:51,616::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:39:52,346::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b28052248> >Thread-27::DEBUG::2014-07-24 11:39:52,347::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-14::DEBUG::2014-07-24 11:39:52,526::task::595::TaskManager.Task::(_updateState) Task=`834da095-0285-4b76-85b5-51e20cc4f550`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:39:52,526::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:39:52,526::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000647324', 'lastCheck': '3.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:39:52,527::task::1185::TaskManager.Task::(prepare) Task=`834da095-0285-4b76-85b5-51e20cc4f550`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000647324', 'lastCheck': '3.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:39:52,527::task::595::TaskManager.Task::(_updateState) Task=`834da095-0285-4b76-85b5-51e20cc4f550`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:39:52,527::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:39:52,527::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:39:52,527::task::990::TaskManager.Task::(_decref) Task=`834da095-0285-4b76-85b5-51e20cc4f550`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:39:52,718::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.360355 s, 11.4 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:39:52,718::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:39:52,719::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:52,734::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0045062 s, 909 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:39:53,133::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:39:53,133::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:39:53,134::task::595::TaskManager.Task::(_updateState) Task=`d19315bc-877e-43c9-861e-7a43b28d3f26`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:39:53,134::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:39:53,134::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:39:53,134::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:39:53,134::task::1185::TaskManager.Task::(prepare) Task=`d19315bc-877e-43c9-861e-7a43b28d3f26`::finished: None >Thread-37::DEBUG::2014-07-24 11:39:53,135::task::595::TaskManager.Task::(_updateState) Task=`d19315bc-877e-43c9-861e-7a43b28d3f26`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:39:53,135::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:39:53,135::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:39:53,135::task::990::TaskManager.Task::(_decref) Task=`d19315bc-877e-43c9-861e-7a43b28d3f26`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:39:53,621::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:39:53,633::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:39:53,634::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-14::DEBUG::2014-07-24 11:39:53,738::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:39:53,738::task::595::TaskManager.Task::(_updateState) Task=`c89909ba-7ded-4600-87a4-4325a4c68193`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:39:53,738::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:39:53,739::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:39:53,739::task::1185::TaskManager.Task::(prepare) Task=`c89909ba-7ded-4600-87a4-4325a4c68193`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:39:53,739::task::595::TaskManager.Task::(_updateState) Task=`c89909ba-7ded-4600-87a4-4325a4c68193`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:39:53,739::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:39:53,739::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:39:53,739::task::990::TaskManager.Task::(_decref) Task=`c89909ba-7ded-4600-87a4-4325a4c68193`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:39:53,770::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:39:53,771::task::595::TaskManager.Task::(_updateState) Task=`ff998b0d-47c2-4037-8bef-46824c35f649`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:39:53,771::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:39:53,771::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f36edee2-6f09-417d-a820-07dea5f51f67`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:39:53,771::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:39:53,772::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:39:53,772::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f36edee2-6f09-417d-a820-07dea5f51f67`::Granted request >Thread-34::DEBUG::2014-07-24 11:39:53,772::task::827::TaskManager.Task::(resourceAcquired) Task=`ff998b0d-47c2-4037-8bef-46824c35f649`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:39:53,772::task::990::TaskManager.Task::(_decref) Task=`ff998b0d-47c2-4037-8bef-46824c35f649`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:39:53,773::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:39:53,773::task::1185::TaskManager.Task::(prepare) Task=`ff998b0d-47c2-4037-8bef-46824c35f649`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:39:53,773::task::595::TaskManager.Task::(_updateState) Task=`ff998b0d-47c2-4037-8bef-46824c35f649`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:39:53,774::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:39:53,774::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:39:53,774::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:39:53,774::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:39:53,774::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:39:53,774::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:39:53,775::task::990::TaskManager.Task::(_decref) Task=`ff998b0d-47c2-4037-8bef-46824c35f649`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:39:54,736::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b28052368> >Thread-27::DEBUG::2014-07-24 11:39:54,737::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:55,108::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.360277 s, 11.4 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:39:55,109::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:39:55,109::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:55,124::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00443544 s, 923 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:39:55,139::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:39:55,139::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:39:55,140::task::595::TaskManager.Task::(_updateState) Task=`c80a97b8-3afd-45bb-9d0e-6138ec17d6db`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:39:55,140::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:39:55,140::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:39:55,140::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:39:55,140::task::1185::TaskManager.Task::(prepare) Task=`c80a97b8-3afd-45bb-9d0e-6138ec17d6db`::finished: None >Thread-37::DEBUG::2014-07-24 11:39:55,141::task::595::TaskManager.Task::(_updateState) Task=`c80a97b8-3afd-45bb-9d0e-6138ec17d6db`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:39:55,141::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:39:55,141::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:39:55,141::task::990::TaskManager.Task::(_decref) Task=`c80a97b8-3afd-45bb-9d0e-6138ec17d6db`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:39:55,637::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:39:55,650::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:39:55,652::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:39:57,126::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b2803f950> >Thread-27::DEBUG::2014-07-24 11:39:57,127::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-37::INFO::2014-07-24 11:39:57,145::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:39:57,145::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:39:57,146::task::595::TaskManager.Task::(_updateState) Task=`b38220fa-6003-4b0e-ada1-566aaa855b43`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:39:57,146::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:39:57,146::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:39:57,146::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:39:57,146::task::1185::TaskManager.Task::(prepare) Task=`b38220fa-6003-4b0e-ada1-566aaa855b43`::finished: None >Thread-37::DEBUG::2014-07-24 11:39:57,147::task::595::TaskManager.Task::(_updateState) Task=`b38220fa-6003-4b0e-ada1-566aaa855b43`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:39:57,147::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:39:57,147::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:39:57,147::task::990::TaskManager.Task::(_decref) Task=`b38220fa-6003-4b0e-ada1-566aaa855b43`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:39:57,370::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.23254 s, 17.6 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:39:57,371::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:39:57,371::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:57,387::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00559967 s, 731 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:39:57,655::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:39:57,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:39:57,669::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-37::INFO::2014-07-24 11:39:59,151::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:39:59,151::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:39:59,151::task::595::TaskManager.Task::(_updateState) Task=`33228bc3-f92e-4207-ac4b-4423a993b76c`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:39:59,152::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:39:59,152::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:39:59,152::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:39:59,152::task::1185::TaskManager.Task::(prepare) Task=`33228bc3-f92e-4207-ac4b-4423a993b76c`::finished: None >Thread-37::DEBUG::2014-07-24 11:39:59,152::task::595::TaskManager.Task::(_updateState) Task=`33228bc3-f92e-4207-ac4b-4423a993b76c`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:39:59,153::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:39:59,153::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:39:59,153::task::990::TaskManager.Task::(_decref) Task=`33228bc3-f92e-4207-ac4b-4423a993b76c`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:39:59,390::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b280564d0> >Thread-27::DEBUG::2014-07-24 11:39:59,390::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8ac8318e60> >Thread-27::DEBUG::2014-07-24 11:39:59,390::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-18::DEBUG::2014-07-24 11:39:59,455::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:39:59,467::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000654577 s, 6.3 MB/s\n'; <rc> = 0 >Thread-27::DEBUG::2014-07-24 11:39:59,627::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.22538 s, 18.2 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:39:59,627::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:39:59,628::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:39:59,643::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00516151 s, 794 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:39:59,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:39:59,685::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:39:59,686::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >VM Channels Listener::DEBUG::2014-07-24 11:40:00,971::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-37::INFO::2014-07-24 11:40:01,157::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:40:01,157::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:40:01,158::task::595::TaskManager.Task::(_updateState) Task=`0c1ce1ef-f4cd-4dc0-8050-5f13a7806179`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:40:01,158::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:40:01,158::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:40:01,158::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:40:01,158::task::1185::TaskManager.Task::(prepare) Task=`0c1ce1ef-f4cd-4dc0-8050-5f13a7806179`::finished: None >Thread-37::DEBUG::2014-07-24 11:40:01,159::task::595::TaskManager.Task::(_updateState) Task=`0c1ce1ef-f4cd-4dc0-8050-5f13a7806179`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:40:01,159::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:40:01,159::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:40:01,159::task::990::TaskManager.Task::(_decref) Task=`0c1ce1ef-f4cd-4dc0-8050-5f13a7806179`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:40:01,646::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b2814ed88> >Thread-27::DEBUG::2014-07-24 11:40:01,647::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:40:01,690::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:40:01,702::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:40:01,705::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:40:02,018::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.361163 s, 11.3 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:40:02,019::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:40:02,019::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:02,037::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00690497 s, 593 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:40:03,170::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:40:03,170::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:40:03,171::task::595::TaskManager.Task::(_updateState) Task=`ea352f18-d405-4a51-ac50-bd0b404dadbb`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:40:03,171::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:40:03,172::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:40:03,172::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:40:03,172::task::1185::TaskManager.Task::(prepare) Task=`ea352f18-d405-4a51-ac50-bd0b404dadbb`::finished: None >Thread-37::DEBUG::2014-07-24 11:40:03,172::task::595::TaskManager.Task::(_updateState) Task=`ea352f18-d405-4a51-ac50-bd0b404dadbb`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:40:03,172::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:40:03,172::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:40:03,172::task::990::TaskManager.Task::(_decref) Task=`ea352f18-d405-4a51-ac50-bd0b404dadbb`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:40:03,708::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:40:03,719::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:40:03,719::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-14::DEBUG::2014-07-24 11:40:03,830::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [5176ccd6] >Thread-14::DEBUG::2014-07-24 11:40:03,830::task::595::TaskManager.Task::(_updateState) Task=`6b1735a0-bb69-449b-ad56-13215ad88a38`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:40:03,830::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:40:03,831::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:40:03,831::task::1185::TaskManager.Task::(prepare) Task=`6b1735a0-bb69-449b-ad56-13215ad88a38`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:40:03,831::task::595::TaskManager.Task::(_updateState) Task=`6b1735a0-bb69-449b-ad56-13215ad88a38`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:40:03,831::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:40:03,831::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:40:03,832::task::990::TaskManager.Task::(_decref) Task=`6b1735a0-bb69-449b-ad56-13215ad88a38`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:40:03,867::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [5176ccd6] >Thread-34::DEBUG::2014-07-24 11:40:03,867::task::595::TaskManager.Task::(_updateState) Task=`ed4a5930-3a69-4a41-89a8-827228939c6b`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:40:03,868::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:40:03,868::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`5d5dcf5f-cb10-4d6d-8d10-80f0b8d7039d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:40:03,868::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:40:03,868::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:40:03,869::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`5d5dcf5f-cb10-4d6d-8d10-80f0b8d7039d`::Granted request >Thread-34::DEBUG::2014-07-24 11:40:03,869::task::827::TaskManager.Task::(resourceAcquired) Task=`ed4a5930-3a69-4a41-89a8-827228939c6b`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:40:03,869::task::990::TaskManager.Task::(_decref) Task=`ed4a5930-3a69-4a41-89a8-827228939c6b`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:40:03,870::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:40:03,870::task::1185::TaskManager.Task::(prepare) Task=`ed4a5930-3a69-4a41-89a8-827228939c6b`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:40:03,870::task::595::TaskManager.Task::(_updateState) Task=`ed4a5930-3a69-4a41-89a8-827228939c6b`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:40:03,870::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:40:03,870::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:40:03,871::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:40:03,871::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:40:03,871::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:40:03,871::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:40:03,871::task::990::TaskManager.Task::(_decref) Task=`ed4a5930-3a69-4a41-89a8-827228939c6b`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:40:04,041::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b280b4560> >Thread-27::DEBUG::2014-07-24 11:40:04,041::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:04,293::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.240737 s, 17.0 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:40:04,293::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:40:04,294::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:04,309::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00473179 s, 866 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:40:05,176::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:40:05,176::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:40:05,176::task::595::TaskManager.Task::(_updateState) Task=`fea607a0-0295-4035-b4d2-c3b6aa3d1cc8`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:40:05,177::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:40:05,177::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:40:05,177::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:40:05,177::task::1185::TaskManager.Task::(prepare) Task=`fea607a0-0295-4035-b4d2-c3b6aa3d1cc8`::finished: None >Thread-37::DEBUG::2014-07-24 11:40:05,177::task::595::TaskManager.Task::(_updateState) Task=`fea607a0-0295-4035-b4d2-c3b6aa3d1cc8`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:40:05,178::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:40:05,178::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:40:05,178::task::990::TaskManager.Task::(_decref) Task=`fea607a0-0295-4035-b4d2-c3b6aa3d1cc8`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:40:05,722::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:40:05,734::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:40:05,735::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:40:06,312::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b2809cc68> >Thread-27::DEBUG::2014-07-24 11:40:06,313::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:06,396::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0718812 s, 57.0 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:40:06,396::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:40:06,397::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:06,413::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00526011 s, 779 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:40:07,187::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:40:07,187::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:40:07,188::task::595::TaskManager.Task::(_updateState) Task=`66605f93-542f-4e11-8b48-c567ec7cdc8c`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:40:07,188::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:40:07,188::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:40:07,188::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:40:07,188::task::1185::TaskManager.Task::(prepare) Task=`66605f93-542f-4e11-8b48-c567ec7cdc8c`::finished: None >Thread-37::DEBUG::2014-07-24 11:40:07,189::task::595::TaskManager.Task::(_updateState) Task=`66605f93-542f-4e11-8b48-c567ec7cdc8c`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:40:07,189::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:40:07,189::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:40:07,189::task::990::TaskManager.Task::(_decref) Task=`66605f93-542f-4e11-8b48-c567ec7cdc8c`::ref 0 aborting False >Thread-37::DEBUG::2014-07-24 11:40:07,189::task::595::TaskManager.Task::(_updateState) Task=`dd5ebe54-877f-4c2a-a007-e951d0e5b2fc`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:40:07,190::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:40:07,190::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-37::DEBUG::2014-07-24 11:40:07,190::task::1185::TaskManager.Task::(prepare) Task=`dd5ebe54-877f-4c2a-a007-e951d0e5b2fc`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-37::DEBUG::2014-07-24 11:40:07,190::task::595::TaskManager.Task::(_updateState) Task=`dd5ebe54-877f-4c2a-a007-e951d0e5b2fc`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:40:07,190::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:40:07,191::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:40:07,191::task::990::TaskManager.Task::(_decref) Task=`dd5ebe54-877f-4c2a-a007-e951d0e5b2fc`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:40:07,738::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:40:07,751::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:40:07,753::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-14::DEBUG::2014-07-24 11:40:07,911::task::595::TaskManager.Task::(_updateState) Task=`bda46ad3-3ee0-46e5-8d25-9d706d7debc6`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:40:07,911::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:40:07,911::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000654577', 'lastCheck': '8.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:40:07,911::task::1185::TaskManager.Task::(prepare) Task=`bda46ad3-3ee0-46e5-8d25-9d706d7debc6`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000654577', 'lastCheck': '8.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:40:07,911::task::595::TaskManager.Task::(_updateState) Task=`bda46ad3-3ee0-46e5-8d25-9d706d7debc6`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:40:07,912::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:40:07,912::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:40:07,912::task::990::TaskManager.Task::(_decref) Task=`bda46ad3-3ee0-46e5-8d25-9d706d7debc6`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:40:08,415::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b280529e0> >Thread-27::DEBUG::2014-07-24 11:40:08,416::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:08,453::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0263454 s, 155 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:40:08,453::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:40:08,454::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:08,469::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00450007 s, 910 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:40:09,225::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:40:09,225::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:40:09,225::task::595::TaskManager.Task::(_updateState) Task=`6e6007bc-475b-4bbf-84c5-848cb97a1276`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:40:09,226::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:40:09,226::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:40:09,226::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:40:09,226::task::1185::TaskManager.Task::(prepare) Task=`6e6007bc-475b-4bbf-84c5-848cb97a1276`::finished: None >Thread-37::DEBUG::2014-07-24 11:40:09,226::task::595::TaskManager.Task::(_updateState) Task=`6e6007bc-475b-4bbf-84c5-848cb97a1276`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:40:09,227::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:40:09,227::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:40:09,227::task::990::TaskManager.Task::(_decref) Task=`6e6007bc-475b-4bbf-84c5-848cb97a1276`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:40:09,471::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:40:09,485::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00367886 s, 1.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:40:09,756::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:40:09,770::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:40:09,772::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:40:10,471::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8ac8047c68> >Thread-27::DEBUG::2014-07-24 11:40:10,472::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:10,518::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.034847 s, 118 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:40:10,519::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:40:10,519::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:10,534::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00472333 s, 867 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:40:11,231::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:40:11,231::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:40:11,231::task::595::TaskManager.Task::(_updateState) Task=`817a97e0-6b20-4704-800f-e968fcffa07f`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:40:11,232::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:40:11,232::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:40:11,232::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:40:11,232::task::1185::TaskManager.Task::(prepare) Task=`817a97e0-6b20-4704-800f-e968fcffa07f`::finished: None >Thread-37::DEBUG::2014-07-24 11:40:11,233::task::595::TaskManager.Task::(_updateState) Task=`817a97e0-6b20-4704-800f-e968fcffa07f`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:40:11,233::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:40:11,233::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:40:11,233::task::990::TaskManager.Task::(_decref) Task=`817a97e0-6b20-4704-800f-e968fcffa07f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:40:11,776::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:40:11,794::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:40:11,794::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:40:12,537::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b28056758> >Thread-27::DEBUG::2014-07-24 11:40:12,537::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:12,593::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.033056 s, 124 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:40:12,594::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:40:12,594::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:12,609::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00469135 s, 873 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:40:13,237::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:40:13,237::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:40:13,237::task::595::TaskManager.Task::(_updateState) Task=`4828ed09-310c-4992-8291-6ee4e042cfb5`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:40:13,238::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:40:13,238::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:40:13,238::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:40:13,238::task::1185::TaskManager.Task::(prepare) Task=`4828ed09-310c-4992-8291-6ee4e042cfb5`::finished: None >Thread-37::DEBUG::2014-07-24 11:40:13,238::task::595::TaskManager.Task::(_updateState) Task=`4828ed09-310c-4992-8291-6ee4e042cfb5`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:40:13,239::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:40:13,239::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:40:13,239::task::990::TaskManager.Task::(_decref) Task=`4828ed09-310c-4992-8291-6ee4e042cfb5`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:40:13,798::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:40:13,814::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:40:13,814::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-14::DEBUG::2014-07-24 11:40:13,923::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:40:13,924::task::595::TaskManager.Task::(_updateState) Task=`41870291-bee6-48d6-9199-fab0f0d129bb`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:40:13,924::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:40:13,925::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:40:13,925::task::1185::TaskManager.Task::(prepare) Task=`41870291-bee6-48d6-9199-fab0f0d129bb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:40:13,925::task::595::TaskManager.Task::(_updateState) Task=`41870291-bee6-48d6-9199-fab0f0d129bb`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:40:13,925::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:40:13,925::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:40:13,925::task::990::TaskManager.Task::(_decref) Task=`41870291-bee6-48d6-9199-fab0f0d129bb`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:40:13,957::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:40:13,957::task::595::TaskManager.Task::(_updateState) Task=`ea629a92-bede-48a0-8bec-debb6f362820`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:40:13,958::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:40:13,958::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f911438a-4659-4fc1-b8b5-fb9626d7bf9a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:40:13,958::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:40:13,958::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:40:13,959::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f911438a-4659-4fc1-b8b5-fb9626d7bf9a`::Granted request >Thread-34::DEBUG::2014-07-24 11:40:13,959::task::827::TaskManager.Task::(resourceAcquired) Task=`ea629a92-bede-48a0-8bec-debb6f362820`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:40:13,959::task::990::TaskManager.Task::(_decref) Task=`ea629a92-bede-48a0-8bec-debb6f362820`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:40:13,960::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:40:13,960::task::1185::TaskManager.Task::(prepare) Task=`ea629a92-bede-48a0-8bec-debb6f362820`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:40:13,960::task::595::TaskManager.Task::(_updateState) Task=`ea629a92-bede-48a0-8bec-debb6f362820`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:40:13,960::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:40:13,960::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:40:13,961::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:40:13,961::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:40:13,961::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:40:13,961::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:40:13,961::task::990::TaskManager.Task::(_decref) Task=`ea629a92-bede-48a0-8bec-debb6f362820`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:40:14,612::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b2813cb90> >Thread-27::DEBUG::2014-07-24 11:40:14,612::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:14,643::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0201219 s, 204 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:40:14,644::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:40:14,644::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:14,659::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00471192 s, 869 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:40:15,243::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:40:15,243::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:40:15,243::task::595::TaskManager.Task::(_updateState) Task=`b6876a8c-9b83-46df-99a7-5f527b176e00`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:40:15,244::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:40:15,244::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:40:15,244::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:40:15,244::task::1185::TaskManager.Task::(prepare) Task=`b6876a8c-9b83-46df-99a7-5f527b176e00`::finished: None >Thread-37::DEBUG::2014-07-24 11:40:15,244::task::595::TaskManager.Task::(_updateState) Task=`b6876a8c-9b83-46df-99a7-5f527b176e00`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:40:15,244::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:40:15,245::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:40:15,245::task::990::TaskManager.Task::(_decref) Task=`b6876a8c-9b83-46df-99a7-5f527b176e00`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:40:15,818::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:40:15,838::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:40:15,839::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:40:16,662::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b2813cc20> >Thread-27::DEBUG::2014-07-24 11:40:16,662::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:16,688::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0141756 s, 289 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:40:16,688::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:40:16,689::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:16,703::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00416485 s, 983 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:40:17,249::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:40:17,249::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:40:17,249::task::595::TaskManager.Task::(_updateState) Task=`3255449c-68da-4e54-b595-d76582f4819f`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:40:17,249::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:40:17,250::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:40:17,250::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:40:17,250::task::1185::TaskManager.Task::(prepare) Task=`3255449c-68da-4e54-b595-d76582f4819f`::finished: None >Thread-37::DEBUG::2014-07-24 11:40:17,250::task::595::TaskManager.Task::(_updateState) Task=`3255449c-68da-4e54-b595-d76582f4819f`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:40:17,250::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:40:17,251::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:40:17,251::task::990::TaskManager.Task::(_decref) Task=`3255449c-68da-4e54-b595-d76582f4819f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:40:17,841::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:40:17,852::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:40:17,854::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:40:18,706::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b2809c638> >Thread-27::DEBUG::2014-07-24 11:40:18,706::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:18,757::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0381717 s, 107 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:40:18,758::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:40:18,758::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:18,773::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00423393 s, 967 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:40:19,254::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:40:19,255::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:40:19,255::task::595::TaskManager.Task::(_updateState) Task=`bbc7413e-91d2-434d-a157-e7b079dfe706`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:40:19,255::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:40:19,255::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:40:19,256::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:40:19,256::task::1185::TaskManager.Task::(prepare) Task=`bbc7413e-91d2-434d-a157-e7b079dfe706`::finished: None >Thread-37::DEBUG::2014-07-24 11:40:19,256::task::595::TaskManager.Task::(_updateState) Task=`bbc7413e-91d2-434d-a157-e7b079dfe706`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:40:19,256::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:40:19,256::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:40:19,256::task::990::TaskManager.Task::(_decref) Task=`bbc7413e-91d2-434d-a157-e7b079dfe706`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:40:19,491::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:40:19,510::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00834667 s, 491 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:40:19,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:40:19,867::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:40:19,867::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:40:20,775::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b280b4560> >Thread-27::DEBUG::2014-07-24 11:40:20,776::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:20,812::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0245802 s, 167 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:40:20,812::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:40:20,813::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:20,828::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00459128 s, 892 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:40:21,260::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:40:21,260::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:40:21,261::task::595::TaskManager.Task::(_updateState) Task=`78551901-32b6-4477-b32a-7fa3d8f33048`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:40:21,261::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:40:21,262::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:40:21,262::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:40:21,262::task::1185::TaskManager.Task::(prepare) Task=`78551901-32b6-4477-b32a-7fa3d8f33048`::finished: None >Thread-37::DEBUG::2014-07-24 11:40:21,262::task::595::TaskManager.Task::(_updateState) Task=`78551901-32b6-4477-b32a-7fa3d8f33048`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:40:21,262::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:40:21,263::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:40:21,263::task::990::TaskManager.Task::(_decref) Task=`78551901-32b6-4477-b32a-7fa3d8f33048`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:40:21,870::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:40:21,881::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:40:21,882::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:40:22,830::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b2803fc20> >Thread-27::DEBUG::2014-07-24 11:40:22,831::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:22,856::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0139401 s, 294 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:40:22,856::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:40:22,866::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:22,880::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00383727 s, 1.1 MB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:40:23,272::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:40:23,272::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:40:23,273::task::595::TaskManager.Task::(_updateState) Task=`4448b973-c919-4531-a8f2-98b69335b702`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:40:23,273::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:40:23,273::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:40:23,273::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:40:23,274::task::1185::TaskManager.Task::(prepare) Task=`4448b973-c919-4531-a8f2-98b69335b702`::finished: None >Thread-37::DEBUG::2014-07-24 11:40:23,274::task::595::TaskManager.Task::(_updateState) Task=`4448b973-c919-4531-a8f2-98b69335b702`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:40:23,274::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:40:23,274::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:40:23,274::task::990::TaskManager.Task::(_decref) Task=`4448b973-c919-4531-a8f2-98b69335b702`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 11:40:23,305::task::595::TaskManager.Task::(_updateState) Task=`4f1dfe29-b671-49b8-9f02-6519df1dcb03`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:40:23,306::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:40:23,306::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00834667', 'lastCheck': '3.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:40:23,306::task::1185::TaskManager.Task::(prepare) Task=`4f1dfe29-b671-49b8-9f02-6519df1dcb03`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00834667', 'lastCheck': '3.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:40:23,306::task::595::TaskManager.Task::(_updateState) Task=`4f1dfe29-b671-49b8-9f02-6519df1dcb03`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:40:23,307::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:40:23,307::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:40:23,307::task::990::TaskManager.Task::(_decref) Task=`4f1dfe29-b671-49b8-9f02-6519df1dcb03`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:40:23,884::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:40:23,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:40:23,897::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-14::DEBUG::2014-07-24 11:40:24,026::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:40:24,026::task::595::TaskManager.Task::(_updateState) Task=`b1cf4756-56dd-44cb-9da9-e7fe102d6c4c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:40:24,026::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:40:24,027::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:40:24,027::task::1185::TaskManager.Task::(prepare) Task=`b1cf4756-56dd-44cb-9da9-e7fe102d6c4c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:40:24,027::task::595::TaskManager.Task::(_updateState) Task=`b1cf4756-56dd-44cb-9da9-e7fe102d6c4c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:40:24,027::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:40:24,027::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:40:24,028::task::990::TaskManager.Task::(_decref) Task=`b1cf4756-56dd-44cb-9da9-e7fe102d6c4c`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:40:24,061::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:40:24,062::task::595::TaskManager.Task::(_updateState) Task=`7bb063ac-dad9-4b56-a145-f14591443226`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:40:24,062::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:40:24,062::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7fed9de3-e67a-4e5d-9f67-74aa6a45fbc4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:40:24,062::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:40:24,063::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:40:24,063::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7fed9de3-e67a-4e5d-9f67-74aa6a45fbc4`::Granted request >Thread-34::DEBUG::2014-07-24 11:40:24,063::task::827::TaskManager.Task::(resourceAcquired) Task=`7bb063ac-dad9-4b56-a145-f14591443226`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:40:24,063::task::990::TaskManager.Task::(_decref) Task=`7bb063ac-dad9-4b56-a145-f14591443226`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:40:24,064::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:40:24,064::task::1185::TaskManager.Task::(prepare) Task=`7bb063ac-dad9-4b56-a145-f14591443226`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:40:24,064::task::595::TaskManager.Task::(_updateState) Task=`7bb063ac-dad9-4b56-a145-f14591443226`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:40:24,065::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:40:24,065::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:40:24,065::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:40:24,065::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:40:24,065::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:40:24,065::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:40:24,066::task::990::TaskManager.Task::(_decref) Task=`7bb063ac-dad9-4b56-a145-f14591443226`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:40:24,882::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8ac8043248> >Thread-27::DEBUG::2014-07-24 11:40:24,883::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:24,918::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.023276 s, 176 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:40:24,918::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:40:24,918::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:24,933::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00425165 s, 963 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:40:25,278::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:40:25,278::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:40:25,279::task::595::TaskManager.Task::(_updateState) Task=`0830a85a-7ac9-4377-b70a-e2155de2a761`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:40:25,279::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:40:25,279::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:40:25,279::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:40:25,279::task::1185::TaskManager.Task::(prepare) Task=`0830a85a-7ac9-4377-b70a-e2155de2a761`::finished: None >Thread-37::DEBUG::2014-07-24 11:40:25,280::task::595::TaskManager.Task::(_updateState) Task=`0830a85a-7ac9-4377-b70a-e2155de2a761`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:40:25,280::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:40:25,280::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:40:25,280::task::990::TaskManager.Task::(_decref) Task=`0830a85a-7ac9-4377-b70a-e2155de2a761`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:40:25,900::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:40:25,911::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:40:25,912::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:40:26,936::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b2813c7a0> >Thread-27::DEBUG::2014-07-24 11:40:26,936::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:26,962::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0140739 s, 291 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:40:26,962::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:40:26,962::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:26,977::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00423287 s, 968 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:40:27,284::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:40:27,284::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:40:27,284::task::595::TaskManager.Task::(_updateState) Task=`08f9e794-a43d-4b5e-b99f-53b08063fa2d`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:40:27,285::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:40:27,285::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:40:27,285::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:40:27,285::task::1185::TaskManager.Task::(prepare) Task=`08f9e794-a43d-4b5e-b99f-53b08063fa2d`::finished: None >Thread-37::DEBUG::2014-07-24 11:40:27,285::task::595::TaskManager.Task::(_updateState) Task=`08f9e794-a43d-4b5e-b99f-53b08063fa2d`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:40:27,286::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:40:27,286::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:40:27,286::task::990::TaskManager.Task::(_decref) Task=`08f9e794-a43d-4b5e-b99f-53b08063fa2d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:40:27,914::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:40:27,925::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:40:27,925::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:40:28,980::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b28055290> >Thread-27::DEBUG::2014-07-24 11:40:28,980::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:29,016::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0248479 s, 165 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:40:29,017::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:40:29,017::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:29,032::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00412712 s, 992 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:40:29,290::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:40:29,290::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:40:29,290::task::595::TaskManager.Task::(_updateState) Task=`f94fe43c-4b74-42ee-b4a4-637d0c593190`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:40:29,290::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:40:29,291::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:40:29,291::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:40:29,291::task::1185::TaskManager.Task::(prepare) Task=`f94fe43c-4b74-42ee-b4a4-637d0c593190`::finished: None >Thread-37::DEBUG::2014-07-24 11:40:29,291::task::595::TaskManager.Task::(_updateState) Task=`f94fe43c-4b74-42ee-b4a4-637d0c593190`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:40:29,291::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:40:29,292::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:40:29,292::task::990::TaskManager.Task::(_decref) Task=`f94fe43c-4b74-42ee-b4a4-637d0c593190`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:40:29,515::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:40:29,536::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00960603 s, 426 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:40:29,928::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:40:29,938::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:40:29,939::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >VM Channels Listener::DEBUG::2014-07-24 11:40:31,008::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-27::DEBUG::2014-07-24 11:40:31,034::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b28069440> >Thread-27::DEBUG::2014-07-24 11:40:31,035::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:31,108::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0608355 s, 67.3 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:40:31,108::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:40:31,108::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:31,126::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0063673 s, 643 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:40:31,295::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:40:31,296::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:40:31,296::task::595::TaskManager.Task::(_updateState) Task=`dbe8a779-a1d0-4ff3-af24-94714bfaf24b`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:40:31,296::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:40:31,297::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:40:31,297::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:40:31,297::task::1185::TaskManager.Task::(prepare) Task=`dbe8a779-a1d0-4ff3-af24-94714bfaf24b`::finished: None >Thread-37::DEBUG::2014-07-24 11:40:31,297::task::595::TaskManager.Task::(_updateState) Task=`dbe8a779-a1d0-4ff3-af24-94714bfaf24b`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:40:31,297::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:40:31,298::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:40:31,298::task::990::TaskManager.Task::(_decref) Task=`dbe8a779-a1d0-4ff3-af24-94714bfaf24b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:40:31,941::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:40:31,952::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:40:31,952::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:40:33,128::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b28052a70> >Thread-27::DEBUG::2014-07-24 11:40:33,129::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:33,154::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0137366 s, 298 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:40:33,154::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:40:33,155::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:33,169::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00416686 s, 983 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:40:33,301::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:40:33,301::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:40:33,302::task::595::TaskManager.Task::(_updateState) Task=`f3868b71-3761-444b-a34b-c17c9faeb560`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:40:33,302::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:40:33,302::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:40:33,303::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:40:33,303::task::1185::TaskManager.Task::(prepare) Task=`f3868b71-3761-444b-a34b-c17c9faeb560`::finished: None >Thread-37::DEBUG::2014-07-24 11:40:33,303::task::595::TaskManager.Task::(_updateState) Task=`f3868b71-3761-444b-a34b-c17c9faeb560`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:40:33,303::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:40:33,303::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:40:33,304::task::990::TaskManager.Task::(_decref) Task=`f3868b71-3761-444b-a34b-c17c9faeb560`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:40:33,953::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:40:33,965::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:40:33,965::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-14::DEBUG::2014-07-24 11:40:34,126::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:40:34,126::task::595::TaskManager.Task::(_updateState) Task=`7d7ac0c0-c6fc-4e6b-9fec-d3e654bec2cf`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:40:34,126::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:40:34,127::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:40:34,127::task::1185::TaskManager.Task::(prepare) Task=`7d7ac0c0-c6fc-4e6b-9fec-d3e654bec2cf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:40:34,127::task::595::TaskManager.Task::(_updateState) Task=`7d7ac0c0-c6fc-4e6b-9fec-d3e654bec2cf`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:40:34,127::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:40:34,127::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:40:34,128::task::990::TaskManager.Task::(_decref) Task=`7d7ac0c0-c6fc-4e6b-9fec-d3e654bec2cf`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:40:34,159::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:40:34,160::task::595::TaskManager.Task::(_updateState) Task=`f9a9dfb5-7c7b-4f1c-b184-70b8be6448c5`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:40:34,160::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:40:34,160::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`a84f5cdb-c7ce-4139-a1d7-5a65ffd488a3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:40:34,161::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:40:34,161::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:40:34,161::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`a84f5cdb-c7ce-4139-a1d7-5a65ffd488a3`::Granted request >Thread-34::DEBUG::2014-07-24 11:40:34,161::task::827::TaskManager.Task::(resourceAcquired) Task=`f9a9dfb5-7c7b-4f1c-b184-70b8be6448c5`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:40:34,161::task::990::TaskManager.Task::(_decref) Task=`f9a9dfb5-7c7b-4f1c-b184-70b8be6448c5`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:40:34,162::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:40:34,162::task::1185::TaskManager.Task::(prepare) Task=`f9a9dfb5-7c7b-4f1c-b184-70b8be6448c5`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:40:34,163::task::595::TaskManager.Task::(_updateState) Task=`f9a9dfb5-7c7b-4f1c-b184-70b8be6448c5`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:40:34,163::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:40:34,163::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:40:34,163::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:40:34,163::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:40:34,164::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:40:34,164::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:40:34,164::task::990::TaskManager.Task::(_decref) Task=`f9a9dfb5-7c7b-4f1c-b184-70b8be6448c5`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:40:35,172::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b2803f7a0> >Thread-27::DEBUG::2014-07-24 11:40:35,172::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:35,208::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0244069 s, 168 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:40:35,209::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:40:35,209::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:35,225::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00584092 s, 701 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:40:35,307::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:40:35,307::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:40:35,308::task::595::TaskManager.Task::(_updateState) Task=`66b48863-6071-47c1-bb96-fde19f5b20d1`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:40:35,308::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:40:35,308::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:40:35,308::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:40:35,309::task::1185::TaskManager.Task::(prepare) Task=`66b48863-6071-47c1-bb96-fde19f5b20d1`::finished: None >Thread-37::DEBUG::2014-07-24 11:40:35,309::task::595::TaskManager.Task::(_updateState) Task=`66b48863-6071-47c1-bb96-fde19f5b20d1`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:40:35,309::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:40:35,309::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:40:35,309::task::990::TaskManager.Task::(_decref) Task=`66b48863-6071-47c1-bb96-fde19f5b20d1`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:40:35,968::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:40:35,979::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:40:35,979::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:40:37,228::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8ac8043b00> >Thread-27::DEBUG::2014-07-24 11:40:37,228::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:37,255::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0145266 s, 282 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:40:37,255::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:40:37,256::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:37,272::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00438811 s, 933 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:40:37,314::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:40:37,314::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:40:37,315::task::595::TaskManager.Task::(_updateState) Task=`f7881f87-7a8e-4493-9df8-daf98dbc3841`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:40:37,315::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:40:37,315::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:40:37,315::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:40:37,316::task::1185::TaskManager.Task::(prepare) Task=`f7881f87-7a8e-4493-9df8-daf98dbc3841`::finished: None >Thread-37::DEBUG::2014-07-24 11:40:37,316::task::595::TaskManager.Task::(_updateState) Task=`f7881f87-7a8e-4493-9df8-daf98dbc3841`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:40:37,316::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:40:37,316::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:40:37,316::task::990::TaskManager.Task::(_decref) Task=`f7881f87-7a8e-4493-9df8-daf98dbc3841`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:40:37,982::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:40:37,992::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:40:37,993::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-14::DEBUG::2014-07-24 11:40:38,725::task::595::TaskManager.Task::(_updateState) Task=`90f7d3d5-58f4-465b-b704-f938a8f7df08`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:40:38,732::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:40:38,733::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00960603', 'lastCheck': '9.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:40:38,733::task::1185::TaskManager.Task::(prepare) Task=`90f7d3d5-58f4-465b-b704-f938a8f7df08`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00960603', 'lastCheck': '9.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:40:38,733::task::595::TaskManager.Task::(_updateState) Task=`90f7d3d5-58f4-465b-b704-f938a8f7df08`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:40:38,733::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:40:38,733::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:40:38,734::task::990::TaskManager.Task::(_decref) Task=`90f7d3d5-58f4-465b-b704-f938a8f7df08`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:40:39,275::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8ac8047c68> >Thread-27::DEBUG::2014-07-24 11:40:39,275::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:39,303::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0173306 s, 236 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:40:39,304::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:40:39,304::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:39,320::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00591359 s, 693 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:40:39,325::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:40:39,325::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:40:39,325::task::595::TaskManager.Task::(_updateState) Task=`3e037e32-665a-44fe-855c-7e9f3c20a242`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:40:39,326::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:40:39,326::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:40:39,326::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:40:39,326::task::1185::TaskManager.Task::(prepare) Task=`3e037e32-665a-44fe-855c-7e9f3c20a242`::finished: None >Thread-37::DEBUG::2014-07-24 11:40:39,326::task::595::TaskManager.Task::(_updateState) Task=`3e037e32-665a-44fe-855c-7e9f3c20a242`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:40:39,327::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:40:39,327::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:40:39,327::task::990::TaskManager.Task::(_decref) Task=`3e037e32-665a-44fe-855c-7e9f3c20a242`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:40:39,540::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:40:39,561::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.010149 s, 404 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:40:39,995::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:40:40,006::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:40:40,007::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:40:41,323::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8ac8047c68> >Thread-27::DEBUG::2014-07-24 11:40:41,324::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-37::INFO::2014-07-24 11:40:41,335::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:40:41,336::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:40:41,336::task::595::TaskManager.Task::(_updateState) Task=`84e71083-a32f-418c-ae06-75bf1b17dc9d`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:40:41,336::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:40:41,337::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:40:41,337::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:40:41,337::task::1185::TaskManager.Task::(prepare) Task=`84e71083-a32f-418c-ae06-75bf1b17dc9d`::finished: None >Thread-37::DEBUG::2014-07-24 11:40:41,337::task::595::TaskManager.Task::(_updateState) Task=`84e71083-a32f-418c-ae06-75bf1b17dc9d`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:40:41,337::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:40:41,338::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:40:41,338::task::990::TaskManager.Task::(_decref) Task=`84e71083-a32f-418c-ae06-75bf1b17dc9d`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:40:41,371::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0356874 s, 115 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:40:41,371::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:40:41,372::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:41,389::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00656154 s, 624 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:40:42,009::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:40:42,020::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:40:42,020::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-37::INFO::2014-07-24 11:40:43,341::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:40:43,342::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:40:43,342::task::595::TaskManager.Task::(_updateState) Task=`b4f8da05-6011-4d6a-a928-07415c4fa2ae`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:40:43,342::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:40:43,343::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:40:43,343::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:40:43,343::task::1185::TaskManager.Task::(prepare) Task=`b4f8da05-6011-4d6a-a928-07415c4fa2ae`::finished: None >Thread-37::DEBUG::2014-07-24 11:40:43,343::task::595::TaskManager.Task::(_updateState) Task=`b4f8da05-6011-4d6a-a928-07415c4fa2ae`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:40:43,343::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:40:43,343::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:40:43,344::task::990::TaskManager.Task::(_decref) Task=`b4f8da05-6011-4d6a-a928-07415c4fa2ae`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:40:43,391::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b28056440> >Thread-27::DEBUG::2014-07-24 11:40:43,392::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b28052cf8> >Thread-27::DEBUG::2014-07-24 11:40:43,392::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:43,432::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0281288 s, 146 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:40:43,432::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:40:43,433::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:43,448::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00464773 s, 881 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:40:44,022::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:40:44,036::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:40:44,036::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-14::DEBUG::2014-07-24 11:40:44,219::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [3b38bf98] >Thread-14::DEBUG::2014-07-24 11:40:44,219::task::595::TaskManager.Task::(_updateState) Task=`2059362e-e1b2-4462-a94f-ba37ab2d1497`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:40:44,219::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:40:44,220::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:40:44,220::task::1185::TaskManager.Task::(prepare) Task=`2059362e-e1b2-4462-a94f-ba37ab2d1497`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:40:44,220::task::595::TaskManager.Task::(_updateState) Task=`2059362e-e1b2-4462-a94f-ba37ab2d1497`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:40:44,220::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:40:44,221::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:40:44,221::task::990::TaskManager.Task::(_decref) Task=`2059362e-e1b2-4462-a94f-ba37ab2d1497`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:40:44,255::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [3b38bf98] >Thread-34::DEBUG::2014-07-24 11:40:44,255::task::595::TaskManager.Task::(_updateState) Task=`42633f8e-dffc-4b87-a6de-f4c811dc107a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:40:44,255::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:40:44,256::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e6c1fd68-8576-4d04-8350-73fd9dc7aa4b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:40:44,256::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:40:44,256::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:40:44,256::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e6c1fd68-8576-4d04-8350-73fd9dc7aa4b`::Granted request >Thread-34::DEBUG::2014-07-24 11:40:44,257::task::827::TaskManager.Task::(resourceAcquired) Task=`42633f8e-dffc-4b87-a6de-f4c811dc107a`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:40:44,257::task::990::TaskManager.Task::(_decref) Task=`42633f8e-dffc-4b87-a6de-f4c811dc107a`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:40:44,258::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:40:44,258::task::1185::TaskManager.Task::(prepare) Task=`42633f8e-dffc-4b87-a6de-f4c811dc107a`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:40:44,258::task::595::TaskManager.Task::(_updateState) Task=`42633f8e-dffc-4b87-a6de-f4c811dc107a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:40:44,258::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:40:44,258::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:40:44,258::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:40:44,259::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:40:44,259::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:40:44,259::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:40:44,259::task::990::TaskManager.Task::(_decref) Task=`42633f8e-dffc-4b87-a6de-f4c811dc107a`::ref 0 aborting False >Thread-37::INFO::2014-07-24 11:40:45,347::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:40:45,348::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:40:45,348::task::595::TaskManager.Task::(_updateState) Task=`b2fed4c9-81c7-4700-9354-7eed1f5f7d36`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:40:45,348::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:40:45,349::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:40:45,349::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:40:45,349::task::1185::TaskManager.Task::(prepare) Task=`b2fed4c9-81c7-4700-9354-7eed1f5f7d36`::finished: None >Thread-37::DEBUG::2014-07-24 11:40:45,349::task::595::TaskManager.Task::(_updateState) Task=`b2fed4c9-81c7-4700-9354-7eed1f5f7d36`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:40:45,349::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:40:45,349::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:40:45,350::task::990::TaskManager.Task::(_decref) Task=`b2fed4c9-81c7-4700-9354-7eed1f5f7d36`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:40:45,450::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b28056368> >Thread-27::DEBUG::2014-07-24 11:40:45,451::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:45,488::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0254163 s, 161 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:40:45,489::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:40:45,489::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:45,505::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00579024 s, 707 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:40:46,039::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:40:46,049::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:40:46,050::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-37::INFO::2014-07-24 11:40:47,354::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:40:47,354::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:40:47,354::task::595::TaskManager.Task::(_updateState) Task=`b40b4006-a1c5-47df-9765-cb9a7a35b6ce`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:40:47,355::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:40:47,355::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:40:47,355::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:40:47,355::task::1185::TaskManager.Task::(prepare) Task=`b40b4006-a1c5-47df-9765-cb9a7a35b6ce`::finished: None >Thread-37::DEBUG::2014-07-24 11:40:47,355::task::595::TaskManager.Task::(_updateState) Task=`b40b4006-a1c5-47df-9765-cb9a7a35b6ce`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:40:47,356::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:40:47,356::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:40:47,356::task::990::TaskManager.Task::(_decref) Task=`b40b4006-a1c5-47df-9765-cb9a7a35b6ce`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:40:47,508::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b2814e680> >Thread-27::DEBUG::2014-07-24 11:40:47,508::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:47,528::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00871398 s, 470 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:40:47,529::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:40:47,529::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:47,544::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00454275 s, 902 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:40:48,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:40:48,063::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:40:48,063::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-37::INFO::2014-07-24 11:40:49,359::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:40:49,360::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:40:49,360::task::595::TaskManager.Task::(_updateState) Task=`0e4a4449-dc80-495e-beaf-110167498ca7`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:40:49,360::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:40:49,361::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:40:49,361::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:40:49,361::task::1185::TaskManager.Task::(prepare) Task=`0e4a4449-dc80-495e-beaf-110167498ca7`::finished: None >Thread-37::DEBUG::2014-07-24 11:40:49,361::task::595::TaskManager.Task::(_updateState) Task=`0e4a4449-dc80-495e-beaf-110167498ca7`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:40:49,361::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:40:49,362::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:40:49,362::task::990::TaskManager.Task::(_decref) Task=`0e4a4449-dc80-495e-beaf-110167498ca7`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:40:49,547::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8ac8318128> >Thread-27::DEBUG::2014-07-24 11:40:49,547::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:49,562::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00343976 s, 1.2 MB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:40:49,562::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:40:49,563::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-18::DEBUG::2014-07-24 11:40:49,574::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:40:49,595::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0103499 s, 396 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:40:50,066::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:40:50,076::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:40:50,077::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:40:50,576::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00279 s, 4.1 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:40:51,366::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:40:51,366::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:40:51,367::task::595::TaskManager.Task::(_updateState) Task=`1b58a0ea-b2a5-4d85-808a-9204fe8be76c`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:40:51,367::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:40:51,367::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:40:51,367::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:40:51,368::task::1185::TaskManager.Task::(prepare) Task=`1b58a0ea-b2a5-4d85-808a-9204fe8be76c`::finished: None >Thread-37::DEBUG::2014-07-24 11:40:51,368::task::595::TaskManager.Task::(_updateState) Task=`1b58a0ea-b2a5-4d85-808a-9204fe8be76c`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:40:51,368::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:40:51,368::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:40:51,368::task::990::TaskManager.Task::(_decref) Task=`1b58a0ea-b2a5-4d85-808a-9204fe8be76c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:40:52,079::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:40:52,090::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:40:52,090::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:40:52,579::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b28061518> >Thread-27::DEBUG::2014-07-24 11:40:52,579::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:52,610::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0196803 s, 208 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:40:52,610::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:40:52,611::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:52,626::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00535243 s, 765 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:40:53,377::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:40:53,377::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:40:53,377::task::595::TaskManager.Task::(_updateState) Task=`51d3b437-6341-4c88-8d12-bcdadde4da93`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:40:53,377::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:40:53,378::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:40:53,378::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:40:53,378::task::1185::TaskManager.Task::(prepare) Task=`51d3b437-6341-4c88-8d12-bcdadde4da93`::finished: None >Thread-37::DEBUG::2014-07-24 11:40:53,378::task::595::TaskManager.Task::(_updateState) Task=`51d3b437-6341-4c88-8d12-bcdadde4da93`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:40:53,378::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:40:53,379::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:40:53,379::task::990::TaskManager.Task::(_decref) Task=`51d3b437-6341-4c88-8d12-bcdadde4da93`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:40:54,093::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:40:54,103::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:40:54,104::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-14::DEBUG::2014-07-24 11:40:54,113::task::595::TaskManager.Task::(_updateState) Task=`343dc1ca-48d0-4165-9176-ca89711842bc`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:40:54,113::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:40:54,114::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0103499', 'lastCheck': '4.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:40:54,114::task::1185::TaskManager.Task::(prepare) Task=`343dc1ca-48d0-4165-9176-ca89711842bc`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0103499', 'lastCheck': '4.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:40:54,114::task::595::TaskManager.Task::(_updateState) Task=`343dc1ca-48d0-4165-9176-ca89711842bc`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:40:54,114::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:40:54,114::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:40:54,115::task::990::TaskManager.Task::(_decref) Task=`343dc1ca-48d0-4165-9176-ca89711842bc`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 11:40:54,321::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:40:54,322::task::595::TaskManager.Task::(_updateState) Task=`8bbd8de3-c089-4c7c-bb7b-0e54f3f1269c`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:40:54,322::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:40:54,322::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:40:54,322::task::1185::TaskManager.Task::(prepare) Task=`8bbd8de3-c089-4c7c-bb7b-0e54f3f1269c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:40:54,322::task::595::TaskManager.Task::(_updateState) Task=`8bbd8de3-c089-4c7c-bb7b-0e54f3f1269c`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:40:54,323::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:40:54,323::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:40:54,323::task::990::TaskManager.Task::(_decref) Task=`8bbd8de3-c089-4c7c-bb7b-0e54f3f1269c`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:40:54,355::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:40:54,356::task::595::TaskManager.Task::(_updateState) Task=`5cf69efc-3727-444f-ad63-1fe36aef912b`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:40:54,356::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:40:54,356::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`657532bd-8472-4cf0-9321-4c3a821a0cdf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:40:54,356::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:40:54,366::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:40:54,366::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`657532bd-8472-4cf0-9321-4c3a821a0cdf`::Granted request >Thread-34::DEBUG::2014-07-24 11:40:54,367::task::827::TaskManager.Task::(resourceAcquired) Task=`5cf69efc-3727-444f-ad63-1fe36aef912b`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:40:54,367::task::990::TaskManager.Task::(_decref) Task=`5cf69efc-3727-444f-ad63-1fe36aef912b`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:40:54,367::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:40:54,368::task::1185::TaskManager.Task::(prepare) Task=`5cf69efc-3727-444f-ad63-1fe36aef912b`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:40:54,368::task::595::TaskManager.Task::(_updateState) Task=`5cf69efc-3727-444f-ad63-1fe36aef912b`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:40:54,368::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:40:54,368::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:40:54,368::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:40:54,369::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:40:54,369::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:40:54,369::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:40:54,369::task::990::TaskManager.Task::(_decref) Task=`5cf69efc-3727-444f-ad63-1fe36aef912b`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:40:54,629::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b28063ea8> >Thread-27::DEBUG::2014-07-24 11:40:54,629::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:54,661::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0196816 s, 208 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:40:54,661::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:40:54,662::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:54,677::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0045342 s, 903 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:40:55,382::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:40:55,383::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:40:55,383::task::595::TaskManager.Task::(_updateState) Task=`b481213c-9e9a-4d12-8c6f-623fdfa303c2`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:40:55,383::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:40:55,384::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:40:55,384::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:40:55,384::task::1185::TaskManager.Task::(prepare) Task=`b481213c-9e9a-4d12-8c6f-623fdfa303c2`::finished: None >Thread-37::DEBUG::2014-07-24 11:40:55,384::task::595::TaskManager.Task::(_updateState) Task=`b481213c-9e9a-4d12-8c6f-623fdfa303c2`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:40:55,384::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:40:55,384::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:40:55,385::task::990::TaskManager.Task::(_decref) Task=`b481213c-9e9a-4d12-8c6f-623fdfa303c2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:40:56,106::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:40:56,117::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:40:56,117::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:40:56,679::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b280d9ef0> >Thread-27::DEBUG::2014-07-24 11:40:56,680::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:56,711::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0202074 s, 203 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:40:56,712::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:40:56,712::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:56,727::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00445295 s, 920 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:40:57,388::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:40:57,388::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:40:57,389::task::595::TaskManager.Task::(_updateState) Task=`dd149adf-d627-4fe4-8934-3dd2939bbe46`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:40:57,389::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:40:57,389::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:40:57,390::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:40:57,390::task::1185::TaskManager.Task::(prepare) Task=`dd149adf-d627-4fe4-8934-3dd2939bbe46`::finished: None >Thread-37::DEBUG::2014-07-24 11:40:57,390::task::595::TaskManager.Task::(_updateState) Task=`dd149adf-d627-4fe4-8934-3dd2939bbe46`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:40:57,390::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:40:57,390::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:40:57,390::task::990::TaskManager.Task::(_decref) Task=`dd149adf-d627-4fe4-8934-3dd2939bbe46`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:40:58,120::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:40:58,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:40:58,131::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:40:58,729::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b28069f38> >Thread-27::DEBUG::2014-07-24 11:40:58,730::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:58,780::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0381999 s, 107 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:40:58,781::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:40:58,781::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:40:58,797::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0054338 s, 754 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:40:59,404::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:40:59,404::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:40:59,405::task::595::TaskManager.Task::(_updateState) Task=`fe0b9b0a-0d11-4423-9f07-aa741fddd5a0`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:40:59,405::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:40:59,405::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:40:59,405::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:40:59,406::task::1185::TaskManager.Task::(prepare) Task=`fe0b9b0a-0d11-4423-9f07-aa741fddd5a0`::finished: None >Thread-37::DEBUG::2014-07-24 11:40:59,406::task::595::TaskManager.Task::(_updateState) Task=`fe0b9b0a-0d11-4423-9f07-aa741fddd5a0`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:40:59,406::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:40:59,406::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:40:59,406::task::990::TaskManager.Task::(_decref) Task=`fe0b9b0a-0d11-4423-9f07-aa741fddd5a0`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:40:59,599::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:40:59,620::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0100241 s, 409 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:41:00,133::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:41:00,144::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:41:00,144::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:41:00,799::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b280beea8> >Thread-27::DEBUG::2014-07-24 11:41:00,800::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:41:00,843::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0313946 s, 130 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:41:00,843::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:41:00,843::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:41:00,858::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00476222 s, 860 kB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:41:01,045::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-37::INFO::2014-07-24 11:41:01,410::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:41:01,410::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:41:01,411::task::595::TaskManager.Task::(_updateState) Task=`b4d64c61-8141-4384-91c3-54c702b36c8c`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:41:01,411::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:41:01,412::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:41:01,412::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:41:01,412::task::1185::TaskManager.Task::(prepare) Task=`b4d64c61-8141-4384-91c3-54c702b36c8c`::finished: None >Thread-37::DEBUG::2014-07-24 11:41:01,412::task::595::TaskManager.Task::(_updateState) Task=`b4d64c61-8141-4384-91c3-54c702b36c8c`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:41:01,412::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:41:01,412::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:41:01,413::task::990::TaskManager.Task::(_decref) Task=`b4d64c61-8141-4384-91c3-54c702b36c8c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:41:02,147::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:41:02,157::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:41:02,157::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:41:02,861::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b2809cc20> >Thread-27::DEBUG::2014-07-24 11:41:02,862::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:41:02,883::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0106216 s, 386 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:41:02,884::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:41:02,884::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:41:02,899::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00484606 s, 845 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:41:03,416::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:41:03,417::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:41:03,417::task::595::TaskManager.Task::(_updateState) Task=`2dcc4a5f-3567-4135-bc88-7de954a6e162`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:41:03,417::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:41:03,418::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:41:03,418::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:41:03,418::task::1185::TaskManager.Task::(prepare) Task=`2dcc4a5f-3567-4135-bc88-7de954a6e162`::finished: None >Thread-37::DEBUG::2014-07-24 11:41:03,418::task::595::TaskManager.Task::(_updateState) Task=`2dcc4a5f-3567-4135-bc88-7de954a6e162`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:41:03,418::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:41:03,418::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:41:03,418::task::990::TaskManager.Task::(_decref) Task=`2dcc4a5f-3567-4135-bc88-7de954a6e162`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:41:04,160::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:41:04,170::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:41:04,171::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-14::DEBUG::2014-07-24 11:41:04,421::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:41:04,437::task::595::TaskManager.Task::(_updateState) Task=`38e618e1-f0e2-4683-ba21-28baa333e6a6`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:41:04,438::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:41:04,438::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:41:04,438::task::1185::TaskManager.Task::(prepare) Task=`38e618e1-f0e2-4683-ba21-28baa333e6a6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:41:04,438::task::595::TaskManager.Task::(_updateState) Task=`38e618e1-f0e2-4683-ba21-28baa333e6a6`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:41:04,439::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:41:04,439::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:41:04,439::task::990::TaskManager.Task::(_decref) Task=`38e618e1-f0e2-4683-ba21-28baa333e6a6`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:41:04,470::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:41:04,470::task::595::TaskManager.Task::(_updateState) Task=`aaf943a1-100d-44f3-96e8-be39811070f8`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:41:04,471::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:41:04,471::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`0485a950-5a7f-417a-ae53-ef93ae116520`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:41:04,471::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:41:04,472::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:41:04,472::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`0485a950-5a7f-417a-ae53-ef93ae116520`::Granted request >Thread-34::DEBUG::2014-07-24 11:41:04,472::task::827::TaskManager.Task::(resourceAcquired) Task=`aaf943a1-100d-44f3-96e8-be39811070f8`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:41:04,472::task::990::TaskManager.Task::(_decref) Task=`aaf943a1-100d-44f3-96e8-be39811070f8`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:41:04,473::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:41:04,473::task::1185::TaskManager.Task::(prepare) Task=`aaf943a1-100d-44f3-96e8-be39811070f8`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:41:04,473::task::595::TaskManager.Task::(_updateState) Task=`aaf943a1-100d-44f3-96e8-be39811070f8`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:41:04,474::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:41:04,474::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:41:04,474::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:41:04,474::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:41:04,474::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:41:04,474::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:41:04,475::task::990::TaskManager.Task::(_decref) Task=`aaf943a1-100d-44f3-96e8-be39811070f8`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:41:04,902::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b28041050> >Thread-27::DEBUG::2014-07-24 11:41:04,902::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:41:05,100::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.185846 s, 22.0 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:41:05,100::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:41:05,100::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:41:05,123::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0115518 s, 355 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:41:05,422::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:41:05,423::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:41:05,423::task::595::TaskManager.Task::(_updateState) Task=`3acb0a74-abbc-4dc1-82a2-362b8ca7b8da`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:41:05,423::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:41:05,424::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:41:05,424::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:41:05,424::task::1185::TaskManager.Task::(prepare) Task=`3acb0a74-abbc-4dc1-82a2-362b8ca7b8da`::finished: None >Thread-37::DEBUG::2014-07-24 11:41:05,424::task::595::TaskManager.Task::(_updateState) Task=`3acb0a74-abbc-4dc1-82a2-362b8ca7b8da`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:41:05,424::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:41:05,424::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:41:05,425::task::990::TaskManager.Task::(_decref) Task=`3acb0a74-abbc-4dc1-82a2-362b8ca7b8da`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:41:06,173::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:41:06,183::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:41:06,184::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:41:07,124::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b28144ef0> >Thread-27::DEBUG::2014-07-24 11:41:07,124::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:41:07,160::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0242502 s, 169 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:41:07,160::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:41:07,160::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:41:07,177::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0056387 s, 726 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:41:07,428::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:41:07,429::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:41:07,429::task::595::TaskManager.Task::(_updateState) Task=`16fa3ee2-98ad-49dd-a268-58e59e73490b`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:41:07,429::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:41:07,430::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:41:07,430::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:41:07,430::task::1185::TaskManager.Task::(prepare) Task=`16fa3ee2-98ad-49dd-a268-58e59e73490b`::finished: None >Thread-37::DEBUG::2014-07-24 11:41:07,430::task::595::TaskManager.Task::(_updateState) Task=`16fa3ee2-98ad-49dd-a268-58e59e73490b`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:41:07,430::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:41:07,431::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:41:07,431::task::990::TaskManager.Task::(_decref) Task=`16fa3ee2-98ad-49dd-a268-58e59e73490b`::ref 0 aborting False >Thread-37::DEBUG::2014-07-24 11:41:07,431::task::595::TaskManager.Task::(_updateState) Task=`3ca25893-4fb7-454e-a9c1-7e3d76597745`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:41:07,431::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:41:07,432::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-37::DEBUG::2014-07-24 11:41:07,432::task::1185::TaskManager.Task::(prepare) Task=`3ca25893-4fb7-454e-a9c1-7e3d76597745`::finished: {'truesize': '5368709120', 'apparentsize': '5368709120'} >Thread-37::DEBUG::2014-07-24 11:41:07,432::task::595::TaskManager.Task::(_updateState) Task=`3ca25893-4fb7-454e-a9c1-7e3d76597745`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:41:07,432::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:41:07,432::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:41:07,432::task::990::TaskManager.Task::(_decref) Task=`3ca25893-4fb7-454e-a9c1-7e3d76597745`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:41:08,186::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:41:08,196::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:41:08,197::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:41:09,179::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b141a6b00> >Thread-27::DEBUG::2014-07-24 11:41:09,180::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:41:09,211::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0194449 s, 211 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:41:09,211::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:41:09,211::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:41:09,227::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00532927 s, 769 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:41:09,460::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:41:09,472::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:41:09,473::task::595::TaskManager.Task::(_updateState) Task=`e15dffc4-1e99-4862-8134-3c5d790978d2`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:41:09,473::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:41:09,474::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:41:09,474::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:41:09,474::task::1185::TaskManager.Task::(prepare) Task=`e15dffc4-1e99-4862-8134-3c5d790978d2`::finished: None >Thread-37::DEBUG::2014-07-24 11:41:09,474::task::595::TaskManager.Task::(_updateState) Task=`e15dffc4-1e99-4862-8134-3c5d790978d2`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:41:09,474::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:41:09,474::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:41:09,474::task::990::TaskManager.Task::(_decref) Task=`e15dffc4-1e99-4862-8134-3c5d790978d2`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 11:41:09,543::task::595::TaskManager.Task::(_updateState) Task=`25e577c0-ed4a-499c-bab8-76c40e69c37d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:41:09,543::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:41:09,543::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0100241', 'lastCheck': '9.9', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:41:09,543::task::1185::TaskManager.Task::(prepare) Task=`25e577c0-ed4a-499c-bab8-76c40e69c37d`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0100241', 'lastCheck': '9.9', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:41:09,544::task::595::TaskManager.Task::(_updateState) Task=`25e577c0-ed4a-499c-bab8-76c40e69c37d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:41:09,544::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:41:09,544::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:41:09,544::task::990::TaskManager.Task::(_decref) Task=`25e577c0-ed4a-499c-bab8-76c40e69c37d`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:41:09,624::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:41:09,645::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00969572 s, 422 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:41:10,199::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:41:10,210::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:41:10,210::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:41:11,230::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b280bea70> >Thread-27::DEBUG::2014-07-24 11:41:11,230::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-37::INFO::2014-07-24 11:41:11,478::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:41:11,479::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:41:11,479::task::595::TaskManager.Task::(_updateState) Task=`6dab27b1-f863-4e0f-be74-8a06676b2247`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:41:11,479::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:41:11,480::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:41:11,480::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:41:11,480::task::1185::TaskManager.Task::(prepare) Task=`6dab27b1-f863-4e0f-be74-8a06676b2247`::finished: None >Thread-37::DEBUG::2014-07-24 11:41:11,480::task::595::TaskManager.Task::(_updateState) Task=`6dab27b1-f863-4e0f-be74-8a06676b2247`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:41:11,480::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:41:11,481::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:41:11,481::task::990::TaskManager.Task::(_decref) Task=`6dab27b1-f863-4e0f-be74-8a06676b2247`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:41:11,525::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.28292 s, 14.5 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:41:11,525::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:41:11,525::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:41:11,543::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00579002 s, 707 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:41:12,213::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:41:12,222::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:41:12,223::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-37::INFO::2014-07-24 11:41:13,489::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:41:13,490::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:41:13,490::task::595::TaskManager.Task::(_updateState) Task=`c133c11a-7b2b-42d6-931e-59f5d463d6a8`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:41:13,490::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:41:13,491::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:41:13,491::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:41:13,491::task::1185::TaskManager.Task::(prepare) Task=`c133c11a-7b2b-42d6-931e-59f5d463d6a8`::finished: None >Thread-37::DEBUG::2014-07-24 11:41:13,491::task::595::TaskManager.Task::(_updateState) Task=`c133c11a-7b2b-42d6-931e-59f5d463d6a8`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:41:13,491::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:41:13,491::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:41:13,492::task::990::TaskManager.Task::(_decref) Task=`c133c11a-7b2b-42d6-931e-59f5d463d6a8`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:41:13,546::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b280b41b8> >Thread-27::DEBUG::2014-07-24 11:41:13,546::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b2809f6c8> >Thread-27::DEBUG::2014-07-24 11:41:13,546::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:41:13,917::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.36004 s, 11.4 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:41:13,918::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:41:13,918::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:41:13,933::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00451416 s, 907 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:41:14,225::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:41:14,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:41:14,236::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-14::DEBUG::2014-07-24 11:41:14,544::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:41:14,556::task::595::TaskManager.Task::(_updateState) Task=`2da879b4-aa0b-457f-bdad-7f0d3d22aa06`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:41:14,557::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:41:14,557::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:41:14,557::task::1185::TaskManager.Task::(prepare) Task=`2da879b4-aa0b-457f-bdad-7f0d3d22aa06`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:41:14,557::task::595::TaskManager.Task::(_updateState) Task=`2da879b4-aa0b-457f-bdad-7f0d3d22aa06`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:41:14,557::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:41:14,558::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:41:14,558::task::990::TaskManager.Task::(_decref) Task=`2da879b4-aa0b-457f-bdad-7f0d3d22aa06`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:41:14,589::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:41:14,590::task::595::TaskManager.Task::(_updateState) Task=`bcf230b5-3a8a-4608-b1fb-0e49cdb3c1e5`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:41:14,590::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:41:14,591::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`352bf73c-6373-465b-98f5-4abf95d215f6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:41:14,592::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:41:14,592::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:41:14,592::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`352bf73c-6373-465b-98f5-4abf95d215f6`::Granted request >Thread-34::DEBUG::2014-07-24 11:41:14,592::task::827::TaskManager.Task::(resourceAcquired) Task=`bcf230b5-3a8a-4608-b1fb-0e49cdb3c1e5`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:41:14,593::task::990::TaskManager.Task::(_decref) Task=`bcf230b5-3a8a-4608-b1fb-0e49cdb3c1e5`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:41:14,593::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:41:14,593::task::1185::TaskManager.Task::(prepare) Task=`bcf230b5-3a8a-4608-b1fb-0e49cdb3c1e5`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:41:14,594::task::595::TaskManager.Task::(_updateState) Task=`bcf230b5-3a8a-4608-b1fb-0e49cdb3c1e5`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:41:14,594::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:41:14,594::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:41:14,594::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:41:14,594::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:41:14,594::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:41:14,595::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:41:14,595::task::990::TaskManager.Task::(_decref) Task=`bcf230b5-3a8a-4608-b1fb-0e49cdb3c1e5`::ref 0 aborting False >Thread-37::INFO::2014-07-24 11:41:15,495::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:41:15,496::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:41:15,496::task::595::TaskManager.Task::(_updateState) Task=`187a6e7c-f0e1-4fb4-b25d-7a0c62784a99`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:41:15,496::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:41:15,497::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:41:15,497::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:41:15,497::task::1185::TaskManager.Task::(prepare) Task=`187a6e7c-f0e1-4fb4-b25d-7a0c62784a99`::finished: None >Thread-37::DEBUG::2014-07-24 11:41:15,497::task::595::TaskManager.Task::(_updateState) Task=`187a6e7c-f0e1-4fb4-b25d-7a0c62784a99`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:41:15,497::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:41:15,497::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:41:15,497::task::990::TaskManager.Task::(_decref) Task=`187a6e7c-f0e1-4fb4-b25d-7a0c62784a99`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:41:15,935::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b280529e0> >Thread-27::DEBUG::2014-07-24 11:41:15,935::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:41:16,148::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.201682 s, 20.3 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:41:16,148::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:41:16,149::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:41:16,164::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00477405 s, 858 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:41:16,238::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:41:16,248::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:41:16,249::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-37::INFO::2014-07-24 11:41:17,501::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:41:17,502::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:41:17,502::task::595::TaskManager.Task::(_updateState) Task=`302b845e-319e-4aac-bb87-c805e98f3c94`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:41:17,502::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:41:17,503::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:41:17,503::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:41:17,503::task::1185::TaskManager.Task::(prepare) Task=`302b845e-319e-4aac-bb87-c805e98f3c94`::finished: None >Thread-37::DEBUG::2014-07-24 11:41:17,503::task::595::TaskManager.Task::(_updateState) Task=`302b845e-319e-4aac-bb87-c805e98f3c94`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:41:17,503::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:41:17,503::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:41:17,504::task::990::TaskManager.Task::(_decref) Task=`302b845e-319e-4aac-bb87-c805e98f3c94`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:41:18,167::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b141a43f8> >Thread-27::DEBUG::2014-07-24 11:41:18,167::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:41:18,252::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:41:18,261::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:41:18,262::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:41:18,539::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.360973 s, 11.3 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:41:18,539::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:41:18,540::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:41:18,555::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00475109 s, 862 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:41:19,507::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:41:19,507::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:41:19,508::task::595::TaskManager.Task::(_updateState) Task=`ca47ebf7-4664-4541-932d-60742c2ba849`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:41:19,508::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:41:19,509::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:41:19,511::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:41:19,512::task::1185::TaskManager.Task::(prepare) Task=`ca47ebf7-4664-4541-932d-60742c2ba849`::finished: None >Thread-37::DEBUG::2014-07-24 11:41:19,514::task::595::TaskManager.Task::(_updateState) Task=`ca47ebf7-4664-4541-932d-60742c2ba849`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:41:19,515::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:41:19,515::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:41:19,515::task::990::TaskManager.Task::(_decref) Task=`ca47ebf7-4664-4541-932d-60742c2ba849`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:41:19,649::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 23aa0606-edc3-4882-a4aa-18aa1983458f >Thread-18::DEBUG::2014-07-24 11:41:19,650::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-18::DEBUG::2014-07-24 11:41:19,650::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:41:19,671::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.0101228 s, 202 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:41:19,671::misc::264::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.0101228 s, 202 kB/s'], size: 2048 >Thread-18::DEBUG::2014-07-24 11:41:19,671::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-18::WARNING::2014-07-24 11:41:19,671::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-18::DEBUG::2014-07-24 11:41:19,671::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-18::DEBUG::2014-07-24 11:41:19,672::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 11:41:19,672::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 11:41:19,672::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 11:41:19,673::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 11:41:19,673::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 11:41:19,673::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-18::DEBUG::2014-07-24 11:41:19,898::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:41:19,899::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 11:41:19,899::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'LOCKPOLICY=', 'POOL_DOMAINS=23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'POOL_DESCRIPTION=DS1', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_UUID=637ea13c-81a8-4b44-8cab-961458b01883', 'POOL_SPM_ID=1', '_SHA_CKSUM=a749afdc7119a2d6aad840af5c63c9b28c0b612c', 'POOL_SPM_LVER=0'] >Thread-18::INFO::2014-07-24 11:41:19,900::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_imageNS already registered >Thread-18::INFO::2014-07-24 11:41:19,901::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_volumeNS already registered >Thread-18::INFO::2014-07-24 11:41:19,901::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_lvmActivationNS already registered >Thread-18::DEBUG::2014-07-24 11:41:19,901::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-18::DEBUG::2014-07-24 11:41:20,056::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:41:20,057::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:41:20,069::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000999744 s, 4.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:41:20,265::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:41:20,274::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:41:20,275::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:41:20,558::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b141a6e60> >Thread-27::DEBUG::2014-07-24 11:41:20,558::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:41:20,882::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.311873 s, 13.1 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:41:20,882::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:41:20,883::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:41:20,898::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00439463 s, 932 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:41:21,519::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:41:21,519::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:41:21,520::task::595::TaskManager.Task::(_updateState) Task=`e6217bfd-d3e1-4149-95d7-d872c7cfef03`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:41:21,520::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:41:21,520::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:41:21,520::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:41:21,521::task::1185::TaskManager.Task::(prepare) Task=`e6217bfd-d3e1-4149-95d7-d872c7cfef03`::finished: None >Thread-37::DEBUG::2014-07-24 11:41:21,521::task::595::TaskManager.Task::(_updateState) Task=`e6217bfd-d3e1-4149-95d7-d872c7cfef03`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:41:21,521::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:41:21,521::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:41:21,521::task::990::TaskManager.Task::(_decref) Task=`e6217bfd-d3e1-4149-95d7-d872c7cfef03`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:41:22,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:41:22,287::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:41:22,288::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:41:22,900::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b281512d8> >Thread-27::DEBUG::2014-07-24 11:41:22,901::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:41:23,272::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.360578 s, 11.4 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:41:23,273::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:41:23,273::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:41:23,291::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00806961 s, 508 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:41:23,529::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:41:23,530::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:41:23,530::task::595::TaskManager.Task::(_updateState) Task=`ae7bb02d-ba28-4bf8-b17c-3655b6cd3b83`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:41:23,531::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:41:23,531::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:41:23,531::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:41:23,531::task::1185::TaskManager.Task::(prepare) Task=`ae7bb02d-ba28-4bf8-b17c-3655b6cd3b83`::finished: None >Thread-37::DEBUG::2014-07-24 11:41:23,531::task::595::TaskManager.Task::(_updateState) Task=`ae7bb02d-ba28-4bf8-b17c-3655b6cd3b83`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:41:23,531::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:41:23,532::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:41:23,532::task::990::TaskManager.Task::(_decref) Task=`ae7bb02d-ba28-4bf8-b17c-3655b6cd3b83`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:41:24,290::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:41:24,300::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:41:24,301::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-14::DEBUG::2014-07-24 11:41:24,685::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:41:24,699::task::595::TaskManager.Task::(_updateState) Task=`2962a660-9f88-4892-b81d-648fbf1cc143`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:41:24,700::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:41:24,700::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:41:24,700::task::1185::TaskManager.Task::(prepare) Task=`2962a660-9f88-4892-b81d-648fbf1cc143`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:41:24,700::task::595::TaskManager.Task::(_updateState) Task=`2962a660-9f88-4892-b81d-648fbf1cc143`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:41:24,701::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:41:24,701::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:41:24,701::task::990::TaskManager.Task::(_decref) Task=`2962a660-9f88-4892-b81d-648fbf1cc143`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:41:24,735::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:41:24,735::task::595::TaskManager.Task::(_updateState) Task=`1da69064-8b89-47e9-a6c4-293bb106af8d`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:41:24,735::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:41:24,736::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`642dcdb2-7208-4ca7-83b2-c28039faddc2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:41:24,736::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:41:24,736::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:41:24,736::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`642dcdb2-7208-4ca7-83b2-c28039faddc2`::Granted request >Thread-34::DEBUG::2014-07-24 11:41:24,737::task::827::TaskManager.Task::(resourceAcquired) Task=`1da69064-8b89-47e9-a6c4-293bb106af8d`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:41:24,737::task::990::TaskManager.Task::(_decref) Task=`1da69064-8b89-47e9-a6c4-293bb106af8d`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:41:24,737::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:41:24,738::task::1185::TaskManager.Task::(prepare) Task=`1da69064-8b89-47e9-a6c4-293bb106af8d`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:41:24,738::task::595::TaskManager.Task::(_updateState) Task=`1da69064-8b89-47e9-a6c4-293bb106af8d`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:41:24,738::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:41:24,738::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:41:24,738::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:41:24,739::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:41:24,739::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:41:24,739::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:41:24,739::task::990::TaskManager.Task::(_decref) Task=`1da69064-8b89-47e9-a6c4-293bb106af8d`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 11:41:25,240::task::595::TaskManager.Task::(_updateState) Task=`7d91890e-e2bf-41a0-80a4-1d6f49abc0b8`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:41:25,240::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:41:25,240::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000999744', 'lastCheck': '5.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:41:25,240::task::1185::TaskManager.Task::(prepare) Task=`7d91890e-e2bf-41a0-80a4-1d6f49abc0b8`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000999744', 'lastCheck': '5.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:41:25,240::task::595::TaskManager.Task::(_updateState) Task=`7d91890e-e2bf-41a0-80a4-1d6f49abc0b8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:41:25,241::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:41:25,241::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:41:25,241::task::990::TaskManager.Task::(_decref) Task=`7d91890e-e2bf-41a0-80a4-1d6f49abc0b8`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:41:25,294::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b2812fcf8> >Thread-27::DEBUG::2014-07-24 11:41:25,294::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-37::INFO::2014-07-24 11:41:25,535::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:41:25,535::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:41:25,536::task::595::TaskManager.Task::(_updateState) Task=`f07330ac-4cae-423d-919f-1dad88f752dc`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:41:25,536::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:41:25,536::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:41:25,536::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:41:25,537::task::1185::TaskManager.Task::(prepare) Task=`f07330ac-4cae-423d-919f-1dad88f752dc`::finished: None >Thread-37::DEBUG::2014-07-24 11:41:25,537::task::595::TaskManager.Task::(_updateState) Task=`f07330ac-4cae-423d-919f-1dad88f752dc`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:41:25,537::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:41:25,537::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:41:25,537::task::990::TaskManager.Task::(_decref) Task=`f07330ac-4cae-423d-919f-1dad88f752dc`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:41:25,546::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.240776 s, 17.0 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:41:25,546::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:41:25,547::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:41:25,562::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00454123 s, 902 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:41:26,303::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:41:26,313::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:41:26,314::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-37::INFO::2014-07-24 11:41:27,541::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:41:27,541::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:41:27,542::task::595::TaskManager.Task::(_updateState) Task=`549d8047-d308-4f13-b782-6e774b34daf0`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:41:27,542::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:41:27,542::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:41:27,542::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:41:27,542::task::1185::TaskManager.Task::(prepare) Task=`549d8047-d308-4f13-b782-6e774b34daf0`::finished: None >Thread-37::DEBUG::2014-07-24 11:41:27,543::task::595::TaskManager.Task::(_updateState) Task=`549d8047-d308-4f13-b782-6e774b34daf0`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:41:27,543::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:41:27,543::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:41:27,543::task::990::TaskManager.Task::(_decref) Task=`549d8047-d308-4f13-b782-6e774b34daf0`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:41:27,564::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b2803f950> >Thread-27::DEBUG::2014-07-24 11:41:27,565::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8ac8318b48> >Thread-27::DEBUG::2014-07-24 11:41:27,565::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:41:27,936::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.359947 s, 11.4 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:41:27,937::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:41:27,937::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:41:27,951::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00439703 s, 932 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:41:28,316::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:41:28,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:41:28,327::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-37::INFO::2014-07-24 11:41:29,547::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:41:29,547::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:41:29,547::task::595::TaskManager.Task::(_updateState) Task=`7e0c01d3-be87-4c57-85e6-1f8c8ba9d496`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:41:29,548::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:41:29,548::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:41:29,548::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:41:29,548::task::1185::TaskManager.Task::(prepare) Task=`7e0c01d3-be87-4c57-85e6-1f8c8ba9d496`::finished: None >Thread-37::DEBUG::2014-07-24 11:41:29,548::task::595::TaskManager.Task::(_updateState) Task=`7e0c01d3-be87-4c57-85e6-1f8c8ba9d496`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:41:29,549::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:41:29,549::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:41:29,549::task::990::TaskManager.Task::(_decref) Task=`7e0c01d3-be87-4c57-85e6-1f8c8ba9d496`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:41:29,954::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b2813ccb0> >Thread-27::DEBUG::2014-07-24 11:41:29,955::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-18::DEBUG::2014-07-24 11:41:30,074::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:41:30,085::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000558363 s, 7.3 MB/s\n'; <rc> = 0 >Thread-27::DEBUG::2014-07-24 11:41:30,125::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.145675 s, 28.1 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:41:30,125::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:41:30,126::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:41:30,140::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00461745 s, 887 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:41:30,330::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:41:30,340::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:41:30,340::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >VM Channels Listener::DEBUG::2014-07-24 11:41:31,084::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-37::INFO::2014-07-24 11:41:31,553::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:41:31,553::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:41:31,554::task::595::TaskManager.Task::(_updateState) Task=`d22aef38-a473-4215-938c-5cf4545ad68e`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:41:31,554::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:41:31,554::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:41:31,554::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:41:31,555::task::1185::TaskManager.Task::(prepare) Task=`d22aef38-a473-4215-938c-5cf4545ad68e`::finished: None >Thread-37::DEBUG::2014-07-24 11:41:31,555::task::595::TaskManager.Task::(_updateState) Task=`d22aef38-a473-4215-938c-5cf4545ad68e`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:41:31,555::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:41:31,555::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:41:31,555::task::990::TaskManager.Task::(_decref) Task=`d22aef38-a473-4215-938c-5cf4545ad68e`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:41:32,143::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b28056b90> >Thread-27::DEBUG::2014-07-24 11:41:32,144::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:41:32,343::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:41:32,353::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:41:32,353::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:41:32,515::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.360148 s, 11.4 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:41:32,516::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:41:32,516::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:41:32,531::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00443101 s, 924 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:41:33,559::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:41:33,559::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:41:33,560::task::595::TaskManager.Task::(_updateState) Task=`158e2f5e-b76f-48f9-a8de-21a522f4964b`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:41:33,560::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:41:33,560::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:41:33,560::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:41:33,560::task::1185::TaskManager.Task::(prepare) Task=`158e2f5e-b76f-48f9-a8de-21a522f4964b`::finished: None >Thread-37::DEBUG::2014-07-24 11:41:33,560::task::595::TaskManager.Task::(_updateState) Task=`158e2f5e-b76f-48f9-a8de-21a522f4964b`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:41:33,561::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:41:33,561::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:41:33,561::task::990::TaskManager.Task::(_decref) Task=`158e2f5e-b76f-48f9-a8de-21a522f4964b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:41:34,356::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:41:34,366::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:41:34,366::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:41:34,534::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8ac8043ab8> >Thread-27::DEBUG::2014-07-24 11:41:34,534::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-14::DEBUG::2014-07-24 11:41:34,793::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:41:34,794::task::595::TaskManager.Task::(_updateState) Task=`b637e4b5-13d4-42fb-896b-18b093609871`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:41:34,794::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:41:34,794::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:41:34,794::task::1185::TaskManager.Task::(prepare) Task=`b637e4b5-13d4-42fb-896b-18b093609871`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:41:34,794::task::595::TaskManager.Task::(_updateState) Task=`b637e4b5-13d4-42fb-896b-18b093609871`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:41:34,795::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:41:34,795::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:41:34,795::task::990::TaskManager.Task::(_decref) Task=`b637e4b5-13d4-42fb-896b-18b093609871`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:41:34,826::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:41:34,826::task::595::TaskManager.Task::(_updateState) Task=`11b19490-858a-4e32-b8a6-c08507d74909`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:41:34,826::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:41:34,826::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ed4fb2b3-2332-470c-b7ab-a5c249557f44`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:41:34,827::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:41:34,827::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:41:34,827::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ed4fb2b3-2332-470c-b7ab-a5c249557f44`::Granted request >Thread-34::DEBUG::2014-07-24 11:41:34,827::task::827::TaskManager.Task::(resourceAcquired) Task=`11b19490-858a-4e32-b8a6-c08507d74909`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:41:34,828::task::990::TaskManager.Task::(_decref) Task=`11b19490-858a-4e32-b8a6-c08507d74909`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:41:34,828::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:41:34,828::task::1185::TaskManager.Task::(prepare) Task=`11b19490-858a-4e32-b8a6-c08507d74909`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:41:34,829::task::595::TaskManager.Task::(_updateState) Task=`11b19490-858a-4e32-b8a6-c08507d74909`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:41:34,829::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:41:34,829::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:41:34,829::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:41:34,829::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:41:34,830::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:41:34,830::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:41:34,830::task::990::TaskManager.Task::(_decref) Task=`11b19490-858a-4e32-b8a6-c08507d74909`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:41:34,906::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.360027 s, 11.4 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:41:34,906::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:41:34,907::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:41:34,922::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00455732 s, 899 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:41:35,565::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:41:35,565::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:41:35,565::task::595::TaskManager.Task::(_updateState) Task=`ea819fbf-e403-4571-bd31-0984c5935986`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:41:35,565::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:41:35,566::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:41:35,566::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:41:35,566::task::1185::TaskManager.Task::(prepare) Task=`ea819fbf-e403-4571-bd31-0984c5935986`::finished: None >Thread-37::DEBUG::2014-07-24 11:41:35,566::task::595::TaskManager.Task::(_updateState) Task=`ea819fbf-e403-4571-bd31-0984c5935986`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:41:35,566::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:41:35,566::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:41:35,567::task::990::TaskManager.Task::(_decref) Task=`ea819fbf-e403-4571-bd31-0984c5935986`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:41:36,369::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:41:36,379::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:41:36,380::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:41:36,925::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b2812fbd8> >Thread-27::DEBUG::2014-07-24 11:41:36,925::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:41:37,297::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.359998 s, 11.4 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:41:37,297::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:41:37,298::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:41:37,313::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00445568 s, 919 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:41:37,570::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:41:37,570::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:41:37,571::task::595::TaskManager.Task::(_updateState) Task=`64088f40-1ef6-4b0d-9e20-3f2941fede8c`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:41:37,571::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:41:37,571::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:41:37,572::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:41:37,572::task::1185::TaskManager.Task::(prepare) Task=`64088f40-1ef6-4b0d-9e20-3f2941fede8c`::finished: None >Thread-37::DEBUG::2014-07-24 11:41:37,572::task::595::TaskManager.Task::(_updateState) Task=`64088f40-1ef6-4b0d-9e20-3f2941fede8c`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:41:37,572::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:41:37,572::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:41:37,572::task::990::TaskManager.Task::(_decref) Task=`64088f40-1ef6-4b0d-9e20-3f2941fede8c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:41:38,382::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:41:38,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:41:38,392::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:41:39,316::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8ac8047290> >Thread-27::DEBUG::2014-07-24 11:41:39,316::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-37::INFO::2014-07-24 11:41:39,580::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:41:39,581::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:41:39,581::task::595::TaskManager.Task::(_updateState) Task=`d9c9a17b-b9c9-41b5-88a4-175394b8267d`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:41:39,581::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:41:39,582::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:41:39,582::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:41:39,582::task::1185::TaskManager.Task::(prepare) Task=`d9c9a17b-b9c9-41b5-88a4-175394b8267d`::finished: None >Thread-37::DEBUG::2014-07-24 11:41:39,582::task::595::TaskManager.Task::(_updateState) Task=`d9c9a17b-b9c9-41b5-88a4-175394b8267d`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:41:39,582::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:41:39,582::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:41:39,583::task::990::TaskManager.Task::(_decref) Task=`d9c9a17b-b9c9-41b5-88a4-175394b8267d`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:41:39,688::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.360039 s, 11.4 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:41:39,688::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:41:39,689::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:41:39,703::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00451104 s, 908 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:41:40,091::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:41:40,102::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000633936 s, 6.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:41:40,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:41:40,405::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:41:40,405::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-14::DEBUG::2014-07-24 11:41:40,653::task::595::TaskManager.Task::(_updateState) Task=`2a8ab536-2e89-43fc-a9b6-64c4b0f198dd`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:41:40,654::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:41:40,654::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000633936', 'lastCheck': '0.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:41:40,654::task::1185::TaskManager.Task::(prepare) Task=`2a8ab536-2e89-43fc-a9b6-64c4b0f198dd`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000633936', 'lastCheck': '0.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:41:40,654::task::595::TaskManager.Task::(_updateState) Task=`2a8ab536-2e89-43fc-a9b6-64c4b0f198dd`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:41:40,654::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:41:40,655::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:41:40,655::task::990::TaskManager.Task::(_decref) Task=`2a8ab536-2e89-43fc-a9b6-64c4b0f198dd`::ref 0 aborting False >Thread-37::INFO::2014-07-24 11:41:41,586::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:41:41,587::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:41:41,587::task::595::TaskManager.Task::(_updateState) Task=`8c5a8b6a-88b8-4561-8827-ce04730aefb5`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:41:41,587::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:41:41,587::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:41:41,588::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:41:41,588::task::1185::TaskManager.Task::(prepare) Task=`8c5a8b6a-88b8-4561-8827-ce04730aefb5`::finished: None >Thread-37::DEBUG::2014-07-24 11:41:41,588::task::595::TaskManager.Task::(_updateState) Task=`8c5a8b6a-88b8-4561-8827-ce04730aefb5`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:41:41,588::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:41:41,588::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:41:41,588::task::990::TaskManager.Task::(_decref) Task=`8c5a8b6a-88b8-4561-8827-ce04730aefb5`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:41:41,706::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b2803fc20> >Thread-27::DEBUG::2014-07-24 11:41:41,706::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b281446c8> >Thread-27::DEBUG::2014-07-24 11:41:41,707::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:41:42,088::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.360772 s, 11.4 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:41:42,090::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:41:42,093::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:41:42,408::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:41:42,418::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:41:42,418::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:41:43,108::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00346 s, 4.1 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:41:43,592::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:41:43,592::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:41:43,592::task::595::TaskManager.Task::(_updateState) Task=`4e5504bd-6eb1-407f-bd33-a0cc63ebb568`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:41:43,593::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:41:43,593::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:41:43,593::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:41:43,593::task::1185::TaskManager.Task::(prepare) Task=`4e5504bd-6eb1-407f-bd33-a0cc63ebb568`::finished: None >Thread-37::DEBUG::2014-07-24 11:41:43,593::task::595::TaskManager.Task::(_updateState) Task=`4e5504bd-6eb1-407f-bd33-a0cc63ebb568`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:41:43,594::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:41:43,594::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:41:43,594::task::990::TaskManager.Task::(_decref) Task=`4e5504bd-6eb1-407f-bd33-a0cc63ebb568`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:41:44,421::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:41:44,431::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:41:44,431::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-14::DEBUG::2014-07-24 11:41:44,885::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:41:44,885::task::595::TaskManager.Task::(_updateState) Task=`836c5cca-8607-4223-942a-028d8fa04bbd`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:41:44,885::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:41:44,886::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:41:44,886::task::1185::TaskManager.Task::(prepare) Task=`836c5cca-8607-4223-942a-028d8fa04bbd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:41:44,886::task::595::TaskManager.Task::(_updateState) Task=`836c5cca-8607-4223-942a-028d8fa04bbd`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:41:44,886::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:41:44,886::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:41:44,887::task::990::TaskManager.Task::(_decref) Task=`836c5cca-8607-4223-942a-028d8fa04bbd`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:41:44,925::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:41:44,925::task::595::TaskManager.Task::(_updateState) Task=`9078716d-b354-47c8-9499-ec4567e7d3bc`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:41:44,925::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:41:44,926::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`477f2810-f759-4a6a-9fb9-2b55b699fbfe`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:41:44,926::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:41:44,926::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:41:44,927::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`477f2810-f759-4a6a-9fb9-2b55b699fbfe`::Granted request >Thread-34::DEBUG::2014-07-24 11:41:44,927::task::827::TaskManager.Task::(resourceAcquired) Task=`9078716d-b354-47c8-9499-ec4567e7d3bc`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:41:44,927::task::990::TaskManager.Task::(_decref) Task=`9078716d-b354-47c8-9499-ec4567e7d3bc`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:41:44,928::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:41:44,928::task::1185::TaskManager.Task::(prepare) Task=`9078716d-b354-47c8-9499-ec4567e7d3bc`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:41:44,928::task::595::TaskManager.Task::(_updateState) Task=`9078716d-b354-47c8-9499-ec4567e7d3bc`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:41:44,928::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:41:44,928::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:41:44,929::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:41:44,929::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:41:44,929::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:41:44,929::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:41:44,929::task::990::TaskManager.Task::(_decref) Task=`9078716d-b354-47c8-9499-ec4567e7d3bc`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:41:45,111::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b2813cb90> >Thread-27::DEBUG::2014-07-24 11:41:45,111::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:41:45,449::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.327341 s, 12.5 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:41:45,450::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:41:45,450::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:41:45,465::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00471594 s, 869 kB/s\n'; <rc> = 0 >Thread-37::INFO::2014-07-24 11:41:45,597::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:41:45,598::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:41:45,598::task::595::TaskManager.Task::(_updateState) Task=`aaa2cb45-a610-46d8-a749-14c181ebea82`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:41:45,598::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:41:45,599::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:41:45,599::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:41:45,599::task::1185::TaskManager.Task::(prepare) Task=`aaa2cb45-a610-46d8-a749-14c181ebea82`::finished: None >Thread-37::DEBUG::2014-07-24 11:41:45,599::task::595::TaskManager.Task::(_updateState) Task=`aaa2cb45-a610-46d8-a749-14c181ebea82`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:41:45,599::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:41:45,599::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:41:45,600::task::990::TaskManager.Task::(_decref) Task=`aaa2cb45-a610-46d8-a749-14c181ebea82`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:41:46,434::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:41:46,444::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:41:46,444::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-27::DEBUG::2014-07-24 11:41:47,468::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8ac8043a70> >Thread-27::DEBUG::2014-07-24 11:41:47,468::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-37::INFO::2014-07-24 11:41:47,603::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:41:47,603::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:41:47,604::task::595::TaskManager.Task::(_updateState) Task=`d97612ae-8cd7-4fb7-8253-9e2c239bb666`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:41:47,604::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:41:47,604::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:41:47,605::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:41:47,605::task::1185::TaskManager.Task::(prepare) Task=`d97612ae-8cd7-4fb7-8253-9e2c239bb666`::finished: None >Thread-37::DEBUG::2014-07-24 11:41:47,605::task::595::TaskManager.Task::(_updateState) Task=`d97612ae-8cd7-4fb7-8253-9e2c239bb666`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:41:47,605::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:41:47,605::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:41:47,605::task::990::TaskManager.Task::(_decref) Task=`d97612ae-8cd7-4fb7-8253-9e2c239bb666`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:41:47,840::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.360633 s, 11.4 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:41:47,840::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:41:47,841::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:41:47,856::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00442405 s, 926 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:41:48,447::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:41:48,457::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) FAILED: <err> = ''; <rc> = 1 >Dummy-33::ERROR::2014-07-24 11:41:48,457::storage_mailbox::787::Storage.MailBox.SpmMailMonitor::(run) Error checking for mail >Traceback (most recent call last): > File "/usr/share/vdsm/storage/storage_mailbox.py", line 785, in run > self._checkForMail() > File "/usr/share/vdsm/storage/storage_mailbox.py", line 734, in _checkForMail > "Could not read mailbox: %s" % self._inbox) >IOError: [Errno 5] _handleRequests._checkForMail - Could not read mailbox: /rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox >Thread-37::INFO::2014-07-24 11:41:49,609::vm::2511::vm.Vm::(extendDrivesIfNeeded) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 on domain 23aa0606-edc3-4882-a4aa-18aa1983458f (apparent: 5368709120, capacity: 10737418240, allocated: 5049613824, physical: 5368709120) >Thread-37::DEBUG::2014-07-24 11:41:49,609::vm::2584::vm.Vm::(__extendDriveVolume) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Requesting an extension for the volume: {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'} >Thread-37::DEBUG::2014-07-24 11:41:49,610::task::595::TaskManager.Task::(_updateState) Task=`6f2f8d93-ffc6-4bc1-a5c0-739b892be93c`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:41:49,610::logUtils::44::dispatcher::(wrapper) Run and protect: sendExtendMsg(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', volDict={'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}, newSize=6442450944, callbackFunc=<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>) >Thread-37::DEBUG::2014-07-24 11:41:49,610::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >Thread-37::INFO::2014-07-24 11:41:49,610::logUtils::47::dispatcher::(wrapper) Run and protect: sendExtendMsg, Return response: None >Thread-37::DEBUG::2014-07-24 11:41:49,610::task::1185::TaskManager.Task::(prepare) Task=`6f2f8d93-ffc6-4bc1-a5c0-739b892be93c`::finished: None >Thread-37::DEBUG::2014-07-24 11:41:49,611::task::595::TaskManager.Task::(_updateState) Task=`6f2f8d93-ffc6-4bc1-a5c0-739b892be93c`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:41:49,611::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:41:49,611::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:41:49,611::task::990::TaskManager.Task::(_decref) Task=`6f2f8d93-ffc6-4bc1-a5c0-739b892be93c`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:41:49,858::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8b28056518> >Thread-27::DEBUG::2014-07-24 11:41:49,858::storage_mailbox::409::Storage.MailBox.HsmMailMonitor::(_handleMessage) HSM_MailMonitor - ignoring duplicate message <storage.storage_mailbox.SPM_Extend_Message instance at 0x7f8ac8047b48> >Thread-27::DEBUG::2014-07-24 11:41:49,859::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:41:50,082::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.212367 s, 19.3 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:41:50,083::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:41:50,083::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:41:50,098::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00501389 s, 817 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:41:50,106::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:41:50,117::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000502292 s, 8.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:41:50,460::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:41:50,544::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0421246 s, 24.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:41:50,545::storage_mailbox::658::Storage.MailBox.SpmMailMonitor::(_handleRequests) SPM_MailMonitor: Mailbox 1 validated, checking mail >Dummy-33::DEBUG::2014-07-24 11:41:50,545::storage_mailbox::698::Storage.MailBox.SpmMailMonitor::(_handleRequests) SPM_MailMonitor: processing request: '1xtnd\x8fE\x83\x19\xaa\x18\xaa\xa4\x82H\xc3\xed\x06\x06\xaa#\xe2\x9b\xed\xae\xc5bR\xb3\x85K\x9f\xe2\xee\xa0\x8c\xe1000000000000180000000000000' >Thread-31::DEBUG::2014-07-24 11:41:50,545::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >064cb745-f55d-4474-98cf-e9cd9c43f1d1::DEBUG::2014-07-24 11:41:50,546::threadPool::200::Misc.ThreadPool.WorkerThread::(_processNextTask) Task: 064cb745-f55d-4474-98cf-e9cd9c43f1d1 running: <function runTask at 0x149a500> with: (<functools.partial object at 0x15de890>, 65, '1xtnd\x8fE\x83\x19\xaa\x18\xaa\xa4\x82H\xc3\xed\x06\x06\xaa#\xe2\x9b\xed\xae\xc5bR\xb3\x85K\x9f\xe2\xee\xa0\x8c\xe1000000000000180000000000000') >064cb745-f55d-4474-98cf-e9cd9c43f1d1::DEBUG::2014-07-24 11:41:50,548::task::595::TaskManager.Task::(_updateState) Task=`3343694b-62e8-4059-87a1-381292cdf5b3`::moving from state init -> state preparing >064cb745-f55d-4474-98cf-e9cd9c43f1d1::DEBUG::2014-07-24 11:41:50,548::storage_mailbox::146::Storage.SPM.Messages.Extend::(processRequest) processRequest, payload:'1xtnd\x8fE\x83\x19\xaa\x18\xaa\xa4\x82H\xc3\xed\x06\x06\xaa#\xe2\x9b\xed\xae\xc5bR\xb3\x85K\x9f\xe2\xee\xa0\x8c\xe1000000000000180000000000000' >064cb745-f55d-4474-98cf-e9cd9c43f1d1::INFO::2014-07-24 11:41:50,549::storage_mailbox::161::Storage.SPM.Messages.Extend::(processRequest) processRequest: extending volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2 in domain 23aa0606-edc3-4882-a4aa-18aa1983458f (pool 637ea13c-81a8-4b44-8cab-961458b01883) to size 6144 >064cb745-f55d-4474-98cf-e9cd9c43f1d1::DEBUG::2014-07-24 11:41:50,554::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvextend --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --autobackup n --size 6144m 23aa0606-edc3-4882-a4aa-18aa1983458f/e18ca0ee-e29f-4b85-b352-62c5aeed9be2' (cwd None) >064cb745-f55d-4474-98cf-e9cd9c43f1d1::DEBUG::2014-07-24 11:41:50,838::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' WARNING: This metadata update is NOT backed up\n'; <rc> = 0 >064cb745-f55d-4474-98cf-e9cd9c43f1d1::DEBUG::2014-07-24 11:41:50,839::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >064cb745-f55d-4474-98cf-e9cd9c43f1d1::DEBUG::2014-07-24 11:41:50,839::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >064cb745-f55d-4474-98cf-e9cd9c43f1d1::DEBUG::2014-07-24 11:41:50,839::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >064cb745-f55d-4474-98cf-e9cd9c43f1d1::DEBUG::2014-07-24 11:41:50,839::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >064cb745-f55d-4474-98cf-e9cd9c43f1d1::DEBUG::2014-07-24 11:41:50,840::storage_mailbox::123::Storage.SPM.Messages.Extend::(__init__) new extend msg created: domain: 23aa0606-edc3-4882-a4aa-18aa1983458f, volume: e18ca0ee-e29f-4b85-b352-62c5aeed9be2 >064cb745-f55d-4474-98cf-e9cd9c43f1d1::DEBUG::2014-07-24 11:41:50,841::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) 'dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox oflag=direct iflag=fullblock conv=notrunc count=1 bs=4096 seek=1' (cwd None) >064cb745-f55d-4474-98cf-e9cd9c43f1d1::DEBUG::2014-07-24 11:41:50,854::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000996674 s, 4.1 MB/s\n'; <rc> = 0 >064cb745-f55d-4474-98cf-e9cd9c43f1d1::DEBUG::2014-07-24 11:41:50,855::task::1185::TaskManager.Task::(prepare) Task=`3343694b-62e8-4059-87a1-381292cdf5b3`::finished: {'status': {'message': 'Done', 'code': 0}} >064cb745-f55d-4474-98cf-e9cd9c43f1d1::DEBUG::2014-07-24 11:41:50,855::task::595::TaskManager.Task::(_updateState) Task=`3343694b-62e8-4059-87a1-381292cdf5b3`::moving from state preparing -> state finished >064cb745-f55d-4474-98cf-e9cd9c43f1d1::DEBUG::2014-07-24 11:41:50,855::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >064cb745-f55d-4474-98cf-e9cd9c43f1d1::DEBUG::2014-07-24 11:41:50,855::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >064cb745-f55d-4474-98cf-e9cd9c43f1d1::DEBUG::2014-07-24 11:41:50,856::task::990::TaskManager.Task::(_decref) Task=`3343694b-62e8-4059-87a1-381292cdf5b3`::ref 0 aborting False >064cb745-f55d-4474-98cf-e9cd9c43f1d1::DEBUG::2014-07-24 11:41:50,856::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-27::DEBUG::2014-07-24 11:41:52,101::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Thread-27::DEBUG::2014-07-24 11:41:52,473::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.360103 s, 11.4 kB/s\n'; <rc> = 0 >Thread-27::DEBUG::2014-07-24 11:41:52,473::storage_mailbox::342::Storage.MailBox.HsmMailMonitor::(_handleResponses) HSM_MailboxMonitor(1/63) - Checking reply: '1xtnd\x8fE\x83\x19\xaa\x18\xaa\xa4\x82H\xc3\xed\x06\x06\xaa#\xe2\x9b\xed\xae\xc5bR\xb3\x85K\x9f\xe2\xee\xa0\x8c\xe1000000000000180000000000000' >Thread-27::INFO::2014-07-24 11:41:52,474::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >09e29166-990d-4b74-bc6d-c580afb066e8::DEBUG::2014-07-24 11:41:52,474::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-27::DEBUG::2014-07-24 11:41:52,475::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >eaf40cc6-6d7a-4249-89ab-b6cb0cbb3a01::DEBUG::2014-07-24 11:41:52,476::threadPool::200::Misc.ThreadPool.WorkerThread::(_processNextTask) Task: eaf40cc6-6d7a-4249-89ab-b6cb0cbb3a01 running: <function runTask at 0x149a500> with: (<bound method Vm.__afterVolumeExtension of <vm.Vm object at 0x7f8b141a7d90>>, {'newSize': 6144, 'domainID': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'name': u'sda', 'volumeID': 'e18ca0ee-e29f-4b85-b352-62c5aeed9be2', 'imageID': '7afbd34c-3fd8-438a-964b-ff0a25fc709c', 'poolID': '637ea13c-81a8-4b44-8cab-961458b01883'}) >eaf40cc6-6d7a-4249-89ab-b6cb0cbb3a01::DEBUG::2014-07-24 11:41:52,487::task::595::TaskManager.Task::(_updateState) Task=`0d3292c8-d953-40db-b965-c13141b36ae9`::moving from state init -> state preparing >eaf40cc6-6d7a-4249-89ab-b6cb0cbb3a01::DEBUG::2014-07-24 11:41:52,488::vm::2543::vm.Vm::(__verifyVolumeExtension) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Refreshing drive volume for sda (domainID: 23aa0606-edc3-4882-a4aa-18aa1983458f, volumeID: e18ca0ee-e29f-4b85-b352-62c5aeed9be2) >eaf40cc6-6d7a-4249-89ab-b6cb0cbb3a01::DEBUG::2014-07-24 11:41:52,488::task::595::TaskManager.Task::(_updateState) Task=`3fc1309b-9e14-4d1b-880c-c1d94650df46`::moving from state init -> state preparing >eaf40cc6-6d7a-4249-89ab-b6cb0cbb3a01::INFO::2014-07-24 11:41:52,488::logUtils::44::dispatcher::(wrapper) Run and protect: refreshVolume(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2') >eaf40cc6-6d7a-4249-89ab-b6cb0cbb3a01::DEBUG::2014-07-24 11:41:52,489::lvm::427::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' got the operation mutex >eaf40cc6-6d7a-4249-89ab-b6cb0cbb3a01::DEBUG::2014-07-24 11:41:52,489::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-27::DEBUG::2014-07-24 11:41:52,498::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.00441691 s, 927 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:41:52,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:41:52,661::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0412735 s, 24.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:41:52,661::storage_mailbox::658::Storage.MailBox.SpmMailMonitor::(_handleRequests) SPM_MailMonitor: Mailbox 1 validated, checking mail >eaf40cc6-6d7a-4249-89ab-b6cb0cbb3a01::DEBUG::2014-07-24 11:41:52,677::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >eaf40cc6-6d7a-4249-89ab-b6cb0cbb3a01::DEBUG::2014-07-24 11:41:52,691::lvm::462::Storage.LVM::(_reloadlvs) lvs reloaded >eaf40cc6-6d7a-4249-89ab-b6cb0cbb3a01::DEBUG::2014-07-24 11:41:52,693::lvm::462::OperationMutex::(_reloadlvs) Operation 'lvm reload operation' released the operation mutex >Dummy-33::DEBUG::2014-07-24 11:41:52,699::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) 'dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox oflag=direct iflag=fullblock conv=notrunc count=1 bs=1024000' (cwd None) >eaf40cc6-6d7a-4249-89ab-b6cb0cbb3a01::DEBUG::2014-07-24 11:41:52,699::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm lvchange --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --refresh 23aa0606-edc3-4882-a4aa-18aa1983458f/e18ca0ee-e29f-4b85-b352-62c5aeed9be2' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:41:52,757::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0448145 s, 22.8 MB/s\n'; <rc> = 0 >eaf40cc6-6d7a-4249-89ab-b6cb0cbb3a01::DEBUG::2014-07-24 11:41:52,908::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >eaf40cc6-6d7a-4249-89ab-b6cb0cbb3a01::DEBUG::2014-07-24 11:41:52,909::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >eaf40cc6-6d7a-4249-89ab-b6cb0cbb3a01::DEBUG::2014-07-24 11:41:52,909::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >eaf40cc6-6d7a-4249-89ab-b6cb0cbb3a01::INFO::2014-07-24 11:41:52,909::logUtils::47::dispatcher::(wrapper) Run and protect: refreshVolume, Return response: None >eaf40cc6-6d7a-4249-89ab-b6cb0cbb3a01::DEBUG::2014-07-24 11:41:52,910::task::1185::TaskManager.Task::(prepare) Task=`3fc1309b-9e14-4d1b-880c-c1d94650df46`::finished: None >eaf40cc6-6d7a-4249-89ab-b6cb0cbb3a01::DEBUG::2014-07-24 11:41:52,910::task::595::TaskManager.Task::(_updateState) Task=`3fc1309b-9e14-4d1b-880c-c1d94650df46`::moving from state preparing -> state finished >eaf40cc6-6d7a-4249-89ab-b6cb0cbb3a01::DEBUG::2014-07-24 11:41:52,910::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >eaf40cc6-6d7a-4249-89ab-b6cb0cbb3a01::DEBUG::2014-07-24 11:41:52,910::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >eaf40cc6-6d7a-4249-89ab-b6cb0cbb3a01::DEBUG::2014-07-24 11:41:52,910::task::990::TaskManager.Task::(_decref) Task=`3fc1309b-9e14-4d1b-880c-c1d94650df46`::ref 0 aborting False >eaf40cc6-6d7a-4249-89ab-b6cb0cbb3a01::DEBUG::2014-07-24 11:41:52,911::task::595::TaskManager.Task::(_updateState) Task=`d7c469a8-1d54-49cc-a32a-918507943549`::moving from state init -> state preparing >eaf40cc6-6d7a-4249-89ab-b6cb0cbb3a01::INFO::2014-07-24 11:41:52,911::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >eaf40cc6-6d7a-4249-89ab-b6cb0cbb3a01::INFO::2014-07-24 11:41:52,911::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >eaf40cc6-6d7a-4249-89ab-b6cb0cbb3a01::DEBUG::2014-07-24 11:41:52,911::task::1185::TaskManager.Task::(prepare) Task=`d7c469a8-1d54-49cc-a32a-918507943549`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >eaf40cc6-6d7a-4249-89ab-b6cb0cbb3a01::DEBUG::2014-07-24 11:41:52,912::task::595::TaskManager.Task::(_updateState) Task=`d7c469a8-1d54-49cc-a32a-918507943549`::moving from state preparing -> state finished >eaf40cc6-6d7a-4249-89ab-b6cb0cbb3a01::DEBUG::2014-07-24 11:41:52,912::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >eaf40cc6-6d7a-4249-89ab-b6cb0cbb3a01::DEBUG::2014-07-24 11:41:52,912::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >eaf40cc6-6d7a-4249-89ab-b6cb0cbb3a01::DEBUG::2014-07-24 11:41:52,912::task::990::TaskManager.Task::(_decref) Task=`d7c469a8-1d54-49cc-a32a-918507943549`::ref 0 aborting False >eaf40cc6-6d7a-4249-89ab-b6cb0cbb3a01::DEBUG::2014-07-24 11:41:52,912::vm::2563::vm.Vm::(__verifyVolumeExtension) vmId=`6fca7e11-8f3f-4784-bdab-7e7f9503cd5b`::Verifying extension for volume e18ca0ee-e29f-4b85-b352-62c5aeed9be2, requested size 6442450944, current size 6442450944 >eaf40cc6-6d7a-4249-89ab-b6cb0cbb3a01::DEBUG::2014-07-24 11:41:52,939::task::1185::TaskManager.Task::(prepare) Task=`0d3292c8-d953-40db-b965-c13141b36ae9`::finished: None >eaf40cc6-6d7a-4249-89ab-b6cb0cbb3a01::DEBUG::2014-07-24 11:41:52,939::task::595::TaskManager.Task::(_updateState) Task=`0d3292c8-d953-40db-b965-c13141b36ae9`::moving from state preparing -> state finished >eaf40cc6-6d7a-4249-89ab-b6cb0cbb3a01::DEBUG::2014-07-24 11:41:52,940::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >eaf40cc6-6d7a-4249-89ab-b6cb0cbb3a01::DEBUG::2014-07-24 11:41:52,940::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >eaf40cc6-6d7a-4249-89ab-b6cb0cbb3a01::DEBUG::2014-07-24 11:41:52,940::task::990::TaskManager.Task::(_decref) Task=`0d3292c8-d953-40db-b965-c13141b36ae9`::ref 0 aborting False >eaf40cc6-6d7a-4249-89ab-b6cb0cbb3a01::DEBUG::2014-07-24 11:41:52,940::threadPool::57::Misc.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-27::DEBUG::2014-07-24 11:41:54,501::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) '/bin/dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=8' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:41:54,760::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-27::DEBUG::2014-07-24 11:41:54,788::storage_mailbox::373::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.261648 s, 15.7 kB/s\n'; <rc> = 0 >Thread-27::INFO::2014-07-24 11:41:54,790::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] >Thread-27::DEBUG::2014-07-24 11:41:54,793::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) '/bin/dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=8' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:41:54,860::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0582729 s, 17.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:41:54,861::storage_mailbox::658::Storage.MailBox.SpmMailMonitor::(_handleRequests) SPM_MailMonitor: Mailbox 1 validated, checking mail >Dummy-33::DEBUG::2014-07-24 11:41:54,871::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) 'dd of=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/outbox oflag=direct iflag=fullblock conv=notrunc count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:41:54,914::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0321665 s, 31.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:41:54,998::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:41:54,998::task::595::TaskManager.Task::(_updateState) Task=`b52ddc8b-9c6a-4ae1-8332-1af52203edec`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:41:54,999::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:41:54,999::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:41:54,999::task::1185::TaskManager.Task::(prepare) Task=`b52ddc8b-9c6a-4ae1-8332-1af52203edec`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:41:54,999::task::595::TaskManager.Task::(_updateState) Task=`b52ddc8b-9c6a-4ae1-8332-1af52203edec`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:41:55,000::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:41:55,000::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:41:55,000::task::990::TaskManager.Task::(_decref) Task=`b52ddc8b-9c6a-4ae1-8332-1af52203edec`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:41:55,033::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:41:55,033::task::595::TaskManager.Task::(_updateState) Task=`38deef5a-1a40-487c-afe3-33e67f25b5a0`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:41:55,033::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:41:55,034::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`fdeee4d7-85a3-4f13-b317-04befe1811b6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:41:55,034::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:41:55,034::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:41:55,034::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`fdeee4d7-85a3-4f13-b317-04befe1811b6`::Granted request >Thread-34::DEBUG::2014-07-24 11:41:55,035::task::827::TaskManager.Task::(resourceAcquired) Task=`38deef5a-1a40-487c-afe3-33e67f25b5a0`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:41:55,035::task::990::TaskManager.Task::(_decref) Task=`38deef5a-1a40-487c-afe3-33e67f25b5a0`::ref 1 aborting False >Thread-34::DEBUG::2014-07-24 11:41:55,035::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-34::DEBUG::2014-07-24 11:41:55,036::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-34::DEBUG::2014-07-24 11:41:55,208::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-34::DEBUG::2014-07-24 11:41:55,209::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-34::INFO::2014-07-24 11:41:55,210::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:41:55,210::task::1185::TaskManager.Task::(prepare) Task=`38deef5a-1a40-487c-afe3-33e67f25b5a0`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '33017561088', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:41:55,211::task::595::TaskManager.Task::(_updateState) Task=`38deef5a-1a40-487c-afe3-33e67f25b5a0`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:41:55,211::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:41:55,211::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:41:55,211::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:41:55,211::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:41:55,212::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:41:55,212::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:41:55,212::task::990::TaskManager.Task::(_decref) Task=`38deef5a-1a40-487c-afe3-33e67f25b5a0`::ref 0 aborting False >Thread-27::DEBUG::2014-07-24 11:41:55,808::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 1.00267 s, 4.1 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:41:56,056::task::595::TaskManager.Task::(_updateState) Task=`b2959bc1-b547-48d2-b1d9-f3c08bb735cf`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:41:56,056::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:41:56,056::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502292', 'lastCheck': '5.9', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:41:56,056::task::1185::TaskManager.Task::(prepare) Task=`b2959bc1-b547-48d2-b1d9-f3c08bb735cf`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000502292', 'lastCheck': '5.9', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:41:56,056::task::595::TaskManager.Task::(_updateState) Task=`b2959bc1-b547-48d2-b1d9-f3c08bb735cf`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:41:56,056::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:41:56,057::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:41:56,057::task::990::TaskManager.Task::(_decref) Task=`b2959bc1-b547-48d2-b1d9-f3c08bb735cf`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:41:56,917::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:41:56,992::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334173 s, 30.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:41:59,004::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:41:59,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036952 s, 27.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:42:00,121::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:42:00,133::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000704263 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:42:01,096::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >VM Channels Listener::DEBUG::2014-07-24 11:42:01,132::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:42:01,175::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372654 s, 27.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:42:03,187::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:42:03,265::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354808 s, 28.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:42:05,268::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:42:05,268::task::595::TaskManager.Task::(_updateState) Task=`4162e887-ea9a-448d-80e1-438f9a881ea8`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:42:05,269::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:42:05,269::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:42:05,269::task::1185::TaskManager.Task::(prepare) Task=`4162e887-ea9a-448d-80e1-438f9a881ea8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:42:05,269::task::595::TaskManager.Task::(_updateState) Task=`4162e887-ea9a-448d-80e1-438f9a881ea8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:42:05,269::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:42:05,270::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:42:05,270::task::990::TaskManager.Task::(_decref) Task=`4162e887-ea9a-448d-80e1-438f9a881ea8`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:42:05,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-34::DEBUG::2014-07-24 11:42:05,302::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:42:05,304::task::595::TaskManager.Task::(_updateState) Task=`cf49da72-e2d7-4947-8598-82d4aaaa7dd6`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:42:05,305::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:42:05,306::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`79a00c59-3a27-48f0-852c-9c09afc74202`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:42:05,307::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:42:05,308::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:42:05,309::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`79a00c59-3a27-48f0-852c-9c09afc74202`::Granted request >Thread-34::DEBUG::2014-07-24 11:42:05,311::task::827::TaskManager.Task::(resourceAcquired) Task=`cf49da72-e2d7-4947-8598-82d4aaaa7dd6`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:42:05,312::task::990::TaskManager.Task::(_decref) Task=`cf49da72-e2d7-4947-8598-82d4aaaa7dd6`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:42:05,315::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:42:05,316::task::1185::TaskManager.Task::(prepare) Task=`cf49da72-e2d7-4947-8598-82d4aaaa7dd6`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:42:05,317::task::595::TaskManager.Task::(_updateState) Task=`cf49da72-e2d7-4947-8598-82d4aaaa7dd6`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:42:05,318::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:42:05,318::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:42:05,320::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:42:05,321::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:42:05,321::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:42:05,322::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:42:05,323::task::990::TaskManager.Task::(_decref) Task=`cf49da72-e2d7-4947-8598-82d4aaaa7dd6`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:42:05,384::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0594283 s, 17.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:42:07,396::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:42:07,472::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332946 s, 30.8 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:42:07,650::task::595::TaskManager.Task::(_updateState) Task=`e00b2d07-f138-4e3a-8260-4554a0b3c799`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:42:07,650::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:42:07,651::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-37::DEBUG::2014-07-24 11:42:07,652::task::1185::TaskManager.Task::(prepare) Task=`e00b2d07-f138-4e3a-8260-4554a0b3c799`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-37::DEBUG::2014-07-24 11:42:07,652::task::595::TaskManager.Task::(_updateState) Task=`e00b2d07-f138-4e3a-8260-4554a0b3c799`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:42:07,652::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:42:07,652::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:42:07,652::task::990::TaskManager.Task::(_decref) Task=`e00b2d07-f138-4e3a-8260-4554a0b3c799`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:42:09,484::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:42:09,563::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362999 s, 28.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:42:10,138::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:42:10,156::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00666985 s, 614 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:42:11,443::task::595::TaskManager.Task::(_updateState) Task=`c57ce251-0ea7-4201-b2e5-37b137133c14`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:42:11,443::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:42:11,444::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00666985', 'lastCheck': '1.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:42:11,444::task::1185::TaskManager.Task::(prepare) Task=`c57ce251-0ea7-4201-b2e5-37b137133c14`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00666985', 'lastCheck': '1.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:42:11,444::task::595::TaskManager.Task::(_updateState) Task=`c57ce251-0ea7-4201-b2e5-37b137133c14`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:42:11,444::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:42:11,444::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:42:11,444::task::990::TaskManager.Task::(_decref) Task=`c57ce251-0ea7-4201-b2e5-37b137133c14`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:42:11,576::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:42:11,652::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332836 s, 30.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:42:13,665::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:42:13,744::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365484 s, 28.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:42:15,397::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:42:15,398::task::595::TaskManager.Task::(_updateState) Task=`2dbd0507-c87c-4c27-a30b-481fd5ddd4ec`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:42:15,398::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:42:15,399::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:42:15,399::task::1185::TaskManager.Task::(prepare) Task=`2dbd0507-c87c-4c27-a30b-481fd5ddd4ec`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:42:15,399::task::595::TaskManager.Task::(_updateState) Task=`2dbd0507-c87c-4c27-a30b-481fd5ddd4ec`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:42:15,399::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:42:15,399::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:42:15,400::task::990::TaskManager.Task::(_decref) Task=`2dbd0507-c87c-4c27-a30b-481fd5ddd4ec`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:42:15,465::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:42:15,466::task::595::TaskManager.Task::(_updateState) Task=`9cc71763-4906-4436-a9eb-2a15752d2fee`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:42:15,466::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:42:15,466::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d2a39f62-dea2-4d4c-abf9-3a6dc8d4a8f6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:42:15,467::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:42:15,467::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:42:15,467::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d2a39f62-dea2-4d4c-abf9-3a6dc8d4a8f6`::Granted request >Thread-34::DEBUG::2014-07-24 11:42:15,467::task::827::TaskManager.Task::(resourceAcquired) Task=`9cc71763-4906-4436-a9eb-2a15752d2fee`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:42:15,467::task::990::TaskManager.Task::(_decref) Task=`9cc71763-4906-4436-a9eb-2a15752d2fee`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:42:15,468::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:42:15,468::task::1185::TaskManager.Task::(prepare) Task=`9cc71763-4906-4436-a9eb-2a15752d2fee`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:42:15,469::task::595::TaskManager.Task::(_updateState) Task=`9cc71763-4906-4436-a9eb-2a15752d2fee`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:42:15,469::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:42:15,469::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:42:15,469::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:42:15,469::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:42:15,470::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:42:15,470::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:42:15,470::task::990::TaskManager.Task::(_decref) Task=`9cc71763-4906-4436-a9eb-2a15752d2fee`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:42:15,757::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:42:15,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0423919 s, 24.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:42:17,855::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:42:17,934::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372037 s, 27.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:42:19,946::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:42:20,025::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350082 s, 29.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:42:20,160::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:42:20,173::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000648331 s, 6.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:42:22,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:42:22,115::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364136 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:42:24,128::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:42:24,206::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348926 s, 29.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:42:25,528::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [1487b3f5] >Thread-14::DEBUG::2014-07-24 11:42:25,529::task::595::TaskManager.Task::(_updateState) Task=`082fe45b-5901-45a0-8d69-155903d2e83d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:42:25,529::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:42:25,530::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:42:25,530::task::1185::TaskManager.Task::(prepare) Task=`082fe45b-5901-45a0-8d69-155903d2e83d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:42:25,530::task::595::TaskManager.Task::(_updateState) Task=`082fe45b-5901-45a0-8d69-155903d2e83d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:42:25,530::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:42:25,530::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:42:25,530::task::990::TaskManager.Task::(_decref) Task=`082fe45b-5901-45a0-8d69-155903d2e83d`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:42:25,561::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [1487b3f5] >Thread-34::DEBUG::2014-07-24 11:42:25,562::task::595::TaskManager.Task::(_updateState) Task=`675aae77-984e-4463-a266-f51b8c18e1a1`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:42:25,562::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:42:25,562::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7a75344a-296e-48c8-94da-4c9daff45fde`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:42:25,562::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:42:25,563::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:42:25,563::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7a75344a-296e-48c8-94da-4c9daff45fde`::Granted request >Thread-34::DEBUG::2014-07-24 11:42:25,563::task::827::TaskManager.Task::(resourceAcquired) Task=`675aae77-984e-4463-a266-f51b8c18e1a1`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:42:25,563::task::990::TaskManager.Task::(_decref) Task=`675aae77-984e-4463-a266-f51b8c18e1a1`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:42:25,564::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:42:25,564::task::1185::TaskManager.Task::(prepare) Task=`675aae77-984e-4463-a266-f51b8c18e1a1`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:42:25,565::task::595::TaskManager.Task::(_updateState) Task=`675aae77-984e-4463-a266-f51b8c18e1a1`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:42:25,565::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:42:25,565::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:42:25,565::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:42:25,565::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:42:25,566::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:42:25,566::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:42:25,566::task::990::TaskManager.Task::(_decref) Task=`675aae77-984e-4463-a266-f51b8c18e1a1`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:42:26,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:42:26,296::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357739 s, 28.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:42:26,803::task::595::TaskManager.Task::(_updateState) Task=`315a4180-b487-4f80-bb6f-ddc93d4dddc7`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:42:26,803::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:42:26,803::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000648331', 'lastCheck': '6.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:42:26,803::task::1185::TaskManager.Task::(prepare) Task=`315a4180-b487-4f80-bb6f-ddc93d4dddc7`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000648331', 'lastCheck': '6.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:42:26,803::task::595::TaskManager.Task::(_updateState) Task=`315a4180-b487-4f80-bb6f-ddc93d4dddc7`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:42:26,804::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:42:26,804::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:42:26,804::task::990::TaskManager.Task::(_decref) Task=`315a4180-b487-4f80-bb6f-ddc93d4dddc7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:42:28,308::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:42:28,386::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352183 s, 29.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:42:30,177::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:42:30,189::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000601573 s, 6.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:42:30,398::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:42:30,475::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034337 s, 29.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:42:31,174::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:42:32,487::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:42:32,583::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0531943 s, 19.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:42:34,596::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:42:34,671::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336436 s, 30.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:42:35,623::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:42:35,623::task::595::TaskManager.Task::(_updateState) Task=`4c83524c-2faa-4acb-80fd-4e1b78717b17`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:42:35,623::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:42:35,624::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:42:35,624::task::1185::TaskManager.Task::(prepare) Task=`4c83524c-2faa-4acb-80fd-4e1b78717b17`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:42:35,624::task::595::TaskManager.Task::(_updateState) Task=`4c83524c-2faa-4acb-80fd-4e1b78717b17`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:42:35,624::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:42:35,624::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:42:35,625::task::990::TaskManager.Task::(_decref) Task=`4c83524c-2faa-4acb-80fd-4e1b78717b17`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:42:35,657::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:42:35,657::task::595::TaskManager.Task::(_updateState) Task=`d82209fb-aab1-4e20-9dfe-ca85480a1984`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:42:35,657::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:42:35,658::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`89496932-ce2a-4854-8830-3ef8b26a92a2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:42:35,658::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:42:35,658::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:42:35,658::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`89496932-ce2a-4854-8830-3ef8b26a92a2`::Granted request >Thread-34::DEBUG::2014-07-24 11:42:35,659::task::827::TaskManager.Task::(resourceAcquired) Task=`d82209fb-aab1-4e20-9dfe-ca85480a1984`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:42:35,659::task::990::TaskManager.Task::(_decref) Task=`d82209fb-aab1-4e20-9dfe-ca85480a1984`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:42:35,660::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:42:35,660::task::1185::TaskManager.Task::(prepare) Task=`d82209fb-aab1-4e20-9dfe-ca85480a1984`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:42:35,660::task::595::TaskManager.Task::(_updateState) Task=`d82209fb-aab1-4e20-9dfe-ca85480a1984`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:42:35,660::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:42:35,660::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:42:35,661::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:42:35,661::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:42:35,661::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:42:35,661::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:42:35,661::task::990::TaskManager.Task::(_decref) Task=`d82209fb-aab1-4e20-9dfe-ca85480a1984`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:42:36,681::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:42:36,760::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362792 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:42:38,772::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:42:38,850::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362144 s, 28.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:42:40,194::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:42:40,222::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0177165 s, 231 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:42:40,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:42:41,229::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.324013 s, 3.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:42:42,191::task::595::TaskManager.Task::(_updateState) Task=`7ffcb683-db53-41b5-97aa-39a58a63cc4b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:42:42,191::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:42:42,191::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0177165', 'lastCheck': '2.0', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:42:42,192::task::1185::TaskManager.Task::(prepare) Task=`7ffcb683-db53-41b5-97aa-39a58a63cc4b`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0177165', 'lastCheck': '2.0', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:42:42,192::task::595::TaskManager.Task::(_updateState) Task=`7ffcb683-db53-41b5-97aa-39a58a63cc4b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:42:42,192::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:42:42,192::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:42:42,192::task::990::TaskManager.Task::(_decref) Task=`7ffcb683-db53-41b5-97aa-39a58a63cc4b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:42:43,242::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:42:43,353::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0696448 s, 14.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:42:45,366::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:42:45,443::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353281 s, 29.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:42:45,718::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:42:45,718::task::595::TaskManager.Task::(_updateState) Task=`3461d491-64b5-443e-a3a8-356b271557f4`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:42:45,718::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:42:45,719::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:42:45,719::task::1185::TaskManager.Task::(prepare) Task=`3461d491-64b5-443e-a3a8-356b271557f4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:42:45,719::task::595::TaskManager.Task::(_updateState) Task=`3461d491-64b5-443e-a3a8-356b271557f4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:42:45,719::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:42:45,719::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:42:45,720::task::990::TaskManager.Task::(_decref) Task=`3461d491-64b5-443e-a3a8-356b271557f4`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:42:45,754::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:42:45,754::task::595::TaskManager.Task::(_updateState) Task=`0563e8ca-701b-43cd-a474-5a366cd604a2`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:42:45,755::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:42:45,755::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`42615450-526f-4c3b-9fcd-ec050f6fae10`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:42:45,755::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:42:45,756::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:42:45,756::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`42615450-526f-4c3b-9fcd-ec050f6fae10`::Granted request >Thread-34::DEBUG::2014-07-24 11:42:45,756::task::827::TaskManager.Task::(resourceAcquired) Task=`0563e8ca-701b-43cd-a474-5a366cd604a2`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:42:45,756::task::990::TaskManager.Task::(_decref) Task=`0563e8ca-701b-43cd-a474-5a366cd604a2`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:42:45,757::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:42:45,757::task::1185::TaskManager.Task::(prepare) Task=`0563e8ca-701b-43cd-a474-5a366cd604a2`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:42:45,757::task::595::TaskManager.Task::(_updateState) Task=`0563e8ca-701b-43cd-a474-5a366cd604a2`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:42:45,758::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:42:45,758::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:42:45,758::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:42:45,758::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:42:45,758::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:42:45,758::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:42:45,759::task::990::TaskManager.Task::(_decref) Task=`0563e8ca-701b-43cd-a474-5a366cd604a2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:42:47,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:42:47,533::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349403 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:42:49,546::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:42:49,628::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360202 s, 28.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:42:50,227::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:42:50,239::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000687598 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:42:51,641::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:42:51,720::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368986 s, 27.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:42:53,732::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:42:53,811::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345102 s, 29.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:42:55,821::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:42:55,821::task::595::TaskManager.Task::(_updateState) Task=`8a038934-a639-4317-90c0-46793fbd0b2f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:42:55,822::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:42:55,822::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:42:55,822::task::1185::TaskManager.Task::(prepare) Task=`8a038934-a639-4317-90c0-46793fbd0b2f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:42:55,822::task::595::TaskManager.Task::(_updateState) Task=`8a038934-a639-4317-90c0-46793fbd0b2f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:42:55,823::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:42:55,823::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:42:55,823::task::990::TaskManager.Task::(_decref) Task=`8a038934-a639-4317-90c0-46793fbd0b2f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:42:55,824::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-34::DEBUG::2014-07-24 11:42:55,864::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:42:55,866::task::595::TaskManager.Task::(_updateState) Task=`9860ba82-6f18-4273-9207-e10e3c742efa`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:42:55,866::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:42:55,868::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4029c657-0e56-4948-83e3-56c214f8bd97`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:42:55,869::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:42:55,870::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:42:55,870::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4029c657-0e56-4948-83e3-56c214f8bd97`::Granted request >Thread-34::DEBUG::2014-07-24 11:42:55,872::task::827::TaskManager.Task::(resourceAcquired) Task=`9860ba82-6f18-4273-9207-e10e3c742efa`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:42:55,873::task::990::TaskManager.Task::(_decref) Task=`9860ba82-6f18-4273-9207-e10e3c742efa`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:42:55,876::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:42:55,877::task::1185::TaskManager.Task::(prepare) Task=`9860ba82-6f18-4273-9207-e10e3c742efa`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:42:55,878::task::595::TaskManager.Task::(_updateState) Task=`9860ba82-6f18-4273-9207-e10e3c742efa`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:42:55,878::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:42:55,879::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:42:55,880::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:42:55,881::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:42:55,882::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:42:55,882::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:42:55,883::task::990::TaskManager.Task::(_decref) Task=`9860ba82-6f18-4273-9207-e10e3c742efa`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:42:55,923::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0575057 s, 17.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:42:57,621::task::595::TaskManager.Task::(_updateState) Task=`023eaba1-fc95-45d2-b821-42135c96a45a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:42:57,622::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:42:57,622::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000687598', 'lastCheck': '7.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:42:57,622::task::1185::TaskManager.Task::(prepare) Task=`023eaba1-fc95-45d2-b821-42135c96a45a`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000687598', 'lastCheck': '7.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:42:57,622::task::595::TaskManager.Task::(_updateState) Task=`023eaba1-fc95-45d2-b821-42135c96a45a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:42:57,622::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:42:57,623::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:42:57,623::task::990::TaskManager.Task::(_decref) Task=`023eaba1-fc95-45d2-b821-42135c96a45a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:42:57,936::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:42:58,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035377 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:43:00,027::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:43:00,101::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331702 s, 30.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:43:00,243::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:43:00,255::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000657364 s, 6.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:43:01,210::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:43:02,114::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:43:02,191::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346207 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:43:04,203::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:43:04,283::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0381892 s, 26.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:43:05,943::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:43:05,944::task::595::TaskManager.Task::(_updateState) Task=`dfc84b56-77c6-46ec-8399-9a0146b55cb6`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:43:05,944::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:43:05,944::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:43:05,945::task::1185::TaskManager.Task::(prepare) Task=`dfc84b56-77c6-46ec-8399-9a0146b55cb6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:43:05,945::task::595::TaskManager.Task::(_updateState) Task=`dfc84b56-77c6-46ec-8399-9a0146b55cb6`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:43:05,945::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:43:05,945::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:43:05,945::task::990::TaskManager.Task::(_decref) Task=`dfc84b56-77c6-46ec-8399-9a0146b55cb6`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:43:05,978::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:43:05,978::task::595::TaskManager.Task::(_updateState) Task=`6e9c0da6-3f78-4ec4-a9a5-bdca7e1ca4ce`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:43:05,978::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:43:05,978::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`0a1b057f-315b-4bb8-a8a1-f535e73ac990`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:43:05,979::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:43:05,979::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:43:05,979::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`0a1b057f-315b-4bb8-a8a1-f535e73ac990`::Granted request >Thread-34::DEBUG::2014-07-24 11:43:05,979::task::827::TaskManager.Task::(resourceAcquired) Task=`6e9c0da6-3f78-4ec4-a9a5-bdca7e1ca4ce`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:43:05,980::task::990::TaskManager.Task::(_decref) Task=`6e9c0da6-3f78-4ec4-a9a5-bdca7e1ca4ce`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:43:05,980::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:43:05,981::task::1185::TaskManager.Task::(prepare) Task=`6e9c0da6-3f78-4ec4-a9a5-bdca7e1ca4ce`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:43:05,981::task::595::TaskManager.Task::(_updateState) Task=`6e9c0da6-3f78-4ec4-a9a5-bdca7e1ca4ce`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:43:05,981::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:43:05,981::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:43:05,981::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:43:05,982::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:43:05,982::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:43:05,982::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:43:05,982::task::990::TaskManager.Task::(_decref) Task=`6e9c0da6-3f78-4ec4-a9a5-bdca7e1ca4ce`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:43:06,296::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:43:06,388::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355598 s, 28.8 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:43:07,807::task::595::TaskManager.Task::(_updateState) Task=`716e4fd3-e30d-49f3-bb6d-dcfb2ee0085e`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:43:07,808::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:43:07,808::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-37::DEBUG::2014-07-24 11:43:07,808::task::1185::TaskManager.Task::(prepare) Task=`716e4fd3-e30d-49f3-bb6d-dcfb2ee0085e`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-37::DEBUG::2014-07-24 11:43:07,808::task::595::TaskManager.Task::(_updateState) Task=`716e4fd3-e30d-49f3-bb6d-dcfb2ee0085e`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:43:07,808::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:43:07,809::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:43:07,809::task::990::TaskManager.Task::(_decref) Task=`716e4fd3-e30d-49f3-bb6d-dcfb2ee0085e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:43:08,400::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:43:08,482::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0403338 s, 25.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:43:10,259::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:43:10,281::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0110999 s, 369 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:43:10,495::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:43:10,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368891 s, 27.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:43:12,587::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:43:12,663::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346093 s, 29.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:43:12,996::task::595::TaskManager.Task::(_updateState) Task=`344b5af7-9d80-4970-a88d-c9e0de5a1a9e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:43:12,997::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:43:12,997::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0110999', 'lastCheck': '2.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:43:12,997::task::1185::TaskManager.Task::(prepare) Task=`344b5af7-9d80-4970-a88d-c9e0de5a1a9e`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0110999', 'lastCheck': '2.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:43:12,997::task::595::TaskManager.Task::(_updateState) Task=`344b5af7-9d80-4970-a88d-c9e0de5a1a9e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:43:12,997::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:43:12,998::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:43:12,998::task::990::TaskManager.Task::(_decref) Task=`344b5af7-9d80-4970-a88d-c9e0de5a1a9e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:43:14,676::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:43:14,752::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338056 s, 30.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:43:16,038::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:43:16,038::task::595::TaskManager.Task::(_updateState) Task=`a479262c-84e6-4292-a0d0-de55faf463f3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:43:16,039::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:43:16,039::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:43:16,039::task::1185::TaskManager.Task::(prepare) Task=`a479262c-84e6-4292-a0d0-de55faf463f3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:43:16,039::task::595::TaskManager.Task::(_updateState) Task=`a479262c-84e6-4292-a0d0-de55faf463f3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:43:16,039::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:43:16,040::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:43:16,040::task::990::TaskManager.Task::(_decref) Task=`a479262c-84e6-4292-a0d0-de55faf463f3`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:43:16,070::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:43:16,070::task::595::TaskManager.Task::(_updateState) Task=`bc0d7bec-427a-4e76-a7f6-a238297edd6a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:43:16,070::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:43:16,071::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1403e5ed-78f7-43e3-b01c-3581110b25fe`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:43:16,071::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:43:16,071::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:43:16,071::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1403e5ed-78f7-43e3-b01c-3581110b25fe`::Granted request >Thread-34::DEBUG::2014-07-24 11:43:16,072::task::827::TaskManager.Task::(resourceAcquired) Task=`bc0d7bec-427a-4e76-a7f6-a238297edd6a`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:43:16,072::task::990::TaskManager.Task::(_decref) Task=`bc0d7bec-427a-4e76-a7f6-a238297edd6a`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:43:16,073::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:43:16,073::task::1185::TaskManager.Task::(prepare) Task=`bc0d7bec-427a-4e76-a7f6-a238297edd6a`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:43:16,073::task::595::TaskManager.Task::(_updateState) Task=`bc0d7bec-427a-4e76-a7f6-a238297edd6a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:43:16,073::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:43:16,073::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:43:16,074::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:43:16,074::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:43:16,074::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:43:16,074::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:43:16,074::task::990::TaskManager.Task::(_decref) Task=`bc0d7bec-427a-4e76-a7f6-a238297edd6a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:43:16,764::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:43:16,841::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352298 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:43:18,854::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:43:18,933::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370693 s, 27.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:43:20,286::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:43:20,298::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00063444 s, 6.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:43:20,946::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:43:21,023::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035431 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:43:23,036::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:43:23,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.048256 s, 21.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:43:25,141::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:43:25,219::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353981 s, 28.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:43:26,127::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:43:26,127::task::595::TaskManager.Task::(_updateState) Task=`55bb0c7b-6660-45c7-920f-baf906c9c2b7`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:43:26,127::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:43:26,128::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:43:26,128::task::1185::TaskManager.Task::(prepare) Task=`55bb0c7b-6660-45c7-920f-baf906c9c2b7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:43:26,128::task::595::TaskManager.Task::(_updateState) Task=`55bb0c7b-6660-45c7-920f-baf906c9c2b7`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:43:26,128::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:43:26,128::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:43:26,129::task::990::TaskManager.Task::(_decref) Task=`55bb0c7b-6660-45c7-920f-baf906c9c2b7`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:43:26,162::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:43:26,162::task::595::TaskManager.Task::(_updateState) Task=`16b45905-1d06-4b86-ac2c-5e8b57bca29c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:43:26,162::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:43:26,163::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7127d46e-4fba-4094-a0a2-0193de6b9a4b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:43:26,163::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:43:26,163::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:43:26,163::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`7127d46e-4fba-4094-a0a2-0193de6b9a4b`::Granted request >Thread-34::DEBUG::2014-07-24 11:43:26,164::task::827::TaskManager.Task::(resourceAcquired) Task=`16b45905-1d06-4b86-ac2c-5e8b57bca29c`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:43:26,164::task::990::TaskManager.Task::(_decref) Task=`16b45905-1d06-4b86-ac2c-5e8b57bca29c`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:43:26,164::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:43:26,165::task::1185::TaskManager.Task::(prepare) Task=`16b45905-1d06-4b86-ac2c-5e8b57bca29c`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:43:26,165::task::595::TaskManager.Task::(_updateState) Task=`16b45905-1d06-4b86-ac2c-5e8b57bca29c`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:43:26,165::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:43:26,165::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:43:26,165::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:43:26,166::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:43:26,166::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:43:26,166::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:43:26,166::task::990::TaskManager.Task::(_decref) Task=`16b45905-1d06-4b86-ac2c-5e8b57bca29c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:43:27,232::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:43:27,307::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333925 s, 30.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:43:28,388::task::595::TaskManager.Task::(_updateState) Task=`e3ed6d5a-4fd5-4cbe-b9a7-b8403c97ee26`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:43:28,389::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:43:28,389::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00063444', 'lastCheck': '8.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:43:28,389::task::1185::TaskManager.Task::(prepare) Task=`e3ed6d5a-4fd5-4cbe-b9a7-b8403c97ee26`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00063444', 'lastCheck': '8.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:43:28,389::task::595::TaskManager.Task::(_updateState) Task=`e3ed6d5a-4fd5-4cbe-b9a7-b8403c97ee26`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:43:28,389::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:43:28,390::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:43:28,390::task::990::TaskManager.Task::(_decref) Task=`e3ed6d5a-4fd5-4cbe-b9a7-b8403c97ee26`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:43:29,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:43:29,396::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346373 s, 29.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:43:30,302::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:43:30,314::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000692949 s, 5.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:43:31,247::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:43:31,408::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:43:31,484::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331112 s, 30.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:43:33,496::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:43:33,579::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0410189 s, 25.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:43:35,592::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:43:35,669::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343172 s, 29.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:43:36,224::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:43:36,224::task::595::TaskManager.Task::(_updateState) Task=`4909cb89-d800-443e-bfb9-5ed00477a065`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:43:36,225::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:43:36,225::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:43:36,225::task::1185::TaskManager.Task::(prepare) Task=`4909cb89-d800-443e-bfb9-5ed00477a065`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:43:36,225::task::595::TaskManager.Task::(_updateState) Task=`4909cb89-d800-443e-bfb9-5ed00477a065`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:43:36,225::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:43:36,226::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:43:36,226::task::990::TaskManager.Task::(_decref) Task=`4909cb89-d800-443e-bfb9-5ed00477a065`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:43:36,263::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:43:36,263::task::595::TaskManager.Task::(_updateState) Task=`b3c2bd9b-d95a-4b21-88cc-bef88ec82b7c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:43:36,263::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:43:36,264::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`0a274784-eb71-4869-9e70-e519f60ae705`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:43:36,264::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:43:36,264::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:43:36,264::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`0a274784-eb71-4869-9e70-e519f60ae705`::Granted request >Thread-34::DEBUG::2014-07-24 11:43:36,265::task::827::TaskManager.Task::(resourceAcquired) Task=`b3c2bd9b-d95a-4b21-88cc-bef88ec82b7c`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:43:36,265::task::990::TaskManager.Task::(_decref) Task=`b3c2bd9b-d95a-4b21-88cc-bef88ec82b7c`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:43:36,266::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:43:36,266::task::1185::TaskManager.Task::(prepare) Task=`b3c2bd9b-d95a-4b21-88cc-bef88ec82b7c`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:43:36,266::task::595::TaskManager.Task::(_updateState) Task=`b3c2bd9b-d95a-4b21-88cc-bef88ec82b7c`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:43:36,266::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:43:36,266::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:43:36,266::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:43:36,267::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:43:36,267::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:43:36,267::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:43:36,267::task::990::TaskManager.Task::(_decref) Task=`b3c2bd9b-d95a-4b21-88cc-bef88ec82b7c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:43:37,681::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:43:37,760::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366614 s, 27.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:43:39,773::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:43:39,851::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345577 s, 29.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:43:40,318::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:43:40,330::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000779662 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:43:41,864::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:43:41,942::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366627 s, 27.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:43:43,756::task::595::TaskManager.Task::(_updateState) Task=`e44ed949-d11b-40a1-8f20-656d6153c581`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:43:43,757::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:43:43,757::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000779662', 'lastCheck': '3.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:43:43,757::task::1185::TaskManager.Task::(prepare) Task=`e44ed949-d11b-40a1-8f20-656d6153c581`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000779662', 'lastCheck': '3.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:43:43,757::task::595::TaskManager.Task::(_updateState) Task=`e44ed949-d11b-40a1-8f20-656d6153c581`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:43:43,758::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:43:43,758::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:43:43,758::task::990::TaskManager.Task::(_decref) Task=`e44ed949-d11b-40a1-8f20-656d6153c581`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:43:43,955::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:43:44,034::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356726 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:43:46,046::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:43:46,123::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357068 s, 28.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:43:46,322::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:43:46,322::task::595::TaskManager.Task::(_updateState) Task=`065b7bd0-c5f3-4c91-b691-ea853c785042`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:43:46,322::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:43:46,323::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:43:46,323::task::1185::TaskManager.Task::(prepare) Task=`065b7bd0-c5f3-4c91-b691-ea853c785042`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:43:46,323::task::595::TaskManager.Task::(_updateState) Task=`065b7bd0-c5f3-4c91-b691-ea853c785042`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:43:46,323::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:43:46,323::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:43:46,324::task::990::TaskManager.Task::(_decref) Task=`065b7bd0-c5f3-4c91-b691-ea853c785042`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:43:46,355::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:43:46,355::task::595::TaskManager.Task::(_updateState) Task=`38db97ab-0ddd-4ab9-a14d-0e9a2a1ac384`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:43:46,355::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:43:46,356::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`0652af26-bfa3-4449-bc9f-e56db5cb1c87`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:43:46,356::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:43:46,356::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:43:46,356::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`0652af26-bfa3-4449-bc9f-e56db5cb1c87`::Granted request >Thread-34::DEBUG::2014-07-24 11:43:46,356::task::827::TaskManager.Task::(resourceAcquired) Task=`38db97ab-0ddd-4ab9-a14d-0e9a2a1ac384`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:43:46,357::task::990::TaskManager.Task::(_decref) Task=`38db97ab-0ddd-4ab9-a14d-0e9a2a1ac384`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:43:46,357::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:43:46,358::task::1185::TaskManager.Task::(prepare) Task=`38db97ab-0ddd-4ab9-a14d-0e9a2a1ac384`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:43:46,358::task::595::TaskManager.Task::(_updateState) Task=`38db97ab-0ddd-4ab9-a14d-0e9a2a1ac384`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:43:46,358::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:43:46,358::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:43:46,358::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:43:46,358::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:43:46,359::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:43:46,359::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:43:46,359::task::990::TaskManager.Task::(_decref) Task=`38db97ab-0ddd-4ab9-a14d-0e9a2a1ac384`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:43:48,135::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:43:48,211::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331352 s, 30.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:43:50,223::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:43:50,299::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340337 s, 30.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:43:50,335::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:43:50,357::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0116821 s, 351 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:43:52,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:43:52,390::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351182 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:43:54,403::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:43:54,479::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034265 s, 29.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:43:56,413::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:43:56,414::task::595::TaskManager.Task::(_updateState) Task=`6aa97504-6667-40f5-9955-a82990e02860`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:43:56,414::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:43:56,414::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:43:56,414::task::1185::TaskManager.Task::(prepare) Task=`6aa97504-6667-40f5-9955-a82990e02860`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:43:56,414::task::595::TaskManager.Task::(_updateState) Task=`6aa97504-6667-40f5-9955-a82990e02860`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:43:56,415::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:43:56,415::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:43:56,415::task::990::TaskManager.Task::(_decref) Task=`6aa97504-6667-40f5-9955-a82990e02860`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:43:56,450::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:43:56,451::task::595::TaskManager.Task::(_updateState) Task=`6b0617e3-e131-4409-a394-fb7f9382b1f7`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:43:56,451::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:43:56,451::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`27be7d4c-57d9-47e4-a259-70520f3e266b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:43:56,451::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:43:56,452::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:43:56,452::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`27be7d4c-57d9-47e4-a259-70520f3e266b`::Granted request >Thread-34::DEBUG::2014-07-24 11:43:56,452::task::827::TaskManager.Task::(resourceAcquired) Task=`6b0617e3-e131-4409-a394-fb7f9382b1f7`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:43:56,452::task::990::TaskManager.Task::(_decref) Task=`6b0617e3-e131-4409-a394-fb7f9382b1f7`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:43:56,453::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:43:56,453::task::1185::TaskManager.Task::(prepare) Task=`6b0617e3-e131-4409-a394-fb7f9382b1f7`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:43:56,453::task::595::TaskManager.Task::(_updateState) Task=`6b0617e3-e131-4409-a394-fb7f9382b1f7`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:43:56,453::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:43:56,454::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:43:56,454::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:43:56,454::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:43:56,454::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:43:56,454::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:43:56,455::task::990::TaskManager.Task::(_decref) Task=`6b0617e3-e131-4409-a394-fb7f9382b1f7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:43:56,491::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:43:56,569::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348275 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:43:58,581::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:43:58,658::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035308 s, 29.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:43:59,178::task::595::TaskManager.Task::(_updateState) Task=`23dafd4a-383d-4ba3-9cd2-2f1df8fadc8b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:43:59,178::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:43:59,178::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0116821', 'lastCheck': '8.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:43:59,178::task::1185::TaskManager.Task::(prepare) Task=`23dafd4a-383d-4ba3-9cd2-2f1df8fadc8b`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0116821', 'lastCheck': '8.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:43:59,178::task::595::TaskManager.Task::(_updateState) Task=`23dafd4a-383d-4ba3-9cd2-2f1df8fadc8b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:43:59,179::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:43:59,179::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:43:59,179::task::990::TaskManager.Task::(_decref) Task=`23dafd4a-383d-4ba3-9cd2-2f1df8fadc8b`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:44:00,362::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:44:00,391::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0178787 s, 229 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:44:00,671::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:44:00,748::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344825 s, 29.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:44:01,283::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:44:02,760::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:44:02,835::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332252 s, 30.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:44:04,848::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:44:04,925::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345823 s, 29.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:44:06,517::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:44:06,528::task::595::TaskManager.Task::(_updateState) Task=`b0c04eb1-9589-4c2f-84cc-5ca2a1332181`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:44:06,528::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:44:06,529::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:44:06,529::task::1185::TaskManager.Task::(prepare) Task=`b0c04eb1-9589-4c2f-84cc-5ca2a1332181`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:44:06,529::task::595::TaskManager.Task::(_updateState) Task=`b0c04eb1-9589-4c2f-84cc-5ca2a1332181`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:44:06,529::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:44:06,529::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:44:06,530::task::990::TaskManager.Task::(_decref) Task=`b0c04eb1-9589-4c2f-84cc-5ca2a1332181`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:44:06,563::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:44:06,563::task::595::TaskManager.Task::(_updateState) Task=`1f8d8d24-9424-4bbc-9dc7-be8bf357e2c4`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:44:06,563::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:44:06,563::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`fe118131-bb1c-4ccf-acad-83036c11473e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:44:06,564::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:44:06,564::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:44:06,564::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`fe118131-bb1c-4ccf-acad-83036c11473e`::Granted request >Thread-34::DEBUG::2014-07-24 11:44:06,564::task::827::TaskManager.Task::(resourceAcquired) Task=`1f8d8d24-9424-4bbc-9dc7-be8bf357e2c4`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:44:06,565::task::990::TaskManager.Task::(_decref) Task=`1f8d8d24-9424-4bbc-9dc7-be8bf357e2c4`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:44:06,565::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:44:06,565::task::1185::TaskManager.Task::(prepare) Task=`1f8d8d24-9424-4bbc-9dc7-be8bf357e2c4`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:44:06,566::task::595::TaskManager.Task::(_updateState) Task=`1f8d8d24-9424-4bbc-9dc7-be8bf357e2c4`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:44:06,566::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:44:06,566::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:44:06,566::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:44:06,566::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:44:06,566::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:44:06,567::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:44:06,567::task::990::TaskManager.Task::(_decref) Task=`1f8d8d24-9424-4bbc-9dc7-be8bf357e2c4`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:44:06,938::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:44:07,013::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337992 s, 30.3 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:44:07,946::task::595::TaskManager.Task::(_updateState) Task=`556284b4-3fb8-4b59-9e20-922dc560fcda`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:44:07,946::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:44:07,946::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-37::DEBUG::2014-07-24 11:44:07,947::task::1185::TaskManager.Task::(prepare) Task=`556284b4-3fb8-4b59-9e20-922dc560fcda`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-37::DEBUG::2014-07-24 11:44:07,947::task::595::TaskManager.Task::(_updateState) Task=`556284b4-3fb8-4b59-9e20-922dc560fcda`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:44:07,947::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:44:07,947::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:44:07,947::task::990::TaskManager.Task::(_decref) Task=`556284b4-3fb8-4b59-9e20-922dc560fcda`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:44:09,026::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:44:09,102::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345627 s, 29.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:44:10,395::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:44:10,407::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000644226 s, 6.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:44:11,115::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:44:11,191::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341351 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:44:13,203::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:44:13,280::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343252 s, 29.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:44:14,557::task::595::TaskManager.Task::(_updateState) Task=`c914fbf1-3a58-4b45-8f44-9662a2dda473`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:44:14,557::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:44:14,557::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644226', 'lastCheck': '4.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:44:14,557::task::1185::TaskManager.Task::(prepare) Task=`c914fbf1-3a58-4b45-8f44-9662a2dda473`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000644226', 'lastCheck': '4.1', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:44:14,558::task::595::TaskManager.Task::(_updateState) Task=`c914fbf1-3a58-4b45-8f44-9662a2dda473`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:44:14,558::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:44:14,558::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:44:14,559::task::990::TaskManager.Task::(_decref) Task=`c914fbf1-3a58-4b45-8f44-9662a2dda473`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:44:15,292::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:44:15,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347927 s, 29.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:44:16,656::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:44:16,665::task::595::TaskManager.Task::(_updateState) Task=`18b4bfce-c0b3-4b66-9909-ac8049abab4a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:44:16,665::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:44:16,666::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:44:16,666::task::1185::TaskManager.Task::(prepare) Task=`18b4bfce-c0b3-4b66-9909-ac8049abab4a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:44:16,666::task::595::TaskManager.Task::(_updateState) Task=`18b4bfce-c0b3-4b66-9909-ac8049abab4a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:44:16,666::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:44:16,666::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:44:16,667::task::990::TaskManager.Task::(_decref) Task=`18b4bfce-c0b3-4b66-9909-ac8049abab4a`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:44:16,704::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:44:16,704::task::595::TaskManager.Task::(_updateState) Task=`50d82075-0f25-4094-af22-947d29dd2dd4`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:44:16,705::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:44:16,705::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`5ccc176a-5ee6-447e-b508-ec5d6cd30ee8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:44:16,705::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:44:16,705::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:44:16,706::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`5ccc176a-5ee6-447e-b508-ec5d6cd30ee8`::Granted request >Thread-34::DEBUG::2014-07-24 11:44:16,706::task::827::TaskManager.Task::(resourceAcquired) Task=`50d82075-0f25-4094-af22-947d29dd2dd4`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:44:16,706::task::990::TaskManager.Task::(_decref) Task=`50d82075-0f25-4094-af22-947d29dd2dd4`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:44:16,707::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:44:16,707::task::1185::TaskManager.Task::(prepare) Task=`50d82075-0f25-4094-af22-947d29dd2dd4`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:44:16,707::task::595::TaskManager.Task::(_updateState) Task=`50d82075-0f25-4094-af22-947d29dd2dd4`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:44:16,707::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:44:16,708::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:44:16,708::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:44:16,708::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:44:16,708::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:44:16,708::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:44:16,708::task::990::TaskManager.Task::(_decref) Task=`50d82075-0f25-4094-af22-947d29dd2dd4`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:44:17,381::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:44:17,459::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342981 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:44:19,471::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:44:19,620::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.106719 s, 9.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:44:20,412::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:44:20,423::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000684811 s, 6.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:44:21,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:44:21,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.147668 s, 6.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:44:23,835::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:44:23,913::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343735 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:44:25,926::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:44:26,007::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359392 s, 28.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:44:26,767::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [4376fa5] >Thread-14::DEBUG::2014-07-24 11:44:26,767::task::595::TaskManager.Task::(_updateState) Task=`4b1a2a41-4ad4-488f-bcc3-772d08254141`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:44:26,767::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:44:26,768::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:44:26,768::task::1185::TaskManager.Task::(prepare) Task=`4b1a2a41-4ad4-488f-bcc3-772d08254141`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:44:26,768::task::595::TaskManager.Task::(_updateState) Task=`4b1a2a41-4ad4-488f-bcc3-772d08254141`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:44:26,768::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:44:26,768::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:44:26,769::task::990::TaskManager.Task::(_decref) Task=`4b1a2a41-4ad4-488f-bcc3-772d08254141`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:44:26,799::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [4376fa5] >Thread-34::DEBUG::2014-07-24 11:44:26,799::task::595::TaskManager.Task::(_updateState) Task=`e3ff5654-91d0-4e5f-9c60-9cb726c8e982`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:44:26,800::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:44:26,800::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`97ccba4b-e6ce-4e8a-9dc5-254f7465a802`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:44:26,800::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:44:26,800::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:44:26,801::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`97ccba4b-e6ce-4e8a-9dc5-254f7465a802`::Granted request >Thread-34::DEBUG::2014-07-24 11:44:26,801::task::827::TaskManager.Task::(resourceAcquired) Task=`e3ff5654-91d0-4e5f-9c60-9cb726c8e982`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:44:26,801::task::990::TaskManager.Task::(_decref) Task=`e3ff5654-91d0-4e5f-9c60-9cb726c8e982`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:44:26,802::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:44:26,802::task::1185::TaskManager.Task::(prepare) Task=`e3ff5654-91d0-4e5f-9c60-9cb726c8e982`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:44:26,802::task::595::TaskManager.Task::(_updateState) Task=`e3ff5654-91d0-4e5f-9c60-9cb726c8e982`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:44:26,802::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:44:26,803::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:44:26,803::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:44:26,803::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:44:26,803::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:44:26,803::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:44:26,803::task::990::TaskManager.Task::(_decref) Task=`e3ff5654-91d0-4e5f-9c60-9cb726c8e982`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:44:28,019::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:44:28,098::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353608 s, 29.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:44:29,928::task::595::TaskManager.Task::(_updateState) Task=`32135e40-5f72-411a-ab36-31bbece17ae9`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:44:29,928::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:44:29,929::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000684811', 'lastCheck': '9.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:44:29,929::task::1185::TaskManager.Task::(prepare) Task=`32135e40-5f72-411a-ab36-31bbece17ae9`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000684811', 'lastCheck': '9.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:44:29,929::task::595::TaskManager.Task::(_updateState) Task=`32135e40-5f72-411a-ab36-31bbece17ae9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:44:29,929::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:44:29,929::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:44:29,929::task::990::TaskManager.Task::(_decref) Task=`32135e40-5f72-411a-ab36-31bbece17ae9`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:44:30,111::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:44:30,190::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368049 s, 27.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:44:30,428::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:44:30,440::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000661548 s, 6.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:44:31,320::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:44:32,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:44:32,280::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352132 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:44:34,292::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:44:34,370::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347667 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:44:36,382::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:44:36,457::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330383 s, 31.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:44:36,859::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:44:36,860::task::595::TaskManager.Task::(_updateState) Task=`b06f594a-a329-47dd-901b-49aa14849441`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:44:36,860::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:44:36,860::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:44:36,860::task::1185::TaskManager.Task::(prepare) Task=`b06f594a-a329-47dd-901b-49aa14849441`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:44:36,861::task::595::TaskManager.Task::(_updateState) Task=`b06f594a-a329-47dd-901b-49aa14849441`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:44:36,861::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:44:36,861::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:44:36,861::task::990::TaskManager.Task::(_decref) Task=`b06f594a-a329-47dd-901b-49aa14849441`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:44:36,892::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:44:36,892::task::595::TaskManager.Task::(_updateState) Task=`39372b4d-62f9-4bec-b620-acadf80a7ce3`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:44:36,892::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:44:36,893::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e9645545-e10a-4eaf-965a-922fb130c909`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:44:36,893::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:44:36,893::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:44:36,893::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e9645545-e10a-4eaf-965a-922fb130c909`::Granted request >Thread-34::DEBUG::2014-07-24 11:44:36,894::task::827::TaskManager.Task::(resourceAcquired) Task=`39372b4d-62f9-4bec-b620-acadf80a7ce3`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:44:36,894::task::990::TaskManager.Task::(_decref) Task=`39372b4d-62f9-4bec-b620-acadf80a7ce3`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:44:36,895::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:44:36,895::task::1185::TaskManager.Task::(prepare) Task=`39372b4d-62f9-4bec-b620-acadf80a7ce3`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:44:36,895::task::595::TaskManager.Task::(_updateState) Task=`39372b4d-62f9-4bec-b620-acadf80a7ce3`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:44:36,895::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:44:36,895::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:44:36,895::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:44:36,896::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:44:36,896::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:44:36,896::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:44:36,896::task::990::TaskManager.Task::(_decref) Task=`39372b4d-62f9-4bec-b620-acadf80a7ce3`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:44:38,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:44:38,546::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334189 s, 30.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:44:40,445::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:44:40,457::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000770325 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:44:40,558::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:44:40,633::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335748 s, 30.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:44:42,645::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:44:42,723::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338856 s, 30.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:44:44,735::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:44:44,813::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361009 s, 28.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:44:45,287::task::595::TaskManager.Task::(_updateState) Task=`6b52df01-cd82-4c05-80e3-57a3af94f9fb`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:44:45,288::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:44:45,288::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000770325', 'lastCheck': '4.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:44:45,288::task::1185::TaskManager.Task::(prepare) Task=`6b52df01-cd82-4c05-80e3-57a3af94f9fb`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000770325', 'lastCheck': '4.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:44:45,288::task::595::TaskManager.Task::(_updateState) Task=`6b52df01-cd82-4c05-80e3-57a3af94f9fb`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:44:45,289::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:44:45,289::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:44:45,289::task::990::TaskManager.Task::(_decref) Task=`6b52df01-cd82-4c05-80e3-57a3af94f9fb`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:44:46,825::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:44:46,904::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349691 s, 29.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:44:46,950::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:44:46,951::task::595::TaskManager.Task::(_updateState) Task=`504aeceb-cffe-4983-9421-05b0e45a67c9`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:44:46,951::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:44:46,951::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:44:46,951::task::1185::TaskManager.Task::(prepare) Task=`504aeceb-cffe-4983-9421-05b0e45a67c9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:44:46,952::task::595::TaskManager.Task::(_updateState) Task=`504aeceb-cffe-4983-9421-05b0e45a67c9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:44:46,952::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:44:46,952::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:44:46,952::task::990::TaskManager.Task::(_decref) Task=`504aeceb-cffe-4983-9421-05b0e45a67c9`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:44:46,984::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:44:46,985::task::595::TaskManager.Task::(_updateState) Task=`7516ed93-1ce5-432d-885d-556623e731ac`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:44:46,985::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:44:46,985::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1d7cef80-7be3-4405-83b8-91cab24181bf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:44:46,985::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:44:46,986::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:44:46,986::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1d7cef80-7be3-4405-83b8-91cab24181bf`::Granted request >Thread-34::DEBUG::2014-07-24 11:44:46,986::task::827::TaskManager.Task::(resourceAcquired) Task=`7516ed93-1ce5-432d-885d-556623e731ac`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:44:46,987::task::990::TaskManager.Task::(_decref) Task=`7516ed93-1ce5-432d-885d-556623e731ac`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:44:46,988::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:44:46,989::task::1185::TaskManager.Task::(prepare) Task=`7516ed93-1ce5-432d-885d-556623e731ac`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:44:46,989::task::595::TaskManager.Task::(_updateState) Task=`7516ed93-1ce5-432d-885d-556623e731ac`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:44:46,989::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:44:46,989::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:44:46,989::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:44:46,990::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:44:46,990::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:44:46,990::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:44:46,990::task::990::TaskManager.Task::(_decref) Task=`7516ed93-1ce5-432d-885d-556623e731ac`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:44:48,916::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:44:48,992::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034166 s, 30.0 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:44:50,462::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:44:50,474::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000797074 s, 5.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:44:51,005::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:44:51,085::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370134 s, 27.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:44:53,097::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:44:53,174::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352891 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:44:55,186::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:44:55,264::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349165 s, 29.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:44:57,044::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:44:57,051::task::595::TaskManager.Task::(_updateState) Task=`3dd4ec96-3dde-4157-b62d-1d1796926b57`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:44:57,051::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:44:57,052::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:44:57,052::task::1185::TaskManager.Task::(prepare) Task=`3dd4ec96-3dde-4157-b62d-1d1796926b57`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:44:57,052::task::595::TaskManager.Task::(_updateState) Task=`3dd4ec96-3dde-4157-b62d-1d1796926b57`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:44:57,052::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:44:57,052::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:44:57,053::task::990::TaskManager.Task::(_decref) Task=`3dd4ec96-3dde-4157-b62d-1d1796926b57`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:44:57,083::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:44:57,083::task::595::TaskManager.Task::(_updateState) Task=`efe08a6e-8e42-4251-ab5c-bbadfeeec125`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:44:57,083::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:44:57,084::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`3afc4a10-9c4d-4094-acb3-a4dd1cabb2aa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:44:57,084::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:44:57,084::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:44:57,084::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`3afc4a10-9c4d-4094-acb3-a4dd1cabb2aa`::Granted request >Thread-34::DEBUG::2014-07-24 11:44:57,085::task::827::TaskManager.Task::(resourceAcquired) Task=`efe08a6e-8e42-4251-ab5c-bbadfeeec125`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:44:57,085::task::990::TaskManager.Task::(_decref) Task=`efe08a6e-8e42-4251-ab5c-bbadfeeec125`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:44:57,085::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:44:57,086::task::1185::TaskManager.Task::(prepare) Task=`efe08a6e-8e42-4251-ab5c-bbadfeeec125`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:44:57,086::task::595::TaskManager.Task::(_updateState) Task=`efe08a6e-8e42-4251-ab5c-bbadfeeec125`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:44:57,086::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:44:57,086::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:44:57,086::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:44:57,087::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:44:57,087::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:44:57,087::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:44:57,087::task::990::TaskManager.Task::(_decref) Task=`efe08a6e-8e42-4251-ab5c-bbadfeeec125`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:44:57,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:44:57,354::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353811 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:44:59,367::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:44:59,444::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350296 s, 29.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:45:00,479::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:45:00,491::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000718654 s, 5.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:45:00,648::task::595::TaskManager.Task::(_updateState) Task=`d6616af9-81ab-4244-81b8-a76e152a0dcf`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:45:00,648::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:45:00,648::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000718654', 'lastCheck': '0.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:45:00,648::task::1185::TaskManager.Task::(prepare) Task=`d6616af9-81ab-4244-81b8-a76e152a0dcf`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000718654', 'lastCheck': '0.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:45:00,648::task::595::TaskManager.Task::(_updateState) Task=`d6616af9-81ab-4244-81b8-a76e152a0dcf`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:45:00,649::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:45:00,649::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:45:00,649::task::990::TaskManager.Task::(_decref) Task=`d6616af9-81ab-4244-81b8-a76e152a0dcf`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-07-24 11:45:01,357::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:45:01,457::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:45:01,535::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367729 s, 27.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:45:03,548::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:45:03,626::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354011 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:45:05,639::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:45:05,716::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353587 s, 29.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:45:07,149::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:45:07,149::task::595::TaskManager.Task::(_updateState) Task=`2dfdaf76-4169-4e0f-b3d9-da8d1913d574`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:45:07,149::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:45:07,150::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:45:07,150::task::1185::TaskManager.Task::(prepare) Task=`2dfdaf76-4169-4e0f-b3d9-da8d1913d574`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:45:07,150::task::595::TaskManager.Task::(_updateState) Task=`2dfdaf76-4169-4e0f-b3d9-da8d1913d574`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:45:07,150::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:45:07,150::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:45:07,150::task::990::TaskManager.Task::(_decref) Task=`2dfdaf76-4169-4e0f-b3d9-da8d1913d574`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:45:07,190::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:45:07,191::task::595::TaskManager.Task::(_updateState) Task=`287bf960-e9ff-43ff-a31b-b45d94005652`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:45:07,191::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:45:07,191::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d9dbd129-2ed6-4de4-851c-a4fd15237bd3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:45:07,191::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:45:07,192::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:45:07,192::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d9dbd129-2ed6-4de4-851c-a4fd15237bd3`::Granted request >Thread-34::DEBUG::2014-07-24 11:45:07,192::task::827::TaskManager.Task::(resourceAcquired) Task=`287bf960-e9ff-43ff-a31b-b45d94005652`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:45:07,192::task::990::TaskManager.Task::(_decref) Task=`287bf960-e9ff-43ff-a31b-b45d94005652`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:45:07,193::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:45:07,193::task::1185::TaskManager.Task::(prepare) Task=`287bf960-e9ff-43ff-a31b-b45d94005652`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:45:07,193::task::595::TaskManager.Task::(_updateState) Task=`287bf960-e9ff-43ff-a31b-b45d94005652`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:45:07,194::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:45:07,194::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:45:07,194::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:45:07,194::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:45:07,194::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:45:07,195::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:45:07,195::task::990::TaskManager.Task::(_decref) Task=`287bf960-e9ff-43ff-a31b-b45d94005652`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:45:07,729::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:45:07,807::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351283 s, 29.2 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:45:08,081::task::595::TaskManager.Task::(_updateState) Task=`4ac4491b-d8bf-4b1c-b32a-c599258f8fbe`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:45:08,081::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:45:08,081::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-37::DEBUG::2014-07-24 11:45:08,081::task::1185::TaskManager.Task::(prepare) Task=`4ac4491b-d8bf-4b1c-b32a-c599258f8fbe`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-37::DEBUG::2014-07-24 11:45:08,082::task::595::TaskManager.Task::(_updateState) Task=`4ac4491b-d8bf-4b1c-b32a-c599258f8fbe`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:45:08,082::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:45:08,082::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:45:08,082::task::990::TaskManager.Task::(_decref) Task=`4ac4491b-d8bf-4b1c-b32a-c599258f8fbe`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:45:09,819::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:45:09,895::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334964 s, 30.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:45:10,499::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:45:10,510::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000717868 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:45:11,910::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:45:12,048::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0938767 s, 10.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:45:14,060::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:45:14,136::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329359 s, 31.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:45:16,059::task::595::TaskManager.Task::(_updateState) Task=`665add23-7645-488d-96ab-d9089a0ec8d1`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:45:16,060::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:45:16,060::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000717868', 'lastCheck': '5.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:45:16,060::task::1185::TaskManager.Task::(prepare) Task=`665add23-7645-488d-96ab-d9089a0ec8d1`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000717868', 'lastCheck': '5.5', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:45:16,060::task::595::TaskManager.Task::(_updateState) Task=`665add23-7645-488d-96ab-d9089a0ec8d1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:45:16,060::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:45:16,061::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:45:16,061::task::990::TaskManager.Task::(_decref) Task=`665add23-7645-488d-96ab-d9089a0ec8d1`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:45:16,149::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:45:16,233::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0413431 s, 24.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:45:17,260::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:45:17,260::task::595::TaskManager.Task::(_updateState) Task=`adebb557-7673-42f7-9f3e-cf32c885e724`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:45:17,260::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:45:17,261::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:45:17,261::task::1185::TaskManager.Task::(prepare) Task=`adebb557-7673-42f7-9f3e-cf32c885e724`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:45:17,261::task::595::TaskManager.Task::(_updateState) Task=`adebb557-7673-42f7-9f3e-cf32c885e724`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:45:17,261::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:45:17,261::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:45:17,262::task::990::TaskManager.Task::(_decref) Task=`adebb557-7673-42f7-9f3e-cf32c885e724`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:45:17,295::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:45:17,295::task::595::TaskManager.Task::(_updateState) Task=`ac8eb3f9-0325-424c-8495-e58bdf018609`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:45:17,295::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:45:17,296::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`57b3764b-c201-472e-ba33-db924e74ee2b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:45:17,296::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:45:17,296::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:45:17,296::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`57b3764b-c201-472e-ba33-db924e74ee2b`::Granted request >Thread-34::DEBUG::2014-07-24 11:45:17,296::task::827::TaskManager.Task::(resourceAcquired) Task=`ac8eb3f9-0325-424c-8495-e58bdf018609`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:45:17,297::task::990::TaskManager.Task::(_decref) Task=`ac8eb3f9-0325-424c-8495-e58bdf018609`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:45:17,297::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:45:17,298::task::1185::TaskManager.Task::(prepare) Task=`ac8eb3f9-0325-424c-8495-e58bdf018609`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:45:17,298::task::595::TaskManager.Task::(_updateState) Task=`ac8eb3f9-0325-424c-8495-e58bdf018609`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:45:17,298::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:45:17,298::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:45:17,298::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:45:17,298::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:45:17,299::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:45:17,299::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:45:17,299::task::990::TaskManager.Task::(_decref) Task=`ac8eb3f9-0325-424c-8495-e58bdf018609`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:45:18,245::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:45:18,322::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354405 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:45:20,335::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:45:20,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343873 s, 29.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:45:20,515::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:45:20,527::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000717319 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:45:22,426::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:45:22,502::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03361 s, 30.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:45:24,515::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:45:24,592::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339941 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:45:26,604::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:45:26,681::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353092 s, 29.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:45:27,351::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:45:27,352::task::595::TaskManager.Task::(_updateState) Task=`ede4c569-6001-4463-b243-d39e46cb3c27`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:45:27,352::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:45:27,352::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:45:27,353::task::1185::TaskManager.Task::(prepare) Task=`ede4c569-6001-4463-b243-d39e46cb3c27`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:45:27,353::task::595::TaskManager.Task::(_updateState) Task=`ede4c569-6001-4463-b243-d39e46cb3c27`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:45:27,353::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:45:27,353::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:45:27,353::task::990::TaskManager.Task::(_decref) Task=`ede4c569-6001-4463-b243-d39e46cb3c27`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:45:27,383::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:45:27,383::task::595::TaskManager.Task::(_updateState) Task=`3d2a83ee-5042-43c5-a949-5960dc5ce4dd`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:45:27,384::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:45:27,384::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`fdf30c05-fb8c-4293-a4bd-dc0180015240`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:45:27,384::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:45:27,384::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:45:27,385::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`fdf30c05-fb8c-4293-a4bd-dc0180015240`::Granted request >Thread-34::DEBUG::2014-07-24 11:45:27,385::task::827::TaskManager.Task::(resourceAcquired) Task=`3d2a83ee-5042-43c5-a949-5960dc5ce4dd`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:45:27,385::task::990::TaskManager.Task::(_decref) Task=`3d2a83ee-5042-43c5-a949-5960dc5ce4dd`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:45:27,386::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:45:27,386::task::1185::TaskManager.Task::(prepare) Task=`3d2a83ee-5042-43c5-a949-5960dc5ce4dd`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:45:27,386::task::595::TaskManager.Task::(_updateState) Task=`3d2a83ee-5042-43c5-a949-5960dc5ce4dd`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:45:27,386::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:45:27,387::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:45:27,387::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:45:27,387::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:45:27,387::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:45:27,387::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:45:27,388::task::990::TaskManager.Task::(_decref) Task=`3d2a83ee-5042-43c5-a949-5960dc5ce4dd`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:45:28,694::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:45:28,772::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350296 s, 29.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:45:30,532::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:45:30,544::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000720733 s, 5.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:45:30,784::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:45:30,859::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333105 s, 30.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:45:31,393::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-14::DEBUG::2014-07-24 11:45:31,419::task::595::TaskManager.Task::(_updateState) Task=`ad983367-79cc-4b42-8baf-d33fd3deb54d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:45:31,419::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:45:31,419::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000720733', 'lastCheck': '0.9', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:45:31,420::task::1185::TaskManager.Task::(prepare) Task=`ad983367-79cc-4b42-8baf-d33fd3deb54d`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000720733', 'lastCheck': '0.9', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:45:31,420::task::595::TaskManager.Task::(_updateState) Task=`ad983367-79cc-4b42-8baf-d33fd3deb54d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:45:31,420::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:45:31,420::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:45:31,420::task::990::TaskManager.Task::(_decref) Task=`ad983367-79cc-4b42-8baf-d33fd3deb54d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:45:32,871::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:45:32,951::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367217 s, 27.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:45:34,963::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:45:35,041::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357319 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:45:37,053::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:45:37,133::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370011 s, 27.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:45:37,443::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:45:37,443::task::595::TaskManager.Task::(_updateState) Task=`f8ec62e3-f3ee-4d18-a031-bdaf1f626beb`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:45:37,444::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:45:37,444::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:45:37,444::task::1185::TaskManager.Task::(prepare) Task=`f8ec62e3-f3ee-4d18-a031-bdaf1f626beb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:45:37,444::task::595::TaskManager.Task::(_updateState) Task=`f8ec62e3-f3ee-4d18-a031-bdaf1f626beb`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:45:37,445::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:45:37,445::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:45:37,445::task::990::TaskManager.Task::(_decref) Task=`f8ec62e3-f3ee-4d18-a031-bdaf1f626beb`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:45:37,483::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:45:37,483::task::595::TaskManager.Task::(_updateState) Task=`42f6d4b5-5933-496f-9dbd-255ea858b0a3`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:45:37,483::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:45:37,484::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`a9f9bdb2-53d0-42bc-8b19-69eff41bde99`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:45:37,484::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:45:37,484::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:45:37,484::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`a9f9bdb2-53d0-42bc-8b19-69eff41bde99`::Granted request >Thread-34::DEBUG::2014-07-24 11:45:37,485::task::827::TaskManager.Task::(resourceAcquired) Task=`42f6d4b5-5933-496f-9dbd-255ea858b0a3`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:45:37,485::task::990::TaskManager.Task::(_decref) Task=`42f6d4b5-5933-496f-9dbd-255ea858b0a3`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:45:37,486::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:45:37,486::task::1185::TaskManager.Task::(prepare) Task=`42f6d4b5-5933-496f-9dbd-255ea858b0a3`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:45:37,486::task::595::TaskManager.Task::(_updateState) Task=`42f6d4b5-5933-496f-9dbd-255ea858b0a3`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:45:37,486::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:45:37,486::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:45:37,486::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:45:37,487::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:45:37,487::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:45:37,487::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:45:37,487::task::990::TaskManager.Task::(_decref) Task=`42f6d4b5-5933-496f-9dbd-255ea858b0a3`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:45:39,145::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:45:39,222::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353989 s, 28.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:45:40,549::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:45:40,570::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0102571 s, 399 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:45:41,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:45:41,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340339 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:45:43,325::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:45:43,402::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359366 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:45:45,416::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:45:45,494::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036066 s, 28.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:45:46,796::task::595::TaskManager.Task::(_updateState) Task=`92b62029-864e-4b83-8c61-b9f7964265b5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:45:46,796::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:45:46,797::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0102571', 'lastCheck': '6.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:45:46,797::task::1185::TaskManager.Task::(prepare) Task=`92b62029-864e-4b83-8c61-b9f7964265b5`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0102571', 'lastCheck': '6.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:45:46,797::task::595::TaskManager.Task::(_updateState) Task=`92b62029-864e-4b83-8c61-b9f7964265b5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:45:46,797::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:45:46,797::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:45:46,797::task::990::TaskManager.Task::(_decref) Task=`92b62029-864e-4b83-8c61-b9f7964265b5`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:45:47,506::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-24 11:45:47,554::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:45:47,556::task::595::TaskManager.Task::(_updateState) Task=`1b419d83-819c-4a1c-ac4d-300927fc305b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:45:47,557::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:45:47,558::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:45:47,559::task::1185::TaskManager.Task::(prepare) Task=`1b419d83-819c-4a1c-ac4d-300927fc305b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:45:47,559::task::595::TaskManager.Task::(_updateState) Task=`1b419d83-819c-4a1c-ac4d-300927fc305b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:45:47,560::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:45:47,561::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:45:47,562::task::990::TaskManager.Task::(_decref) Task=`1b419d83-819c-4a1c-ac4d-300927fc305b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:45:47,598::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0490177 s, 20.9 MB/s\n'; <rc> = 0 >Thread-34::DEBUG::2014-07-24 11:45:47,613::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:45:47,613::task::595::TaskManager.Task::(_updateState) Task=`cbaf5b01-b6d3-4dd0-923f-279de2ce5efd`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:45:47,614::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:45:47,614::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4018fe00-53aa-4fa9-b66c-060b41e2bd25`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:45:47,614::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:45:47,614::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:45:47,615::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4018fe00-53aa-4fa9-b66c-060b41e2bd25`::Granted request >Thread-34::DEBUG::2014-07-24 11:45:47,615::task::827::TaskManager.Task::(resourceAcquired) Task=`cbaf5b01-b6d3-4dd0-923f-279de2ce5efd`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:45:47,615::task::990::TaskManager.Task::(_decref) Task=`cbaf5b01-b6d3-4dd0-923f-279de2ce5efd`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:45:47,616::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:45:47,616::task::1185::TaskManager.Task::(prepare) Task=`cbaf5b01-b6d3-4dd0-923f-279de2ce5efd`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:45:47,616::task::595::TaskManager.Task::(_updateState) Task=`cbaf5b01-b6d3-4dd0-923f-279de2ce5efd`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:45:47,616::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:45:47,616::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:45:47,617::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:45:47,617::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:45:47,617::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:45:47,617::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:45:47,617::task::990::TaskManager.Task::(_decref) Task=`cbaf5b01-b6d3-4dd0-923f-279de2ce5efd`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:45:49,611::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:45:49,687::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339085 s, 30.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:45:50,574::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:45:50,586::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000751443 s, 5.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:45:51,700::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:45:51,778::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361396 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:45:53,790::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:45:53,871::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369804 s, 27.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:45:55,884::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:45:55,959::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341473 s, 30.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:45:57,678::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:45:57,679::task::595::TaskManager.Task::(_updateState) Task=`ab0a674a-9e60-4dcb-a5a2-d884eb77fca4`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:45:57,679::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:45:57,679::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:45:57,679::task::1185::TaskManager.Task::(prepare) Task=`ab0a674a-9e60-4dcb-a5a2-d884eb77fca4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:45:57,679::task::595::TaskManager.Task::(_updateState) Task=`ab0a674a-9e60-4dcb-a5a2-d884eb77fca4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:45:57,680::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:45:57,680::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:45:57,680::task::990::TaskManager.Task::(_decref) Task=`ab0a674a-9e60-4dcb-a5a2-d884eb77fca4`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:45:57,717::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:45:57,717::task::595::TaskManager.Task::(_updateState) Task=`3e72f188-bde0-4602-95a1-c1f68dbc8592`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:45:57,717::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:45:57,718::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`303b49f4-d2d2-4ae7-9950-900586152129`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:45:57,718::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:45:57,718::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:45:57,718::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`303b49f4-d2d2-4ae7-9950-900586152129`::Granted request >Thread-34::DEBUG::2014-07-24 11:45:57,719::task::827::TaskManager.Task::(resourceAcquired) Task=`3e72f188-bde0-4602-95a1-c1f68dbc8592`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:45:57,719::task::990::TaskManager.Task::(_decref) Task=`3e72f188-bde0-4602-95a1-c1f68dbc8592`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:45:57,720::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:45:57,720::task::1185::TaskManager.Task::(prepare) Task=`3e72f188-bde0-4602-95a1-c1f68dbc8592`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:45:57,720::task::595::TaskManager.Task::(_updateState) Task=`3e72f188-bde0-4602-95a1-c1f68dbc8592`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:45:57,720::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:45:57,720::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:45:57,721::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:45:57,721::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:45:57,721::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:45:57,721::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:45:57,721::task::990::TaskManager.Task::(_decref) Task=`3e72f188-bde0-4602-95a1-c1f68dbc8592`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:45:57,973::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:45:58,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362386 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:46:00,064::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:46:00,141::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361247 s, 28.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:46:00,596::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:46:00,608::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000703142 s, 5.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:46:01,428::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:46:02,154::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-14::DEBUG::2014-07-24 11:46:02,164::task::595::TaskManager.Task::(_updateState) Task=`79e0644c-67f4-4fa7-9ca0-18a084552998`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:46:02,165::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:46:02,165::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000703142', 'lastCheck': '1.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:46:02,165::task::1185::TaskManager.Task::(prepare) Task=`79e0644c-67f4-4fa7-9ca0-18a084552998`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000703142', 'lastCheck': '1.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:46:02,165::task::595::TaskManager.Task::(_updateState) Task=`79e0644c-67f4-4fa7-9ca0-18a084552998`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:46:02,165::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:46:02,166::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:46:02,166::task::990::TaskManager.Task::(_decref) Task=`79e0644c-67f4-4fa7-9ca0-18a084552998`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:46:02,234::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348106 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:46:04,246::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:46:04,323::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351427 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:46:06,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:46:06,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342145 s, 29.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:46:07,778::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:46:07,779::task::595::TaskManager.Task::(_updateState) Task=`ce5138cc-198b-4117-8642-1830e774effc`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:46:07,779::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:46:07,779::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:46:07,779::task::1185::TaskManager.Task::(prepare) Task=`ce5138cc-198b-4117-8642-1830e774effc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:46:07,780::task::595::TaskManager.Task::(_updateState) Task=`ce5138cc-198b-4117-8642-1830e774effc`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:46:07,780::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:46:07,780::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:46:07,780::task::990::TaskManager.Task::(_decref) Task=`ce5138cc-198b-4117-8642-1830e774effc`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:46:07,822::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:46:07,822::task::595::TaskManager.Task::(_updateState) Task=`4c7472fa-c68c-453c-a788-1652eeb355bf`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:46:07,823::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:46:07,823::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d4acbb28-9d01-498c-9467-cbb5e07bea5c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:46:07,823::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:46:07,823::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:46:07,824::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`d4acbb28-9d01-498c-9467-cbb5e07bea5c`::Granted request >Thread-34::DEBUG::2014-07-24 11:46:07,824::task::827::TaskManager.Task::(resourceAcquired) Task=`4c7472fa-c68c-453c-a788-1652eeb355bf`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:46:07,824::task::990::TaskManager.Task::(_decref) Task=`4c7472fa-c68c-453c-a788-1652eeb355bf`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:46:07,825::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:46:07,825::task::1185::TaskManager.Task::(prepare) Task=`4c7472fa-c68c-453c-a788-1652eeb355bf`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:46:07,825::task::595::TaskManager.Task::(_updateState) Task=`4c7472fa-c68c-453c-a788-1652eeb355bf`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:46:07,825::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:46:07,825::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:46:07,826::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:46:07,826::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:46:07,826::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:46:07,826::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:46:07,826::task::990::TaskManager.Task::(_decref) Task=`4c7472fa-c68c-453c-a788-1652eeb355bf`::ref 0 aborting False >Thread-37::DEBUG::2014-07-24 11:46:08,223::task::595::TaskManager.Task::(_updateState) Task=`b9cd2000-7f47-4586-b3f1-a03d854f50ee`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:46:08,224::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:46:08,224::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-37::DEBUG::2014-07-24 11:46:08,224::task::1185::TaskManager.Task::(prepare) Task=`b9cd2000-7f47-4586-b3f1-a03d854f50ee`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-37::DEBUG::2014-07-24 11:46:08,224::task::595::TaskManager.Task::(_updateState) Task=`b9cd2000-7f47-4586-b3f1-a03d854f50ee`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:46:08,224::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:46:08,224::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:46:08,225::task::990::TaskManager.Task::(_decref) Task=`b9cd2000-7f47-4586-b3f1-a03d854f50ee`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:46:08,425::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:46:08,501::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345247 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:46:10,513::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:46:10,593::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349359 s, 29.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:46:10,612::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:46:10,625::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000641887 s, 6.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:46:12,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:46:12,682::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338426 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:46:14,695::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:46:14,771::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344347 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:46:16,784::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:46:16,858::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328936 s, 31.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:46:17,869::task::595::TaskManager.Task::(_updateState) Task=`aeea73dd-f81b-4cc7-a760-a83bab2e7931`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:46:17,870::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:46:17,870::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000641887', 'lastCheck': '7.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:46:17,870::task::1185::TaskManager.Task::(prepare) Task=`aeea73dd-f81b-4cc7-a760-a83bab2e7931`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000641887', 'lastCheck': '7.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:46:17,870::task::595::TaskManager.Task::(_updateState) Task=`aeea73dd-f81b-4cc7-a760-a83bab2e7931`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:46:17,870::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:46:17,870::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:46:17,871::task::990::TaskManager.Task::(_decref) Task=`aeea73dd-f81b-4cc7-a760-a83bab2e7931`::ref 0 aborting False >Thread-13::DEBUG::2014-07-24 11:46:17,998::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [1487b3f5] >Thread-13::DEBUG::2014-07-24 11:46:17,999::task::595::TaskManager.Task::(_updateState) Task=`94d101b5-e5b8-492e-9659-31e30d33e0ba`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:46:17,999::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:46:17,999::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:46:17,999::task::1185::TaskManager.Task::(prepare) Task=`94d101b5-e5b8-492e-9659-31e30d33e0ba`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:46:18,000::task::595::TaskManager.Task::(_updateState) Task=`94d101b5-e5b8-492e-9659-31e30d33e0ba`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:46:18,000::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:46:18,000::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:46:18,000::task::990::TaskManager.Task::(_decref) Task=`94d101b5-e5b8-492e-9659-31e30d33e0ba`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:46:18,056::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [1487b3f5] >Thread-34::DEBUG::2014-07-24 11:46:18,056::task::595::TaskManager.Task::(_updateState) Task=`6bfb0f69-1da5-4158-b66c-b1ca07dd366a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:46:18,056::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:46:18,057::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1989c84e-96f4-4f19-a820-72bfe8d85b49`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:46:18,057::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:46:18,057::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:46:18,057::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1989c84e-96f4-4f19-a820-72bfe8d85b49`::Granted request >Thread-34::DEBUG::2014-07-24 11:46:18,058::task::827::TaskManager.Task::(resourceAcquired) Task=`6bfb0f69-1da5-4158-b66c-b1ca07dd366a`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:46:18,058::task::990::TaskManager.Task::(_decref) Task=`6bfb0f69-1da5-4158-b66c-b1ca07dd366a`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:46:18,058::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:46:18,059::task::1185::TaskManager.Task::(prepare) Task=`6bfb0f69-1da5-4158-b66c-b1ca07dd366a`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:46:18,059::task::595::TaskManager.Task::(_updateState) Task=`6bfb0f69-1da5-4158-b66c-b1ca07dd366a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:46:18,059::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:46:18,059::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:46:18,059::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:46:18,060::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:46:18,060::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:46:18,060::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:46:18,060::task::990::TaskManager.Task::(_decref) Task=`6bfb0f69-1da5-4158-b66c-b1ca07dd366a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:46:18,871::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:46:18,963::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349459 s, 29.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:46:20,629::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 23aa0606-edc3-4882-a4aa-18aa1983458f >Thread-18::DEBUG::2014-07-24 11:46:20,630::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-18::DEBUG::2014-07-24 11:46:20,630::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:46:20,642::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.000613397 s, 3.3 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:46:20,642::misc::264::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.000613397 s, 3.3 MB/s'], size: 2048 >Thread-18::DEBUG::2014-07-24 11:46:20,642::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-18::WARNING::2014-07-24 11:46:20,642::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-18::DEBUG::2014-07-24 11:46:20,643::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-18::DEBUG::2014-07-24 11:46:20,643::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 11:46:20,643::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 11:46:20,643::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 11:46:20,644::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 11:46:20,644::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 11:46:20,645::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-18::DEBUG::2014-07-24 11:46:20,853::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:46:20,855::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 11:46:20,855::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'LOCKPOLICY=', 'POOL_DOMAINS=23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'POOL_DESCRIPTION=DS1', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_UUID=637ea13c-81a8-4b44-8cab-961458b01883', 'POOL_SPM_ID=1', '_SHA_CKSUM=a749afdc7119a2d6aad840af5c63c9b28c0b612c', 'POOL_SPM_LVER=0'] >Thread-18::INFO::2014-07-24 11:46:20,856::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_imageNS already registered >Thread-18::INFO::2014-07-24 11:46:20,856::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_volumeNS already registered >Thread-18::INFO::2014-07-24 11:46:20,856::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_lvmActivationNS already registered >Thread-18::DEBUG::2014-07-24 11:46:20,857::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:46:20,975::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-24 11:46:21,016::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:46:21,020::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:46:21,038::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000646751 s, 6.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:46:21,104::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0848924 s, 12.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:46:23,116::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:46:23,195::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350741 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:46:25,207::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:46:25,284::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357958 s, 28.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:46:27,297::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:46:27,375::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035292 s, 29.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:46:28,159::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:46:28,160::task::595::TaskManager.Task::(_updateState) Task=`ad06e071-d2e8-4d42-86bc-3dc882c7c16b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:46:28,160::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:46:28,161::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:46:28,161::task::1185::TaskManager.Task::(prepare) Task=`ad06e071-d2e8-4d42-86bc-3dc882c7c16b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:46:28,161::task::595::TaskManager.Task::(_updateState) Task=`ad06e071-d2e8-4d42-86bc-3dc882c7c16b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:46:28,161::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:46:28,161::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:46:28,161::task::990::TaskManager.Task::(_decref) Task=`ad06e071-d2e8-4d42-86bc-3dc882c7c16b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:46:28,194::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:46:28,194::task::595::TaskManager.Task::(_updateState) Task=`1db28678-657f-4acc-8dba-c763ad5f5992`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:46:28,194::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:46:28,195::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`60f4db1c-64eb-46be-9d99-fa3f1582ace3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:46:28,195::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:46:28,195::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:46:28,195::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`60f4db1c-64eb-46be-9d99-fa3f1582ace3`::Granted request >Thread-34::DEBUG::2014-07-24 11:46:28,196::task::827::TaskManager.Task::(resourceAcquired) Task=`1db28678-657f-4acc-8dba-c763ad5f5992`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:46:28,196::task::990::TaskManager.Task::(_decref) Task=`1db28678-657f-4acc-8dba-c763ad5f5992`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:46:28,197::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:46:28,197::task::1185::TaskManager.Task::(prepare) Task=`1db28678-657f-4acc-8dba-c763ad5f5992`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:46:28,197::task::595::TaskManager.Task::(_updateState) Task=`1db28678-657f-4acc-8dba-c763ad5f5992`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:46:28,197::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:46:28,197::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:46:28,198::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:46:28,198::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:46:28,198::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:46:28,198::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:46:28,198::task::990::TaskManager.Task::(_decref) Task=`1db28678-657f-4acc-8dba-c763ad5f5992`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:46:29,387::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:46:29,466::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363176 s, 28.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:46:31,065::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:46:31,086::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0101772 s, 402 kB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:46:31,465::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:46:31,478::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:46:31,560::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340939 s, 30.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:46:33,481::task::595::TaskManager.Task::(_updateState) Task=`e5e30a31-02f5-4460-991e-49d037005ff8`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:46:33,482::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:46:33,482::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0101772', 'lastCheck': '2.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:46:33,482::task::1185::TaskManager.Task::(prepare) Task=`e5e30a31-02f5-4460-991e-49d037005ff8`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0101772', 'lastCheck': '2.4', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:46:33,482::task::595::TaskManager.Task::(_updateState) Task=`e5e30a31-02f5-4460-991e-49d037005ff8`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:46:33,482::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:46:33,482::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:46:33,483::task::990::TaskManager.Task::(_decref) Task=`e5e30a31-02f5-4460-991e-49d037005ff8`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:46:33,573::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:46:33,657::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0418586 s, 24.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:46:35,670::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:46:35,760::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0481402 s, 21.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:46:37,772::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:46:37,849::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354408 s, 28.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:46:38,258::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:46:38,258::task::595::TaskManager.Task::(_updateState) Task=`a7905950-3ddb-4afa-8edc-22eb344e9b56`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:46:38,259::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:46:38,259::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:46:38,259::task::1185::TaskManager.Task::(prepare) Task=`a7905950-3ddb-4afa-8edc-22eb344e9b56`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:46:38,259::task::595::TaskManager.Task::(_updateState) Task=`a7905950-3ddb-4afa-8edc-22eb344e9b56`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:46:38,260::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:46:38,260::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:46:38,260::task::990::TaskManager.Task::(_decref) Task=`a7905950-3ddb-4afa-8edc-22eb344e9b56`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:46:38,294::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:46:38,295::task::595::TaskManager.Task::(_updateState) Task=`85aede0b-a257-4b56-91d9-5906b69387cf`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:46:38,295::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:46:38,295::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b223bad8-2f98-4b70-b26a-5e92b62deb97`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:46:38,295::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:46:38,296::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:46:38,296::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b223bad8-2f98-4b70-b26a-5e92b62deb97`::Granted request >Thread-34::DEBUG::2014-07-24 11:46:38,296::task::827::TaskManager.Task::(resourceAcquired) Task=`85aede0b-a257-4b56-91d9-5906b69387cf`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:46:38,296::task::990::TaskManager.Task::(_decref) Task=`85aede0b-a257-4b56-91d9-5906b69387cf`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:46:38,297::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:46:38,297::task::1185::TaskManager.Task::(prepare) Task=`85aede0b-a257-4b56-91d9-5906b69387cf`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:46:38,297::task::595::TaskManager.Task::(_updateState) Task=`85aede0b-a257-4b56-91d9-5906b69387cf`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:46:38,298::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:46:38,298::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:46:38,298::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:46:38,298::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:46:38,298::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:46:38,299::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:46:38,299::task::990::TaskManager.Task::(_decref) Task=`85aede0b-a257-4b56-91d9-5906b69387cf`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:46:39,862::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:46:39,945::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347947 s, 29.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:46:41,091::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:46:41,120::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0170888 s, 240 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:46:41,958::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:46:42,034::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033601 s, 30.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:46:44,046::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:46:44,122::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338887 s, 30.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:46:46,135::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:46:46,211::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352663 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:46:48,224::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:46:48,345::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0763135 s, 13.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:46:48,360::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:46:48,361::task::595::TaskManager.Task::(_updateState) Task=`15385852-ec95-4c5f-8960-19fbbb434276`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:46:48,361::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:46:48,362::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:46:48,362::task::1185::TaskManager.Task::(prepare) Task=`15385852-ec95-4c5f-8960-19fbbb434276`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:46:48,362::task::595::TaskManager.Task::(_updateState) Task=`15385852-ec95-4c5f-8960-19fbbb434276`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:46:48,362::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:46:48,362::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:46:48,362::task::990::TaskManager.Task::(_decref) Task=`15385852-ec95-4c5f-8960-19fbbb434276`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:46:48,397::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:46:48,398::task::595::TaskManager.Task::(_updateState) Task=`4c80fe0c-4b6b-4db2-b595-80ddc0a0225a`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:46:48,398::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:46:48,398::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e5b49bb3-e0b1-432e-ba60-179adccae1fe`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:46:48,398::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:46:48,399::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:46:48,399::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e5b49bb3-e0b1-432e-ba60-179adccae1fe`::Granted request >Thread-34::DEBUG::2014-07-24 11:46:48,399::task::827::TaskManager.Task::(resourceAcquired) Task=`4c80fe0c-4b6b-4db2-b595-80ddc0a0225a`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:46:48,399::task::990::TaskManager.Task::(_decref) Task=`4c80fe0c-4b6b-4db2-b595-80ddc0a0225a`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:46:48,400::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:46:48,400::task::1185::TaskManager.Task::(prepare) Task=`4c80fe0c-4b6b-4db2-b595-80ddc0a0225a`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:46:48,400::task::595::TaskManager.Task::(_updateState) Task=`4c80fe0c-4b6b-4db2-b595-80ddc0a0225a`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:46:48,400::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:46:48,401::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:46:48,401::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:46:48,401::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:46:48,401::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:46:48,401::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:46:48,402::task::990::TaskManager.Task::(_decref) Task=`4c80fe0c-4b6b-4db2-b595-80ddc0a0225a`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 11:46:48,888::task::595::TaskManager.Task::(_updateState) Task=`2b397356-847c-4a3d-85d3-0ed4c6329f01`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:46:48,888::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:46:48,889::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0170888', 'lastCheck': '7.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:46:48,889::task::1185::TaskManager.Task::(prepare) Task=`2b397356-847c-4a3d-85d3-0ed4c6329f01`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0170888', 'lastCheck': '7.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:46:48,889::task::595::TaskManager.Task::(_updateState) Task=`2b397356-847c-4a3d-85d3-0ed4c6329f01`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:46:48,889::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:46:48,889::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:46:48,889::task::990::TaskManager.Task::(_decref) Task=`2b397356-847c-4a3d-85d3-0ed4c6329f01`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:46:50,357::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:46:50,471::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0704413 s, 14.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:46:51,124::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:46:51,153::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.017755 s, 231 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:46:52,483::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:46:52,561::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344147 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:46:54,573::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:46:54,650::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358889 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:46:56,664::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:46:56,739::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0328137 s, 31.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:46:58,458::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:46:58,458::task::595::TaskManager.Task::(_updateState) Task=`45736540-252c-482f-8253-8474104b6c51`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:46:58,458::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:46:58,459::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:46:58,459::task::1185::TaskManager.Task::(prepare) Task=`45736540-252c-482f-8253-8474104b6c51`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:46:58,459::task::595::TaskManager.Task::(_updateState) Task=`45736540-252c-482f-8253-8474104b6c51`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:46:58,459::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:46:58,459::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:46:58,460::task::990::TaskManager.Task::(_decref) Task=`45736540-252c-482f-8253-8474104b6c51`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:46:58,493::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:46:58,494::task::595::TaskManager.Task::(_updateState) Task=`5cb254e5-f451-470f-b7d6-305550fb92e0`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:46:58,494::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:46:58,494::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b518c5cf-e87d-427a-83c7-31d57ff236a3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:46:58,494::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:46:58,495::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:46:58,495::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b518c5cf-e87d-427a-83c7-31d57ff236a3`::Granted request >Thread-34::DEBUG::2014-07-24 11:46:58,495::task::827::TaskManager.Task::(resourceAcquired) Task=`5cb254e5-f451-470f-b7d6-305550fb92e0`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:46:58,495::task::990::TaskManager.Task::(_decref) Task=`5cb254e5-f451-470f-b7d6-305550fb92e0`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:46:58,496::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:46:58,496::task::1185::TaskManager.Task::(prepare) Task=`5cb254e5-f451-470f-b7d6-305550fb92e0`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:46:58,496::task::595::TaskManager.Task::(_updateState) Task=`5cb254e5-f451-470f-b7d6-305550fb92e0`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:46:58,496::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:46:58,497::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:46:58,497::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:46:58,497::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:46:58,497::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:46:58,497::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:46:58,498::task::990::TaskManager.Task::(_decref) Task=`5cb254e5-f451-470f-b7d6-305550fb92e0`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:46:58,751::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:46:58,827::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350595 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:47:00,840::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:47:00,916::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339496 s, 30.2 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:47:01,158::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:47:01,171::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000722387 s, 5.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:47:01,505::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:47:02,928::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:47:03,002::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329863 s, 31.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:47:04,400::task::595::TaskManager.Task::(_updateState) Task=`c872fb4d-b00c-4bbd-8568-800b8b2231b5`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:47:04,400::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:47:04,401::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000722387', 'lastCheck': '3.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:47:04,401::task::1185::TaskManager.Task::(prepare) Task=`c872fb4d-b00c-4bbd-8568-800b8b2231b5`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000722387', 'lastCheck': '3.2', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:47:04,401::task::595::TaskManager.Task::(_updateState) Task=`c872fb4d-b00c-4bbd-8568-800b8b2231b5`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:47:04,401::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:47:04,401::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:47:04,401::task::990::TaskManager.Task::(_decref) Task=`c872fb4d-b00c-4bbd-8568-800b8b2231b5`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:47:05,015::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:47:05,105::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334284 s, 30.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:47:07,117::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:47:07,195::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362889 s, 28.2 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:47:08,378::task::595::TaskManager.Task::(_updateState) Task=`d446833a-220c-4b83-ba25-44f553c368fe`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:47:08,378::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:47:08,379::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-37::DEBUG::2014-07-24 11:47:08,379::task::1185::TaskManager.Task::(prepare) Task=`d446833a-220c-4b83-ba25-44f553c368fe`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-37::DEBUG::2014-07-24 11:47:08,379::task::595::TaskManager.Task::(_updateState) Task=`d446833a-220c-4b83-ba25-44f553c368fe`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:47:08,379::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:47:08,379::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:47:08,380::task::990::TaskManager.Task::(_decref) Task=`d446833a-220c-4b83-ba25-44f553c368fe`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 11:47:08,557::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:47:08,557::task::595::TaskManager.Task::(_updateState) Task=`b5843315-61fa-459b-a263-5f2a6922e0c6`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:47:08,557::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:47:08,558::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:47:08,558::task::1185::TaskManager.Task::(prepare) Task=`b5843315-61fa-459b-a263-5f2a6922e0c6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:47:08,558::task::595::TaskManager.Task::(_updateState) Task=`b5843315-61fa-459b-a263-5f2a6922e0c6`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:47:08,558::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:47:08,558::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:47:08,559::task::990::TaskManager.Task::(_decref) Task=`b5843315-61fa-459b-a263-5f2a6922e0c6`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:47:08,627::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:47:08,627::task::595::TaskManager.Task::(_updateState) Task=`504166b9-9edb-44dc-b360-7708f57929da`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:47:08,627::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:47:08,628::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`6feb8728-207d-4df3-93c7-3a62c90de1e8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:47:08,628::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:47:08,628::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:47:08,628::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`6feb8728-207d-4df3-93c7-3a62c90de1e8`::Granted request >Thread-34::DEBUG::2014-07-24 11:47:08,628::task::827::TaskManager.Task::(resourceAcquired) Task=`504166b9-9edb-44dc-b360-7708f57929da`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:47:08,629::task::990::TaskManager.Task::(_decref) Task=`504166b9-9edb-44dc-b360-7708f57929da`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:47:08,629::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:47:08,629::task::1185::TaskManager.Task::(prepare) Task=`504166b9-9edb-44dc-b360-7708f57929da`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:47:08,630::task::595::TaskManager.Task::(_updateState) Task=`504166b9-9edb-44dc-b360-7708f57929da`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:47:08,630::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:47:08,630::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:47:08,630::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:47:08,630::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:47:08,631::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:47:08,631::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:47:08,631::task::990::TaskManager.Task::(_decref) Task=`504166b9-9edb-44dc-b360-7708f57929da`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:47:09,208::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:47:09,285::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347817 s, 29.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:47:11,175::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:47:11,188::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000702561 s, 5.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:47:11,297::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:47:11,372::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334408 s, 30.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:47:13,385::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:47:13,461::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342262 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:47:15,473::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:47:15,552::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035017 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:47:17,565::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:47:17,643::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348446 s, 29.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:47:18,690::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:47:18,690::task::595::TaskManager.Task::(_updateState) Task=`48b3a4fc-b45a-4ebe-81cb-3c8cc4e43f3f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:47:18,691::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:47:18,691::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:47:18,691::task::1185::TaskManager.Task::(prepare) Task=`48b3a4fc-b45a-4ebe-81cb-3c8cc4e43f3f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:47:18,691::task::595::TaskManager.Task::(_updateState) Task=`48b3a4fc-b45a-4ebe-81cb-3c8cc4e43f3f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:47:18,692::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:47:18,692::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:47:18,692::task::990::TaskManager.Task::(_decref) Task=`48b3a4fc-b45a-4ebe-81cb-3c8cc4e43f3f`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:47:18,725::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:47:18,726::task::595::TaskManager.Task::(_updateState) Task=`c2104226-7f2c-4883-ba9e-155f8be5dd5b`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:47:18,726::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:47:18,726::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e268159b-044d-47b4-a112-fb7d33dda2f9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:47:18,726::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:47:18,727::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:47:18,727::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e268159b-044d-47b4-a112-fb7d33dda2f9`::Granted request >Thread-34::DEBUG::2014-07-24 11:47:18,727::task::827::TaskManager.Task::(resourceAcquired) Task=`c2104226-7f2c-4883-ba9e-155f8be5dd5b`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:47:18,727::task::990::TaskManager.Task::(_decref) Task=`c2104226-7f2c-4883-ba9e-155f8be5dd5b`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:47:18,728::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:47:18,728::task::1185::TaskManager.Task::(prepare) Task=`c2104226-7f2c-4883-ba9e-155f8be5dd5b`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:47:18,728::task::595::TaskManager.Task::(_updateState) Task=`c2104226-7f2c-4883-ba9e-155f8be5dd5b`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:47:18,729::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:47:18,729::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:47:18,729::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:47:18,729::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:47:18,729::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:47:18,729::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:47:18,730::task::990::TaskManager.Task::(_decref) Task=`c2104226-7f2c-4883-ba9e-155f8be5dd5b`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:47:19,656::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:47:19,733::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346215 s, 29.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:47:19,766::task::595::TaskManager.Task::(_updateState) Task=`0a54e9e2-8edf-47c6-adec-abb0c69f55f4`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:47:19,767::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:47:19,767::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000702561', 'lastCheck': '8.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:47:19,767::task::1185::TaskManager.Task::(prepare) Task=`0a54e9e2-8edf-47c6-adec-abb0c69f55f4`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000702561', 'lastCheck': '8.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:47:19,767::task::595::TaskManager.Task::(_updateState) Task=`0a54e9e2-8edf-47c6-adec-abb0c69f55f4`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:47:19,767::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:47:19,768::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:47:19,768::task::990::TaskManager.Task::(_decref) Task=`0a54e9e2-8edf-47c6-adec-abb0c69f55f4`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:47:21,193::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:47:21,205::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000779148 s, 5.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:47:21,746::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:47:21,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335735 s, 30.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:47:23,834::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:47:23,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351864 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:47:25,926::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:47:26,007::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362035 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:47:28,019::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:47:28,099::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360281 s, 28.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:47:28,787::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:47:28,787::task::595::TaskManager.Task::(_updateState) Task=`bc961431-71c4-4962-956c-83c41e494f03`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:47:28,787::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:47:28,788::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:47:28,788::task::1185::TaskManager.Task::(prepare) Task=`bc961431-71c4-4962-956c-83c41e494f03`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:47:28,788::task::595::TaskManager.Task::(_updateState) Task=`bc961431-71c4-4962-956c-83c41e494f03`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:47:28,788::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:47:28,788::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:47:28,788::task::990::TaskManager.Task::(_decref) Task=`bc961431-71c4-4962-956c-83c41e494f03`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:47:28,820::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:47:28,820::task::595::TaskManager.Task::(_updateState) Task=`bf5c4084-1336-4989-8933-47dc92281fad`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:47:28,820::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:47:28,821::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`968de013-65df-4674-a5b2-04f7505ed754`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:47:28,821::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:47:28,821::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:47:28,821::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`968de013-65df-4674-a5b2-04f7505ed754`::Granted request >Thread-34::DEBUG::2014-07-24 11:47:28,822::task::827::TaskManager.Task::(resourceAcquired) Task=`bf5c4084-1336-4989-8933-47dc92281fad`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:47:28,822::task::990::TaskManager.Task::(_decref) Task=`bf5c4084-1336-4989-8933-47dc92281fad`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:47:28,823::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:47:28,823::task::1185::TaskManager.Task::(prepare) Task=`bf5c4084-1336-4989-8933-47dc92281fad`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:47:28,823::task::595::TaskManager.Task::(_updateState) Task=`bf5c4084-1336-4989-8933-47dc92281fad`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:47:28,823::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:47:28,823::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:47:28,823::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:47:28,824::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:47:28,824::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:47:28,824::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:47:28,824::task::990::TaskManager.Task::(_decref) Task=`bf5c4084-1336-4989-8933-47dc92281fad`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:47:30,113::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:47:30,488::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.331781 s, 3.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:47:31,210::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:47:31,222::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000626218 s, 6.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:47:31,542::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:47:32,500::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:47:32,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329106 s, 31.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:47:34,587::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:47:34,662::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329706 s, 31.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:47:35,129::task::595::TaskManager.Task::(_updateState) Task=`0bbf61e6-7762-4212-a5a0-c89561a90034`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:47:35,130::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:47:35,130::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000626218', 'lastCheck': '3.9', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:47:35,130::task::1185::TaskManager.Task::(prepare) Task=`0bbf61e6-7762-4212-a5a0-c89561a90034`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000626218', 'lastCheck': '3.9', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:47:35,130::task::595::TaskManager.Task::(_updateState) Task=`0bbf61e6-7762-4212-a5a0-c89561a90034`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:47:35,130::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:47:35,131::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:47:35,131::task::990::TaskManager.Task::(_decref) Task=`0bbf61e6-7762-4212-a5a0-c89561a90034`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:47:36,675::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:47:36,755::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0384632 s, 26.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:47:38,776::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:47:38,851::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333948 s, 30.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:47:38,883::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:47:38,883::task::595::TaskManager.Task::(_updateState) Task=`54ddf5a8-09c5-4023-9511-763d3b7b4abb`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:47:38,883::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:47:38,884::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:47:38,884::task::1185::TaskManager.Task::(prepare) Task=`54ddf5a8-09c5-4023-9511-763d3b7b4abb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:47:38,884::task::595::TaskManager.Task::(_updateState) Task=`54ddf5a8-09c5-4023-9511-763d3b7b4abb`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:47:38,884::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:47:38,884::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:47:38,885::task::990::TaskManager.Task::(_decref) Task=`54ddf5a8-09c5-4023-9511-763d3b7b4abb`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:47:38,921::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:47:38,921::task::595::TaskManager.Task::(_updateState) Task=`e5c18b08-c052-4e29-8539-50a165635de5`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:47:38,921::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:47:38,922::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`71a204c7-6a4b-406a-a243-65e5730da56e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:47:38,922::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:47:38,922::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:47:38,922::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`71a204c7-6a4b-406a-a243-65e5730da56e`::Granted request >Thread-34::DEBUG::2014-07-24 11:47:38,923::task::827::TaskManager.Task::(resourceAcquired) Task=`e5c18b08-c052-4e29-8539-50a165635de5`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:47:38,923::task::990::TaskManager.Task::(_decref) Task=`e5c18b08-c052-4e29-8539-50a165635de5`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:47:38,924::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:47:38,924::task::1185::TaskManager.Task::(prepare) Task=`e5c18b08-c052-4e29-8539-50a165635de5`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:47:38,924::task::595::TaskManager.Task::(_updateState) Task=`e5c18b08-c052-4e29-8539-50a165635de5`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:47:38,924::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:47:38,924::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:47:38,925::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:47:38,925::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:47:38,925::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:47:38,925::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:47:38,925::task::990::TaskManager.Task::(_decref) Task=`e5c18b08-c052-4e29-8539-50a165635de5`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:47:40,864::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:47:40,942::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354236 s, 28.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:47:41,226::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:47:41,238::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000662328 s, 6.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:47:42,955::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:47:43,032::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034488 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:47:45,044::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:47:45,121::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034663 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:47:47,133::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:47:47,209::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331675 s, 30.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:47:48,988::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:47:48,988::task::595::TaskManager.Task::(_updateState) Task=`250a9222-327a-4d42-b180-407ae94a9d59`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:47:48,989::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:47:48,989::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:47:48,989::task::1185::TaskManager.Task::(prepare) Task=`250a9222-327a-4d42-b180-407ae94a9d59`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:47:48,989::task::595::TaskManager.Task::(_updateState) Task=`250a9222-327a-4d42-b180-407ae94a9d59`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:47:48,989::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:47:48,990::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:47:48,990::task::990::TaskManager.Task::(_decref) Task=`250a9222-327a-4d42-b180-407ae94a9d59`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:47:49,022::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:47:49,022::task::595::TaskManager.Task::(_updateState) Task=`5bec3d4a-24a3-4f9a-9bb9-d10311e0b247`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:47:49,022::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:47:49,023::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f04c368e-10e9-472f-a0d2-fdc975e92e52`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:47:49,023::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:47:49,023::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:47:49,023::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`f04c368e-10e9-472f-a0d2-fdc975e92e52`::Granted request >Thread-34::DEBUG::2014-07-24 11:47:49,024::task::827::TaskManager.Task::(resourceAcquired) Task=`5bec3d4a-24a3-4f9a-9bb9-d10311e0b247`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:47:49,024::task::990::TaskManager.Task::(_decref) Task=`5bec3d4a-24a3-4f9a-9bb9-d10311e0b247`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:47:49,025::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:47:49,025::task::1185::TaskManager.Task::(prepare) Task=`5bec3d4a-24a3-4f9a-9bb9-d10311e0b247`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:47:49,025::task::595::TaskManager.Task::(_updateState) Task=`5bec3d4a-24a3-4f9a-9bb9-d10311e0b247`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:47:49,025::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:47:49,025::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:47:49,026::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:47:49,026::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:47:49,026::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:47:49,026::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:47:49,026::task::990::TaskManager.Task::(_decref) Task=`5bec3d4a-24a3-4f9a-9bb9-d10311e0b247`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:47:49,234::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:47:49,308::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332297 s, 30.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:47:50,511::task::595::TaskManager.Task::(_updateState) Task=`56007946-38fa-4634-a58f-0f09b22b8bca`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:47:50,511::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:47:50,511::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000662328', 'lastCheck': '9.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:47:50,511::task::1185::TaskManager.Task::(prepare) Task=`56007946-38fa-4634-a58f-0f09b22b8bca`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000662328', 'lastCheck': '9.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:47:50,511::task::595::TaskManager.Task::(_updateState) Task=`56007946-38fa-4634-a58f-0f09b22b8bca`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:47:50,512::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:47:50,512::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:47:50,512::task::990::TaskManager.Task::(_decref) Task=`56007946-38fa-4634-a58f-0f09b22b8bca`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:47:51,243::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:47:51,254::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000725121 s, 5.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:47:51,321::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:47:51,399::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355881 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:47:53,411::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:47:53,488::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344814 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:47:55,501::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:47:55,864::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.320923 s, 3.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:47:57,877::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:47:57,952::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331444 s, 30.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:47:59,080::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:47:59,080::task::595::TaskManager.Task::(_updateState) Task=`d0befd35-677c-42e9-8138-1fdbdc7b86c3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:47:59,081::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:47:59,081::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:47:59,081::task::1185::TaskManager.Task::(prepare) Task=`d0befd35-677c-42e9-8138-1fdbdc7b86c3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:47:59,081::task::595::TaskManager.Task::(_updateState) Task=`d0befd35-677c-42e9-8138-1fdbdc7b86c3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:47:59,082::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:47:59,082::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:47:59,082::task::990::TaskManager.Task::(_decref) Task=`d0befd35-677c-42e9-8138-1fdbdc7b86c3`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:47:59,113::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:47:59,113::task::595::TaskManager.Task::(_updateState) Task=`ba9a2adb-3d84-4f5d-a540-ebc2e3b92792`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:47:59,114::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:47:59,114::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1a3443c3-44f5-455f-8752-4c1a51d21a8a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:47:59,114::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:47:59,114::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:47:59,115::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1a3443c3-44f5-455f-8752-4c1a51d21a8a`::Granted request >Thread-34::DEBUG::2014-07-24 11:47:59,115::task::827::TaskManager.Task::(resourceAcquired) Task=`ba9a2adb-3d84-4f5d-a540-ebc2e3b92792`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:47:59,115::task::990::TaskManager.Task::(_decref) Task=`ba9a2adb-3d84-4f5d-a540-ebc2e3b92792`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:47:59,116::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:47:59,116::task::1185::TaskManager.Task::(prepare) Task=`ba9a2adb-3d84-4f5d-a540-ebc2e3b92792`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:47:59,116::task::595::TaskManager.Task::(_updateState) Task=`ba9a2adb-3d84-4f5d-a540-ebc2e3b92792`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:47:59,116::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:47:59,117::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:47:59,117::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:47:59,117::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:47:59,117::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:47:59,117::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:47:59,118::task::990::TaskManager.Task::(_decref) Task=`ba9a2adb-3d84-4f5d-a540-ebc2e3b92792`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:47:59,965::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:48:00,046::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0371497 s, 27.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:48:01,259::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:48:01,276::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000695965 s, 5.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:48:01,579::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:48:02,059::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:48:02,134::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344173 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:48:04,147::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:48:04,226::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364087 s, 28.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:48:05,903::task::595::TaskManager.Task::(_updateState) Task=`37457923-94cd-47fb-a7d8-67296df05f2d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:48:05,903::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:48:05,903::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000695965', 'lastCheck': '4.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:48:05,903::task::1185::TaskManager.Task::(prepare) Task=`37457923-94cd-47fb-a7d8-67296df05f2d`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000695965', 'lastCheck': '4.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:48:05,904::task::595::TaskManager.Task::(_updateState) Task=`37457923-94cd-47fb-a7d8-67296df05f2d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:48:05,904::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:48:05,904::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:48:05,904::task::990::TaskManager.Task::(_decref) Task=`37457923-94cd-47fb-a7d8-67296df05f2d`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:48:06,238::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:48:06,324::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0412478 s, 24.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:48:08,337::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-37::DEBUG::2014-07-24 11:48:08,559::task::595::TaskManager.Task::(_updateState) Task=`75ed1c2a-0793-4440-bbe0-35d994dc5d8f`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:48:08,560::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:48:08,560::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-37::DEBUG::2014-07-24 11:48:08,560::task::1185::TaskManager.Task::(prepare) Task=`75ed1c2a-0793-4440-bbe0-35d994dc5d8f`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-37::DEBUG::2014-07-24 11:48:08,561::task::595::TaskManager.Task::(_updateState) Task=`75ed1c2a-0793-4440-bbe0-35d994dc5d8f`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:48:08,561::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:48:08,561::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:48:08,561::task::990::TaskManager.Task::(_decref) Task=`75ed1c2a-0793-4440-bbe0-35d994dc5d8f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:48:08,703::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.324109 s, 3.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:48:09,173::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:48:09,181::task::595::TaskManager.Task::(_updateState) Task=`aee0b4a2-4244-4c3e-9bc8-f3c84c8d4a55`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:48:09,181::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:48:09,181::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:48:09,182::task::1185::TaskManager.Task::(prepare) Task=`aee0b4a2-4244-4c3e-9bc8-f3c84c8d4a55`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:48:09,182::task::595::TaskManager.Task::(_updateState) Task=`aee0b4a2-4244-4c3e-9bc8-f3c84c8d4a55`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:48:09,182::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:48:09,182::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:48:09,182::task::990::TaskManager.Task::(_decref) Task=`aee0b4a2-4244-4c3e-9bc8-f3c84c8d4a55`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:48:09,215::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:48:09,215::task::595::TaskManager.Task::(_updateState) Task=`4fb57483-ff71-4f5d-bf1a-e3f02e8d841f`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:48:09,216::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:48:09,216::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`16f1f3fe-2766-46bc-8bd5-a776f995b536`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:48:09,216::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:48:09,216::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:48:09,217::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`16f1f3fe-2766-46bc-8bd5-a776f995b536`::Granted request >Thread-34::DEBUG::2014-07-24 11:48:09,217::task::827::TaskManager.Task::(resourceAcquired) Task=`4fb57483-ff71-4f5d-bf1a-e3f02e8d841f`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:48:09,217::task::990::TaskManager.Task::(_decref) Task=`4fb57483-ff71-4f5d-bf1a-e3f02e8d841f`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:48:09,218::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:48:09,218::task::1185::TaskManager.Task::(prepare) Task=`4fb57483-ff71-4f5d-bf1a-e3f02e8d841f`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:48:09,218::task::595::TaskManager.Task::(_updateState) Task=`4fb57483-ff71-4f5d-bf1a-e3f02e8d841f`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:48:09,218::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:48:09,219::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:48:09,219::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:48:09,219::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:48:09,219::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:48:09,219::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:48:09,220::task::990::TaskManager.Task::(_decref) Task=`4fb57483-ff71-4f5d-bf1a-e3f02e8d841f`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:48:10,715::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:48:10,793::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358132 s, 28.6 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:48:11,299::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:48:11,312::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000753936 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:48:12,805::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:48:12,885::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370944 s, 27.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:48:14,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:48:14,974::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357386 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:48:16,988::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:48:17,066::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355893 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:48:19,079::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:48:19,157::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365231 s, 28.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:48:19,272::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:48:19,273::task::595::TaskManager.Task::(_updateState) Task=`685d4277-dbaf-4ef2-b52c-deeecb05a642`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:48:19,273::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:48:19,273::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:48:19,274::task::1185::TaskManager.Task::(prepare) Task=`685d4277-dbaf-4ef2-b52c-deeecb05a642`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:48:19,274::task::595::TaskManager.Task::(_updateState) Task=`685d4277-dbaf-4ef2-b52c-deeecb05a642`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:48:19,274::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:48:19,274::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:48:19,274::task::990::TaskManager.Task::(_decref) Task=`685d4277-dbaf-4ef2-b52c-deeecb05a642`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:48:19,305::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:48:19,305::task::595::TaskManager.Task::(_updateState) Task=`0931ca94-e7ec-4f0b-8884-6afd2da9aa03`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:48:19,306::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:48:19,306::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`974534a3-5a6d-4cc7-9a2c-4386318c2f92`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:48:19,306::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:48:19,307::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:48:19,307::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`974534a3-5a6d-4cc7-9a2c-4386318c2f92`::Granted request >Thread-34::DEBUG::2014-07-24 11:48:19,307::task::827::TaskManager.Task::(resourceAcquired) Task=`0931ca94-e7ec-4f0b-8884-6afd2da9aa03`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:48:19,307::task::990::TaskManager.Task::(_decref) Task=`0931ca94-e7ec-4f0b-8884-6afd2da9aa03`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:48:19,308::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:48:19,308::task::1185::TaskManager.Task::(prepare) Task=`0931ca94-e7ec-4f0b-8884-6afd2da9aa03`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:48:19,308::task::595::TaskManager.Task::(_updateState) Task=`0931ca94-e7ec-4f0b-8884-6afd2da9aa03`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:48:19,309::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:48:19,309::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:48:19,309::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:48:19,309::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:48:19,309::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:48:19,310::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:48:19,310::task::990::TaskManager.Task::(_decref) Task=`0931ca94-e7ec-4f0b-8884-6afd2da9aa03`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:48:21,170::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:48:21,248::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356916 s, 28.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:48:21,279::task::595::TaskManager.Task::(_updateState) Task=`005ec305-2307-4d56-a5fc-6f7f576c135b`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:48:21,279::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:48:21,279::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000753936', 'lastCheck': '10.0', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:48:21,279::task::1185::TaskManager.Task::(prepare) Task=`005ec305-2307-4d56-a5fc-6f7f576c135b`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000753936', 'lastCheck': '10.0', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:48:21,280::task::595::TaskManager.Task::(_updateState) Task=`005ec305-2307-4d56-a5fc-6f7f576c135b`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:48:21,280::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:48:21,280::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:48:21,280::task::990::TaskManager.Task::(_decref) Task=`005ec305-2307-4d56-a5fc-6f7f576c135b`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:48:21,316::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:48:21,328::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000697746 s, 5.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:48:23,261::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:48:23,338::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358743 s, 28.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:48:25,351::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:48:25,428::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351465 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:48:27,441::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:48:27,520::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0378506 s, 27.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:48:29,366::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:48:29,367::task::595::TaskManager.Task::(_updateState) Task=`23f3cd9a-267d-4ea2-a2f8-f34d4fae59ac`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:48:29,367::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:48:29,367::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:48:29,368::task::1185::TaskManager.Task::(prepare) Task=`23f3cd9a-267d-4ea2-a2f8-f34d4fae59ac`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:48:29,368::task::595::TaskManager.Task::(_updateState) Task=`23f3cd9a-267d-4ea2-a2f8-f34d4fae59ac`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:48:29,368::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:48:29,368::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:48:29,368::task::990::TaskManager.Task::(_decref) Task=`23f3cd9a-267d-4ea2-a2f8-f34d4fae59ac`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:48:29,399::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:48:29,399::task::595::TaskManager.Task::(_updateState) Task=`66b345f2-fb7a-465f-8b0d-63c84e9834c7`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:48:29,399::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:48:29,400::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`5e9ae925-31fd-4799-87aa-d986e5303a49`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:48:29,400::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:48:29,400::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:48:29,400::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`5e9ae925-31fd-4799-87aa-d986e5303a49`::Granted request >Thread-34::DEBUG::2014-07-24 11:48:29,401::task::827::TaskManager.Task::(resourceAcquired) Task=`66b345f2-fb7a-465f-8b0d-63c84e9834c7`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:48:29,401::task::990::TaskManager.Task::(_decref) Task=`66b345f2-fb7a-465f-8b0d-63c84e9834c7`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:48:29,401::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:48:29,402::task::1185::TaskManager.Task::(prepare) Task=`66b345f2-fb7a-465f-8b0d-63c84e9834c7`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:48:29,402::task::595::TaskManager.Task::(_updateState) Task=`66b345f2-fb7a-465f-8b0d-63c84e9834c7`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:48:29,402::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:48:29,402::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:48:29,402::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:48:29,403::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:48:29,403::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:48:29,403::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:48:29,403::task::990::TaskManager.Task::(_decref) Task=`66b345f2-fb7a-465f-8b0d-63c84e9834c7`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:48:29,533::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:48:29,610::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347012 s, 29.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:48:31,333::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:48:31,356::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0118611 s, 345 kB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:48:31,602::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:48:31,621::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:48:31,699::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348035 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:48:33,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:48:33,805::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0504244 s, 20.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:48:35,817::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:48:35,896::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363935 s, 28.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:48:36,652::task::595::TaskManager.Task::(_updateState) Task=`94529f6f-2826-4a9a-bc3a-5b8ed5d69f63`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:48:36,652::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:48:36,653::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0118611', 'lastCheck': '5.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:48:36,653::task::1185::TaskManager.Task::(prepare) Task=`94529f6f-2826-4a9a-bc3a-5b8ed5d69f63`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0118611', 'lastCheck': '5.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:48:36,653::task::595::TaskManager.Task::(_updateState) Task=`94529f6f-2826-4a9a-bc3a-5b8ed5d69f63`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:48:36,653::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:48:36,653::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:48:36,653::task::990::TaskManager.Task::(_decref) Task=`94529f6f-2826-4a9a-bc3a-5b8ed5d69f63`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:48:37,910::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:48:37,991::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352075 s, 29.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:48:39,466::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:48:39,466::task::595::TaskManager.Task::(_updateState) Task=`c78d85db-9f68-4881-84aa-ca07ace3acce`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:48:39,467::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:48:39,467::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:48:39,467::task::1185::TaskManager.Task::(prepare) Task=`c78d85db-9f68-4881-84aa-ca07ace3acce`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:48:39,467::task::595::TaskManager.Task::(_updateState) Task=`c78d85db-9f68-4881-84aa-ca07ace3acce`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:48:39,467::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:48:39,468::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:48:39,468::task::990::TaskManager.Task::(_decref) Task=`c78d85db-9f68-4881-84aa-ca07ace3acce`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:48:39,507::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:48:39,508::task::595::TaskManager.Task::(_updateState) Task=`a06a4467-a407-4cfd-8f84-a991e1cc7c5e`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:48:39,508::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:48:39,508::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`0493311e-757c-4e50-b846-a83bc370582f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:48:39,508::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:48:39,509::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:48:39,509::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`0493311e-757c-4e50-b846-a83bc370582f`::Granted request >Thread-34::DEBUG::2014-07-24 11:48:39,509::task::827::TaskManager.Task::(resourceAcquired) Task=`a06a4467-a407-4cfd-8f84-a991e1cc7c5e`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:48:39,509::task::990::TaskManager.Task::(_decref) Task=`a06a4467-a407-4cfd-8f84-a991e1cc7c5e`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:48:39,510::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:48:39,510::task::1185::TaskManager.Task::(prepare) Task=`a06a4467-a407-4cfd-8f84-a991e1cc7c5e`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:48:39,510::task::595::TaskManager.Task::(_updateState) Task=`a06a4467-a407-4cfd-8f84-a991e1cc7c5e`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:48:39,511::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:48:39,511::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:48:39,511::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:48:39,511::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:48:39,511::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:48:39,511::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:48:39,512::task::990::TaskManager.Task::(_decref) Task=`a06a4467-a407-4cfd-8f84-a991e1cc7c5e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:48:40,004::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:48:40,087::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0372063 s, 27.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:48:41,360::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:48:41,381::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00935047 s, 438 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:48:42,101::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:48:42,178::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356905 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:48:44,191::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:48:44,280::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0480145 s, 21.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:48:46,293::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:48:46,384::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0484577 s, 21.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:48:48,397::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:48:48,482::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0437873 s, 23.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:48:49,577::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:48:49,577::task::595::TaskManager.Task::(_updateState) Task=`83e5ae16-e80d-42f6-97a4-2c517ee26687`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:48:49,578::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:48:49,578::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:48:49,578::task::1185::TaskManager.Task::(prepare) Task=`83e5ae16-e80d-42f6-97a4-2c517ee26687`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:48:49,578::task::595::TaskManager.Task::(_updateState) Task=`83e5ae16-e80d-42f6-97a4-2c517ee26687`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:48:49,579::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:48:49,579::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:48:49,579::task::990::TaskManager.Task::(_decref) Task=`83e5ae16-e80d-42f6-97a4-2c517ee26687`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:48:49,629::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:48:49,630::task::595::TaskManager.Task::(_updateState) Task=`7bc7cbba-9971-41c5-9ed4-87ca84af6be6`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:48:49,630::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:48:49,630::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4f30a1bb-d7c3-4fba-933c-f77ed5e4d557`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:48:49,630::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:48:49,631::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:48:49,631::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`4f30a1bb-d7c3-4fba-933c-f77ed5e4d557`::Granted request >Thread-34::DEBUG::2014-07-24 11:48:49,631::task::827::TaskManager.Task::(resourceAcquired) Task=`7bc7cbba-9971-41c5-9ed4-87ca84af6be6`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:48:49,631::task::990::TaskManager.Task::(_decref) Task=`7bc7cbba-9971-41c5-9ed4-87ca84af6be6`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:48:49,632::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:48:49,632::task::1185::TaskManager.Task::(prepare) Task=`7bc7cbba-9971-41c5-9ed4-87ca84af6be6`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:48:49,632::task::595::TaskManager.Task::(_updateState) Task=`7bc7cbba-9971-41c5-9ed4-87ca84af6be6`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:48:49,633::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:48:49,633::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:48:49,633::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:48:49,633::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:48:49,633::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:48:49,634::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:48:49,634::task::990::TaskManager.Task::(_decref) Task=`7bc7cbba-9971-41c5-9ed4-87ca84af6be6`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:48:50,494::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:48:50,573::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359236 s, 28.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:48:51,386::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:48:51,406::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00945401 s, 433 kB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:48:52,012::task::595::TaskManager.Task::(_updateState) Task=`f2664853-5656-4a63-8169-3d532322660e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:48:52,012::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:48:52,012::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00945401', 'lastCheck': '0.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:48:52,012::task::1185::TaskManager.Task::(prepare) Task=`f2664853-5656-4a63-8169-3d532322660e`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00945401', 'lastCheck': '0.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:48:52,013::task::595::TaskManager.Task::(_updateState) Task=`f2664853-5656-4a63-8169-3d532322660e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:48:52,013::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:48:52,013::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:48:52,013::task::990::TaskManager.Task::(_decref) Task=`f2664853-5656-4a63-8169-3d532322660e`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:48:52,585::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:48:52,880::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341156 s, 30.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:48:54,893::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:48:54,969::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334783 s, 30.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:48:56,981::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:48:57,058::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354319 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:48:59,070::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:48:59,149::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358948 s, 28.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:48:59,731::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:48:59,731::task::595::TaskManager.Task::(_updateState) Task=`c80cd2e3-84af-4b82-bc14-c4e569451db3`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:48:59,732::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:48:59,732::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:48:59,732::task::1185::TaskManager.Task::(prepare) Task=`c80cd2e3-84af-4b82-bc14-c4e569451db3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:48:59,732::task::595::TaskManager.Task::(_updateState) Task=`c80cd2e3-84af-4b82-bc14-c4e569451db3`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:48:59,732::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:48:59,733::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:48:59,733::task::990::TaskManager.Task::(_decref) Task=`c80cd2e3-84af-4b82-bc14-c4e569451db3`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:48:59,767::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:48:59,767::task::595::TaskManager.Task::(_updateState) Task=`e0b1c374-962e-46dd-9127-6caee802326c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:48:59,767::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:48:59,768::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ac218afc-cada-4b8d-ace3-b97450fe9554`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:48:59,768::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:48:59,768::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:48:59,768::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ac218afc-cada-4b8d-ace3-b97450fe9554`::Granted request >Thread-34::DEBUG::2014-07-24 11:48:59,769::task::827::TaskManager.Task::(resourceAcquired) Task=`e0b1c374-962e-46dd-9127-6caee802326c`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:48:59,769::task::990::TaskManager.Task::(_decref) Task=`e0b1c374-962e-46dd-9127-6caee802326c`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:48:59,769::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:48:59,770::task::1185::TaskManager.Task::(prepare) Task=`e0b1c374-962e-46dd-9127-6caee802326c`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:48:59,770::task::595::TaskManager.Task::(_updateState) Task=`e0b1c374-962e-46dd-9127-6caee802326c`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:48:59,770::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:48:59,770::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:48:59,770::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:48:59,771::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:48:59,771::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:48:59,771::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:48:59,771::task::990::TaskManager.Task::(_decref) Task=`e0b1c374-962e-46dd-9127-6caee802326c`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:49:01,161::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:49:01,240::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0377439 s, 27.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:49:01,411::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:49:01,423::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000720602 s, 5.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:49:01,639::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:49:03,253::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:49:03,333::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0374087 s, 27.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:49:05,346::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:49:05,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363067 s, 28.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:49:07,386::task::595::TaskManager.Task::(_updateState) Task=`18cadea0-793e-4637-beba-dc65d0b74a5a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:49:07,386::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:49:07,386::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000720602', 'lastCheck': '6.0', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:49:07,386::task::1185::TaskManager.Task::(prepare) Task=`18cadea0-793e-4637-beba-dc65d0b74a5a`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000720602', 'lastCheck': '6.0', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:49:07,387::task::595::TaskManager.Task::(_updateState) Task=`18cadea0-793e-4637-beba-dc65d0b74a5a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:49:07,387::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:49:07,387::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:49:07,387::task::990::TaskManager.Task::(_decref) Task=`18cadea0-793e-4637-beba-dc65d0b74a5a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:49:07,436::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:49:07,537::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360774 s, 28.4 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:49:08,734::task::595::TaskManager.Task::(_updateState) Task=`b6bd2ee3-d030-4933-b996-0c82146a6d89`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:49:08,734::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:49:08,735::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-37::DEBUG::2014-07-24 11:49:08,735::task::1185::TaskManager.Task::(prepare) Task=`b6bd2ee3-d030-4933-b996-0c82146a6d89`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-37::DEBUG::2014-07-24 11:49:08,735::task::595::TaskManager.Task::(_updateState) Task=`b6bd2ee3-d030-4933-b996-0c82146a6d89`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:49:08,735::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:49:08,735::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:49:08,735::task::990::TaskManager.Task::(_decref) Task=`b6bd2ee3-d030-4933-b996-0c82146a6d89`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:49:09,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:49:09,631::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0378165 s, 27.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:49:09,829::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:49:09,830::task::595::TaskManager.Task::(_updateState) Task=`174b7b9d-69a2-4cea-8d9c-6481c5285f30`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:49:09,830::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:49:09,830::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:49:09,830::task::1185::TaskManager.Task::(prepare) Task=`174b7b9d-69a2-4cea-8d9c-6481c5285f30`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:49:09,831::task::595::TaskManager.Task::(_updateState) Task=`174b7b9d-69a2-4cea-8d9c-6481c5285f30`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:49:09,831::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:49:09,831::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:49:09,831::task::990::TaskManager.Task::(_decref) Task=`174b7b9d-69a2-4cea-8d9c-6481c5285f30`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:49:09,861::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:49:09,861::task::595::TaskManager.Task::(_updateState) Task=`568b96ca-548a-417e-b64e-f30b72e5a8fc`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:49:09,862::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:49:09,862::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`247470b9-e839-445b-aeef-2e66396e6613`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:49:09,862::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:49:09,862::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:49:09,863::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`247470b9-e839-445b-aeef-2e66396e6613`::Granted request >Thread-34::DEBUG::2014-07-24 11:49:09,863::task::827::TaskManager.Task::(resourceAcquired) Task=`568b96ca-548a-417e-b64e-f30b72e5a8fc`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:49:09,863::task::990::TaskManager.Task::(_decref) Task=`568b96ca-548a-417e-b64e-f30b72e5a8fc`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:49:09,864::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:49:09,864::task::1185::TaskManager.Task::(prepare) Task=`568b96ca-548a-417e-b64e-f30b72e5a8fc`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:49:09,864::task::595::TaskManager.Task::(_updateState) Task=`568b96ca-548a-417e-b64e-f30b72e5a8fc`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:49:09,864::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:49:09,864::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:49:09,865::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:49:09,865::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:49:09,865::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:49:09,865::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:49:09,865::task::990::TaskManager.Task::(_decref) Task=`568b96ca-548a-417e-b64e-f30b72e5a8fc`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:49:11,428::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:49:11,439::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000650945 s, 6.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:49:11,643::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:49:11,720::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0345408 s, 29.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:49:13,733::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:49:13,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343258 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:49:15,821::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:49:15,898::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339232 s, 30.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:49:17,910::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:49:17,988::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348534 s, 29.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:49:19,928::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:49:19,948::task::595::TaskManager.Task::(_updateState) Task=`f9ca5729-b337-4f42-b8e0-45e11c651832`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:49:19,948::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:49:19,948::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:49:19,948::task::1185::TaskManager.Task::(prepare) Task=`f9ca5729-b337-4f42-b8e0-45e11c651832`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:49:19,949::task::595::TaskManager.Task::(_updateState) Task=`f9ca5729-b337-4f42-b8e0-45e11c651832`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:49:19,949::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:49:19,949::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:49:19,949::task::990::TaskManager.Task::(_decref) Task=`f9ca5729-b337-4f42-b8e0-45e11c651832`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:49:19,980::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:49:19,980::task::595::TaskManager.Task::(_updateState) Task=`422eae6b-0b2c-40da-9094-41b5ae304ed4`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:49:19,981::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:49:19,983::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b7222625-b02e-4be7-b310-f5c6ea5bc0dc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:49:19,983::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:49:19,983::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:49:19,983::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b7222625-b02e-4be7-b310-f5c6ea5bc0dc`::Granted request >Thread-34::DEBUG::2014-07-24 11:49:19,984::task::827::TaskManager.Task::(resourceAcquired) Task=`422eae6b-0b2c-40da-9094-41b5ae304ed4`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:49:19,984::task::990::TaskManager.Task::(_decref) Task=`422eae6b-0b2c-40da-9094-41b5ae304ed4`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:49:19,984::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:49:19,985::task::1185::TaskManager.Task::(prepare) Task=`422eae6b-0b2c-40da-9094-41b5ae304ed4`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:49:19,985::task::595::TaskManager.Task::(_updateState) Task=`422eae6b-0b2c-40da-9094-41b5ae304ed4`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:49:19,985::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:49:19,985::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:49:19,985::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:49:19,986::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:49:19,986::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:49:19,986::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:49:19,986::task::990::TaskManager.Task::(_decref) Task=`422eae6b-0b2c-40da-9094-41b5ae304ed4`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:49:20,001::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:49:20,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0380899 s, 26.9 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:49:21,444::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:49:21,465::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0100334 s, 408 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:49:22,096::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:49:22,179::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0393052 s, 26.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:49:23,080::task::595::TaskManager.Task::(_updateState) Task=`d65c7c7a-75b1-4070-b9de-8698fb873c2a`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:49:23,080::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:49:23,080::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0100334', 'lastCheck': '1.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:49:23,080::task::1185::TaskManager.Task::(prepare) Task=`d65c7c7a-75b1-4070-b9de-8698fb873c2a`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0100334', 'lastCheck': '1.6', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:49:23,081::task::595::TaskManager.Task::(_updateState) Task=`d65c7c7a-75b1-4070-b9de-8698fb873c2a`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:49:23,081::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:49:23,081::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:49:23,081::task::990::TaskManager.Task::(_decref) Task=`d65c7c7a-75b1-4070-b9de-8698fb873c2a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:49:24,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:49:24,271::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036341 s, 28.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:49:26,283::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:49:26,360::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348144 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:49:28,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:49:28,451::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348538 s, 29.4 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:49:30,040::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [21656b69] >Thread-14::DEBUG::2014-07-24 11:49:30,040::task::595::TaskManager.Task::(_updateState) Task=`17d8ca49-04d2-4564-ae9c-5e1b5bab2844`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:49:30,041::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:49:30,041::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:49:30,041::task::1185::TaskManager.Task::(prepare) Task=`17d8ca49-04d2-4564-ae9c-5e1b5bab2844`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:49:30,041::task::595::TaskManager.Task::(_updateState) Task=`17d8ca49-04d2-4564-ae9c-5e1b5bab2844`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:49:30,041::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:49:30,042::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:49:30,042::task::990::TaskManager.Task::(_decref) Task=`17d8ca49-04d2-4564-ae9c-5e1b5bab2844`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:49:30,072::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] flowID [21656b69] >Thread-34::DEBUG::2014-07-24 11:49:30,073::task::595::TaskManager.Task::(_updateState) Task=`cd310348-349e-4ec5-ba31-f5d062cf4a88`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:49:30,073::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:49:30,073::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`acbc37fb-67fe-491e-94a4-59812acf192a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:49:30,074::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:49:30,074::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:49:30,074::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`acbc37fb-67fe-491e-94a4-59812acf192a`::Granted request >Thread-34::DEBUG::2014-07-24 11:49:30,074::task::827::TaskManager.Task::(resourceAcquired) Task=`cd310348-349e-4ec5-ba31-f5d062cf4a88`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:49:30,074::task::990::TaskManager.Task::(_decref) Task=`cd310348-349e-4ec5-ba31-f5d062cf4a88`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:49:30,075::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:49:30,075::task::1185::TaskManager.Task::(prepare) Task=`cd310348-349e-4ec5-ba31-f5d062cf4a88`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:49:30,075::task::595::TaskManager.Task::(_updateState) Task=`cd310348-349e-4ec5-ba31-f5d062cf4a88`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:49:30,076::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:49:30,076::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:49:30,076::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:49:30,076::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:49:30,076::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:49:30,077::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:49:30,077::task::990::TaskManager.Task::(_decref) Task=`cd310348-349e-4ec5-ba31-f5d062cf4a88`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:49:30,463::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:49:30,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351687 s, 29.1 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:49:31,470::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:49:31,499::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0164802 s, 249 kB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:49:31,675::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:49:32,552::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:49:32,628::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331057 s, 30.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:49:34,640::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:49:34,715::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332888 s, 30.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:49:36,727::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:49:36,803::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331284 s, 30.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:49:38,445::task::595::TaskManager.Task::(_updateState) Task=`9f031263-73ae-40d9-aa14-fb84078479eb`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:49:38,445::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:49:38,446::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0164802', 'lastCheck': '6.9', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:49:38,446::task::1185::TaskManager.Task::(prepare) Task=`9f031263-73ae-40d9-aa14-fb84078479eb`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0164802', 'lastCheck': '6.9', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:49:38,446::task::595::TaskManager.Task::(_updateState) Task=`9f031263-73ae-40d9-aa14-fb84078479eb`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:49:38,446::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:49:38,446::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:49:38,447::task::990::TaskManager.Task::(_decref) Task=`9f031263-73ae-40d9-aa14-fb84078479eb`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:49:38,817::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:49:38,894::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351295 s, 29.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:49:40,165::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:49:40,166::task::595::TaskManager.Task::(_updateState) Task=`5559ce4c-5d12-4058-993e-9112afa6be90`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:49:40,166::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:49:40,166::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:49:40,166::task::1185::TaskManager.Task::(prepare) Task=`5559ce4c-5d12-4058-993e-9112afa6be90`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:49:40,167::task::595::TaskManager.Task::(_updateState) Task=`5559ce4c-5d12-4058-993e-9112afa6be90`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:49:40,167::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:49:40,167::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:49:40,167::task::990::TaskManager.Task::(_decref) Task=`5559ce4c-5d12-4058-993e-9112afa6be90`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:49:40,205::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:49:40,205::task::595::TaskManager.Task::(_updateState) Task=`09fc32c2-64ef-416e-a140-a80cbbf9b943`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:49:40,205::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:49:40,206::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`511a7b97-8f82-465b-a32d-44058904db88`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:49:40,206::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:49:40,206::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:49:40,206::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`511a7b97-8f82-465b-a32d-44058904db88`::Granted request >Thread-34::DEBUG::2014-07-24 11:49:40,206::task::827::TaskManager.Task::(resourceAcquired) Task=`09fc32c2-64ef-416e-a140-a80cbbf9b943`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:49:40,207::task::990::TaskManager.Task::(_decref) Task=`09fc32c2-64ef-416e-a140-a80cbbf9b943`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:49:40,207::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:49:40,207::task::1185::TaskManager.Task::(prepare) Task=`09fc32c2-64ef-416e-a140-a80cbbf9b943`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:49:40,208::task::595::TaskManager.Task::(_updateState) Task=`09fc32c2-64ef-416e-a140-a80cbbf9b943`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:49:40,208::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:49:40,208::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:49:40,208::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:49:40,208::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:49:40,209::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:49:40,209::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:49:40,209::task::990::TaskManager.Task::(_decref) Task=`09fc32c2-64ef-416e-a140-a80cbbf9b943`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:49:40,906::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:49:40,987::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0359288 s, 28.5 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:49:41,503::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:49:41,524::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0093945 s, 436 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:49:43,002::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:49:43,196::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.152189 s, 6.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:49:45,209::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:49:45,285::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340327 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:49:47,298::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:49:47,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338615 s, 30.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:49:49,386::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:49:49,464::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357852 s, 28.6 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:49:50,276::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:49:50,276::task::595::TaskManager.Task::(_updateState) Task=`9dd9f68e-e0cc-435a-8048-73988da93915`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:49:50,277::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:49:50,277::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:49:50,277::task::1185::TaskManager.Task::(prepare) Task=`9dd9f68e-e0cc-435a-8048-73988da93915`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:49:50,277::task::595::TaskManager.Task::(_updateState) Task=`9dd9f68e-e0cc-435a-8048-73988da93915`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:49:50,278::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:49:50,278::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:49:50,278::task::990::TaskManager.Task::(_decref) Task=`9dd9f68e-e0cc-435a-8048-73988da93915`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:49:50,321::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:49:50,321::task::595::TaskManager.Task::(_updateState) Task=`9d482f12-2d41-4958-9a81-8123793df601`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:49:50,321::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:49:50,322::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`8db13099-17a2-42db-8ddd-47708a3ed0c5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:49:50,322::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:49:50,322::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:49:50,322::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`8db13099-17a2-42db-8ddd-47708a3ed0c5`::Granted request >Thread-34::DEBUG::2014-07-24 11:49:50,323::task::827::TaskManager.Task::(resourceAcquired) Task=`9d482f12-2d41-4958-9a81-8123793df601`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:49:50,323::task::990::TaskManager.Task::(_decref) Task=`9d482f12-2d41-4958-9a81-8123793df601`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:49:50,324::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:49:50,324::task::1185::TaskManager.Task::(prepare) Task=`9d482f12-2d41-4958-9a81-8123793df601`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:49:50,324::task::595::TaskManager.Task::(_updateState) Task=`9d482f12-2d41-4958-9a81-8123793df601`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:49:50,324::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:49:50,324::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:49:50,325::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:49:50,325::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:49:50,325::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:49:50,325::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:49:50,325::task::990::TaskManager.Task::(_decref) Task=`9d482f12-2d41-4958-9a81-8123793df601`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:49:51,477::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Thread-18::DEBUG::2014-07-24 11:49:51,532::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:49:51,550::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000594692 s, 6.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:49:51,597::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338032 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:49:53,610::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:49:53,700::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0480861 s, 21.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:49:53,873::task::595::TaskManager.Task::(_updateState) Task=`4edc4b6d-f8e0-43af-a999-be99bc2b56df`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:49:53,874::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:49:53,874::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000594692', 'lastCheck': '2.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:49:53,874::task::1185::TaskManager.Task::(prepare) Task=`4edc4b6d-f8e0-43af-a999-be99bc2b56df`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000594692', 'lastCheck': '2.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:49:53,874::task::595::TaskManager.Task::(_updateState) Task=`4edc4b6d-f8e0-43af-a999-be99bc2b56df`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:49:53,875::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:49:53,875::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:49:53,875::task::990::TaskManager.Task::(_decref) Task=`4edc4b6d-f8e0-43af-a999-be99bc2b56df`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:49:55,713::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:49:55,788::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329936 s, 31.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:49:57,800::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:49:57,880::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368769 s, 27.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:49:59,893::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:49:59,972::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0376174 s, 27.2 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:50:00,399::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:50:00,399::task::595::TaskManager.Task::(_updateState) Task=`269497f0-feaf-4f48-9591-d04b5902377d`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:50:00,399::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:50:00,400::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:50:00,400::task::1185::TaskManager.Task::(prepare) Task=`269497f0-feaf-4f48-9591-d04b5902377d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:50:00,400::task::595::TaskManager.Task::(_updateState) Task=`269497f0-feaf-4f48-9591-d04b5902377d`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:50:00,400::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:50:00,400::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:50:00,400::task::990::TaskManager.Task::(_decref) Task=`269497f0-feaf-4f48-9591-d04b5902377d`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:50:00,471::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:50:00,471::task::595::TaskManager.Task::(_updateState) Task=`0107caa7-0713-4dce-abe1-9c0cf96ba341`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:50:00,471::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:50:00,472::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e96ecb52-ac93-48f3-8c37-4f6eb8ea02ad`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:50:00,472::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:50:00,472::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:50:00,472::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`e96ecb52-ac93-48f3-8c37-4f6eb8ea02ad`::Granted request >Thread-34::DEBUG::2014-07-24 11:50:00,473::task::827::TaskManager.Task::(resourceAcquired) Task=`0107caa7-0713-4dce-abe1-9c0cf96ba341`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:50:00,473::task::990::TaskManager.Task::(_decref) Task=`0107caa7-0713-4dce-abe1-9c0cf96ba341`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:50:00,474::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:50:00,474::task::1185::TaskManager.Task::(prepare) Task=`0107caa7-0713-4dce-abe1-9c0cf96ba341`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:50:00,474::task::595::TaskManager.Task::(_updateState) Task=`0107caa7-0713-4dce-abe1-9c0cf96ba341`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:50:00,474::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:50:00,474::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:50:00,474::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:50:00,475::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:50:00,475::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:50:00,475::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:50:00,475::task::990::TaskManager.Task::(_decref) Task=`0107caa7-0713-4dce-abe1-9c0cf96ba341`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:50:01,575::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:50:01,587::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000714512 s, 5.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:50:01,711::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:50:01,984::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:50:02,065::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036135 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:50:04,077::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:50:04,162::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0427661 s, 23.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:50:06,175::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:50:06,252::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351338 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:50:08,265::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:50:08,342::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358222 s, 28.6 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:50:08,929::task::595::TaskManager.Task::(_updateState) Task=`59efbcb8-5dc4-46dd-a8d5-f6eca467045f`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:50:08,929::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:50:08,929::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-37::DEBUG::2014-07-24 11:50:08,930::task::1185::TaskManager.Task::(prepare) Task=`59efbcb8-5dc4-46dd-a8d5-f6eca467045f`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-37::DEBUG::2014-07-24 11:50:08,930::task::595::TaskManager.Task::(_updateState) Task=`59efbcb8-5dc4-46dd-a8d5-f6eca467045f`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:50:08,930::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:50:08,930::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:50:08,930::task::990::TaskManager.Task::(_decref) Task=`59efbcb8-5dc4-46dd-a8d5-f6eca467045f`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 11:50:09,344::task::595::TaskManager.Task::(_updateState) Task=`0760ba61-2b2e-46af-b2c7-ca9b4e244350`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:50:09,344::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:50:09,345::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000714512', 'lastCheck': '7.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:50:09,345::task::1185::TaskManager.Task::(prepare) Task=`0760ba61-2b2e-46af-b2c7-ca9b4e244350`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000714512', 'lastCheck': '7.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:50:09,345::task::595::TaskManager.Task::(_updateState) Task=`0760ba61-2b2e-46af-b2c7-ca9b4e244350`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:50:09,345::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:50:09,345::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:50:09,345::task::990::TaskManager.Task::(_decref) Task=`0760ba61-2b2e-46af-b2c7-ca9b4e244350`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:50:10,354::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:50:10,433::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356927 s, 28.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:50:10,558::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:50:10,559::task::595::TaskManager.Task::(_updateState) Task=`3442f672-edc0-491e-b537-54e6994e3c37`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:50:10,559::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:50:10,559::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:50:10,560::task::1185::TaskManager.Task::(prepare) Task=`3442f672-edc0-491e-b537-54e6994e3c37`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:50:10,560::task::595::TaskManager.Task::(_updateState) Task=`3442f672-edc0-491e-b537-54e6994e3c37`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:50:10,560::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:50:10,560::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:50:10,560::task::990::TaskManager.Task::(_decref) Task=`3442f672-edc0-491e-b537-54e6994e3c37`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:50:10,613::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:50:10,614::task::595::TaskManager.Task::(_updateState) Task=`2279790c-be8b-4a87-af06-bae218c454f6`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:50:10,614::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:50:10,614::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`2f041ca0-bbd0-4816-89db-e51f21441fe5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:50:10,614::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:50:10,615::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:50:10,615::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`2f041ca0-bbd0-4816-89db-e51f21441fe5`::Granted request >Thread-34::DEBUG::2014-07-24 11:50:10,616::task::827::TaskManager.Task::(resourceAcquired) Task=`2279790c-be8b-4a87-af06-bae218c454f6`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:50:10,616::task::990::TaskManager.Task::(_decref) Task=`2279790c-be8b-4a87-af06-bae218c454f6`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:50:10,616::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:50:10,617::task::1185::TaskManager.Task::(prepare) Task=`2279790c-be8b-4a87-af06-bae218c454f6`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:50:10,617::task::595::TaskManager.Task::(_updateState) Task=`2279790c-be8b-4a87-af06-bae218c454f6`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:50:10,617::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:50:10,617::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:50:10,617::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:50:10,618::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:50:10,618::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:50:10,618::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:50:10,618::task::990::TaskManager.Task::(_decref) Task=`2279790c-be8b-4a87-af06-bae218c454f6`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:50:11,592::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:50:11,617::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0137081 s, 299 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:50:12,445::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:50:12,520::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338952 s, 30.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:50:14,533::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:50:14,611::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349143 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:50:16,623::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:50:16,699::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344209 s, 29.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:50:18,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:50:18,788::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342162 s, 29.9 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:50:20,705::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:50:20,705::task::595::TaskManager.Task::(_updateState) Task=`7f4f44af-757d-4108-82bd-8d083b0b5b0e`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:50:20,706::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:50:20,706::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:50:20,706::task::1185::TaskManager.Task::(prepare) Task=`7f4f44af-757d-4108-82bd-8d083b0b5b0e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:50:20,706::task::595::TaskManager.Task::(_updateState) Task=`7f4f44af-757d-4108-82bd-8d083b0b5b0e`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:50:20,707::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:50:20,707::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:50:20,707::task::990::TaskManager.Task::(_decref) Task=`7f4f44af-757d-4108-82bd-8d083b0b5b0e`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:50:20,763::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:50:20,763::task::595::TaskManager.Task::(_updateState) Task=`efc159e3-7854-423c-948c-e11bcd4f0ed1`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:50:20,763::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:50:20,764::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`58e9284a-e77c-4992-97bc-960ace64dd44`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:50:20,764::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:50:20,764::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:50:20,764::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`58e9284a-e77c-4992-97bc-960ace64dd44`::Granted request >Thread-34::DEBUG::2014-07-24 11:50:20,764::task::827::TaskManager.Task::(resourceAcquired) Task=`efc159e3-7854-423c-948c-e11bcd4f0ed1`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:50:20,765::task::990::TaskManager.Task::(_decref) Task=`efc159e3-7854-423c-948c-e11bcd4f0ed1`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:50:20,765::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:50:20,766::task::1185::TaskManager.Task::(prepare) Task=`efc159e3-7854-423c-948c-e11bcd4f0ed1`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:50:20,766::task::595::TaskManager.Task::(_updateState) Task=`efc159e3-7854-423c-948c-e11bcd4f0ed1`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:50:20,766::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:50:20,766::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:50:20,766::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:50:20,766::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:50:20,767::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:50:20,767::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:50:20,767::task::990::TaskManager.Task::(_decref) Task=`efc159e3-7854-423c-948c-e11bcd4f0ed1`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:50:20,804::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:50:20,880::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03437 s, 29.8 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:50:21,622::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:50:21,642::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00896049 s, 457 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:50:22,892::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:50:22,969::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333001 s, 30.8 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:50:24,908::task::595::TaskManager.Task::(_updateState) Task=`f76506ae-15ae-4276-8157-cb2025b80093`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:50:24,908::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:50:24,908::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00896049', 'lastCheck': '3.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:50:24,908::task::1185::TaskManager.Task::(prepare) Task=`f76506ae-15ae-4276-8157-cb2025b80093`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00896049', 'lastCheck': '3.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:50:24,909::task::595::TaskManager.Task::(_updateState) Task=`f76506ae-15ae-4276-8157-cb2025b80093`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:50:24,909::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:50:24,909::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:50:24,909::task::990::TaskManager.Task::(_decref) Task=`f76506ae-15ae-4276-8157-cb2025b80093`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:50:24,982::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:50:25,059::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362428 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:50:27,072::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:50:27,149::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349918 s, 29.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:50:29,162::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:50:29,240::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0362145 s, 28.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:50:30,864::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:50:30,864::task::595::TaskManager.Task::(_updateState) Task=`5275c6a9-6da0-4be1-8bc6-840ca430919f`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:50:30,864::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:50:30,865::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:50:30,865::task::1185::TaskManager.Task::(prepare) Task=`5275c6a9-6da0-4be1-8bc6-840ca430919f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:50:30,865::task::595::TaskManager.Task::(_updateState) Task=`5275c6a9-6da0-4be1-8bc6-840ca430919f`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:50:30,865::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:50:30,865::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:50:30,866::task::990::TaskManager.Task::(_decref) Task=`5275c6a9-6da0-4be1-8bc6-840ca430919f`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:50:30,926::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:50:30,926::task::595::TaskManager.Task::(_updateState) Task=`cfeb248d-81fe-47db-9210-62cb1fa798b4`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:50:30,926::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:50:30,927::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b00f2814-f4e7-4a78-9648-cecaf78a8e29`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:50:30,927::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:50:30,927::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:50:30,928::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`b00f2814-f4e7-4a78-9648-cecaf78a8e29`::Granted request >Thread-34::DEBUG::2014-07-24 11:50:30,929::task::827::TaskManager.Task::(resourceAcquired) Task=`cfeb248d-81fe-47db-9210-62cb1fa798b4`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:50:30,929::task::990::TaskManager.Task::(_decref) Task=`cfeb248d-81fe-47db-9210-62cb1fa798b4`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:50:30,930::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:50:30,930::task::1185::TaskManager.Task::(prepare) Task=`cfeb248d-81fe-47db-9210-62cb1fa798b4`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:50:30,930::task::595::TaskManager.Task::(_updateState) Task=`cfeb248d-81fe-47db-9210-62cb1fa798b4`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:50:30,930::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:50:30,930::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:50:30,930::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:50:30,931::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:50:30,931::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:50:30,931::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:50:30,931::task::990::TaskManager.Task::(_decref) Task=`cfeb248d-81fe-47db-9210-62cb1fa798b4`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:50:31,252::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:50:31,333::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348247 s, 29.4 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:50:31,646::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:50:31,658::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000729143 s, 5.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:50:31,748::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:50:33,345::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:50:33,421::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034003 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:50:35,434::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:50:35,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348458 s, 29.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:50:37,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:50:37,601::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351613 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:50:39,614::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:50:39,693::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357093 s, 28.7 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:50:40,485::task::595::TaskManager.Task::(_updateState) Task=`8c4c2977-8dba-49f2-942d-a659502f2190`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:50:40,485::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:50:40,486::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000729143', 'lastCheck': '8.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:50:40,486::task::1185::TaskManager.Task::(prepare) Task=`8c4c2977-8dba-49f2-942d-a659502f2190`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000729143', 'lastCheck': '8.8', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:50:40,486::task::595::TaskManager.Task::(_updateState) Task=`8c4c2977-8dba-49f2-942d-a659502f2190`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:50:40,486::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:50:40,486::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:50:40,486::task::990::TaskManager.Task::(_decref) Task=`8c4c2977-8dba-49f2-942d-a659502f2190`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 11:50:41,036::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:50:41,036::task::595::TaskManager.Task::(_updateState) Task=`e48a735a-e7f1-4154-addf-bb06657b2a38`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:50:41,036::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:50:41,037::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:50:41,037::task::1185::TaskManager.Task::(prepare) Task=`e48a735a-e7f1-4154-addf-bb06657b2a38`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:50:41,037::task::595::TaskManager.Task::(_updateState) Task=`e48a735a-e7f1-4154-addf-bb06657b2a38`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:50:41,037::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:50:41,037::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:50:41,038::task::990::TaskManager.Task::(_decref) Task=`e48a735a-e7f1-4154-addf-bb06657b2a38`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:50:41,120::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:50:41,120::task::595::TaskManager.Task::(_updateState) Task=`798d268e-a787-4c2b-83a1-25af720b1d29`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:50:41,120::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:50:41,121::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1303fccb-a267-4d2e-a768-0112e4e58e49`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:50:41,121::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:50:41,121::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:50:41,121::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`1303fccb-a267-4d2e-a768-0112e4e58e49`::Granted request >Thread-34::DEBUG::2014-07-24 11:50:41,122::task::827::TaskManager.Task::(resourceAcquired) Task=`798d268e-a787-4c2b-83a1-25af720b1d29`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:50:41,122::task::990::TaskManager.Task::(_decref) Task=`798d268e-a787-4c2b-83a1-25af720b1d29`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:50:41,123::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:50:41,123::task::1185::TaskManager.Task::(prepare) Task=`798d268e-a787-4c2b-83a1-25af720b1d29`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:50:41,123::task::595::TaskManager.Task::(_updateState) Task=`798d268e-a787-4c2b-83a1-25af720b1d29`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:50:41,123::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:50:41,124::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:50:41,124::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:50:41,124::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:50:41,124::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:50:41,124::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:50:41,124::task::990::TaskManager.Task::(_decref) Task=`798d268e-a787-4c2b-83a1-25af720b1d29`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:50:41,662::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:50:41,692::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0174451 s, 235 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:50:41,705::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:50:41,782::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0340617 s, 30.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:50:43,807::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:50:43,882::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333337 s, 30.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:50:45,895::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:50:45,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342484 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:50:47,984::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:50:48,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355041 s, 28.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:50:50,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:50:50,156::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0408699 s, 25.1 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:50:51,229::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:50:51,229::task::595::TaskManager.Task::(_updateState) Task=`a6051768-1631-4fb4-985d-ad9e3f8757bd`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:50:51,229::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:50:51,230::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:50:51,230::task::1185::TaskManager.Task::(prepare) Task=`a6051768-1631-4fb4-985d-ad9e3f8757bd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:50:51,230::task::595::TaskManager.Task::(_updateState) Task=`a6051768-1631-4fb4-985d-ad9e3f8757bd`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:50:51,230::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:50:51,231::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:50:51,231::task::990::TaskManager.Task::(_decref) Task=`a6051768-1631-4fb4-985d-ad9e3f8757bd`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:50:51,284::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:50:51,285::task::595::TaskManager.Task::(_updateState) Task=`02f1d767-d90e-4dbc-99fa-055727e858d2`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:50:51,285::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:50:51,285::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`92ee593c-8cd0-44da-8e8d-69363760709c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:50:51,286::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:50:51,286::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:50:51,286::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`92ee593c-8cd0-44da-8e8d-69363760709c`::Granted request >Thread-34::DEBUG::2014-07-24 11:50:51,286::task::827::TaskManager.Task::(resourceAcquired) Task=`02f1d767-d90e-4dbc-99fa-055727e858d2`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:50:51,287::task::990::TaskManager.Task::(_decref) Task=`02f1d767-d90e-4dbc-99fa-055727e858d2`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:50:51,287::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:50:51,288::task::1185::TaskManager.Task::(prepare) Task=`02f1d767-d90e-4dbc-99fa-055727e858d2`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:50:51,288::task::595::TaskManager.Task::(_updateState) Task=`02f1d767-d90e-4dbc-99fa-055727e858d2`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:50:51,288::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:50:51,288::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:50:51,288::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:50:51,288::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:50:51,289::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:50:51,289::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:50:51,289::task::990::TaskManager.Task::(_decref) Task=`02f1d767-d90e-4dbc-99fa-055727e858d2`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:50:51,697::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:50:51,717::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00958517 s, 427 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:50:52,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:50:52,244::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330933 s, 30.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:50:54,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:50:54,610::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.312673 s, 3.3 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:50:55,995::task::595::TaskManager.Task::(_updateState) Task=`1ed5e90f-f639-4697-832b-93e0834cabf9`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:50:55,995::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:50:55,996::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00958517', 'lastCheck': '4.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:50:55,996::task::1185::TaskManager.Task::(prepare) Task=`1ed5e90f-f639-4697-832b-93e0834cabf9`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00958517', 'lastCheck': '4.3', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:50:55,996::task::595::TaskManager.Task::(_updateState) Task=`1ed5e90f-f639-4697-832b-93e0834cabf9`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:50:55,996::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:50:55,996::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:50:55,996::task::990::TaskManager.Task::(_decref) Task=`1ed5e90f-f639-4697-832b-93e0834cabf9`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:50:56,623::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:50:56,699::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344152 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:50:58,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:50:58,789::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357382 s, 28.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:51:00,802::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:51:00,880::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353378 s, 29.0 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:51:01,364::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:51:01,365::task::595::TaskManager.Task::(_updateState) Task=`dbbd9b7b-7a4b-405e-9eed-034a9a44c3a7`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:51:01,365::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:51:01,365::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:51:01,366::task::1185::TaskManager.Task::(prepare) Task=`dbbd9b7b-7a4b-405e-9eed-034a9a44c3a7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:51:01,366::task::595::TaskManager.Task::(_updateState) Task=`dbbd9b7b-7a4b-405e-9eed-034a9a44c3a7`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:51:01,366::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:51:01,366::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:51:01,366::task::990::TaskManager.Task::(_decref) Task=`dbbd9b7b-7a4b-405e-9eed-034a9a44c3a7`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:51:01,399::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:51:01,399::task::595::TaskManager.Task::(_updateState) Task=`3c7d6e44-45bb-4ca5-9404-6aebafde0028`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:51:01,399::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:51:01,400::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ce83820e-f3cf-413e-bd00-72bd1dc546e2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:51:01,400::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:51:01,400::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:51:01,400::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`ce83820e-f3cf-413e-bd00-72bd1dc546e2`::Granted request >Thread-34::DEBUG::2014-07-24 11:51:01,401::task::827::TaskManager.Task::(resourceAcquired) Task=`3c7d6e44-45bb-4ca5-9404-6aebafde0028`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:51:01,401::task::990::TaskManager.Task::(_decref) Task=`3c7d6e44-45bb-4ca5-9404-6aebafde0028`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:51:01,401::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:51:01,402::task::1185::TaskManager.Task::(prepare) Task=`3c7d6e44-45bb-4ca5-9404-6aebafde0028`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:51:01,402::task::595::TaskManager.Task::(_updateState) Task=`3c7d6e44-45bb-4ca5-9404-6aebafde0028`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:51:01,402::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:51:01,402::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:51:01,402::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:51:01,403::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:51:01,403::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:51:01,403::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:51:01,403::task::990::TaskManager.Task::(_decref) Task=`3c7d6e44-45bb-4ca5-9404-6aebafde0028`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:51:01,722::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:51:01,734::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000901503 s, 4.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:51:01,784::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-33::DEBUG::2014-07-24 11:51:02,892::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:51:02,968::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0336113 s, 30.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:51:04,980::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:51:05,076::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0522783 s, 19.6 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:51:07,089::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:51:07,169::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0375473 s, 27.3 MB/s\n'; <rc> = 0 >Thread-37::DEBUG::2014-07-24 11:51:09,084::task::595::TaskManager.Task::(_updateState) Task=`aada45bb-19f6-4b32-9079-e5c4e18558c2`::moving from state init -> state preparing >Thread-37::INFO::2014-07-24 11:51:09,084::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='23aa0606-edc3-4882-a4aa-18aa1983458f', spUUID='637ea13c-81a8-4b44-8cab-961458b01883', imgUUID='7afbd34c-3fd8-438a-964b-ff0a25fc709c', volUUID='e18ca0ee-e29f-4b85-b352-62c5aeed9be2', options=None) >Thread-37::INFO::2014-07-24 11:51:09,085::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-37::DEBUG::2014-07-24 11:51:09,085::task::1185::TaskManager.Task::(prepare) Task=`aada45bb-19f6-4b32-9079-e5c4e18558c2`::finished: {'truesize': '6442450944', 'apparentsize': '6442450944'} >Thread-37::DEBUG::2014-07-24 11:51:09,085::task::595::TaskManager.Task::(_updateState) Task=`aada45bb-19f6-4b32-9079-e5c4e18558c2`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-07-24 11:51:09,085::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-07-24 11:51:09,086::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-07-24 11:51:09,086::task::990::TaskManager.Task::(_decref) Task=`aada45bb-19f6-4b32-9079-e5c4e18558c2`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:51:09,181::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:51:09,259::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352517 s, 29.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:51:11,271::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:51:11,383::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0708333 s, 14.5 MB/s\n'; <rc> = 0 >Thread-14::DEBUG::2014-07-24 11:51:11,432::task::595::TaskManager.Task::(_updateState) Task=`5dbd7c65-616d-4fbd-9339-b1cdc76f40c1`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:51:11,432::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-14::INFO::2014-07-24 11:51:11,432::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000901503', 'lastCheck': '9.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:51:11,432::task::1185::TaskManager.Task::(prepare) Task=`5dbd7c65-616d-4fbd-9339-b1cdc76f40c1`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000901503', 'lastCheck': '9.7', 'valid': True}} >Thread-14::DEBUG::2014-07-24 11:51:11,432::task::595::TaskManager.Task::(_updateState) Task=`5dbd7c65-616d-4fbd-9339-b1cdc76f40c1`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:51:11,433::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:51:11,433::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:51:11,433::task::990::TaskManager.Task::(_decref) Task=`5dbd7c65-616d-4fbd-9339-b1cdc76f40c1`::ref 0 aborting False >Thread-14::DEBUG::2014-07-24 11:51:11,551::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-14::DEBUG::2014-07-24 11:51:11,552::task::595::TaskManager.Task::(_updateState) Task=`50ffd60c-13e6-43e7-abc5-0c3f254223a2`::moving from state init -> state preparing >Thread-14::INFO::2014-07-24 11:51:11,552::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-14::INFO::2014-07-24 11:51:11,552::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:51:11,552::task::1185::TaskManager.Task::(prepare) Task=`50ffd60c-13e6-43e7-abc5-0c3f254223a2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-14::DEBUG::2014-07-24 11:51:11,552::task::595::TaskManager.Task::(_updateState) Task=`50ffd60c-13e6-43e7-abc5-0c3f254223a2`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-07-24 11:51:11,553::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-07-24 11:51:11,553::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-07-24 11:51:11,553::task::990::TaskManager.Task::(_decref) Task=`50ffd60c-13e6-43e7-abc5-0c3f254223a2`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:51:11,626::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:51:11,626::task::595::TaskManager.Task::(_updateState) Task=`2cff06c8-fd57-4091-b4e8-d38cd0152299`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:51:11,626::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:51:11,627::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`cbaad6d2-0a5a-48e7-a1e1-6a513b861ce6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:51:11,627::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:51:11,627::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:51:11,627::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`cbaad6d2-0a5a-48e7-a1e1-6a513b861ce6`::Granted request >Thread-34::DEBUG::2014-07-24 11:51:11,628::task::827::TaskManager.Task::(resourceAcquired) Task=`2cff06c8-fd57-4091-b4e8-d38cd0152299`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:51:11,628::task::990::TaskManager.Task::(_decref) Task=`2cff06c8-fd57-4091-b4e8-d38cd0152299`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:51:11,628::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:51:11,629::task::1185::TaskManager.Task::(prepare) Task=`2cff06c8-fd57-4091-b4e8-d38cd0152299`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:51:11,629::task::595::TaskManager.Task::(_updateState) Task=`2cff06c8-fd57-4091-b4e8-d38cd0152299`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:51:11,629::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:51:11,629::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:51:11,629::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:51:11,630::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:51:11,630::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:51:11,630::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:51:11,630::task::990::TaskManager.Task::(_decref) Task=`2cff06c8-fd57-4091-b4e8-d38cd0152299`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:51:11,739::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:51:11,760::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0101122 s, 405 kB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:51:13,396::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:51:13,628::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.188068 s, 5.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:51:15,640::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:51:15,719::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365299 s, 28.0 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:51:17,731::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:51:17,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353946 s, 28.9 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:51:19,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:51:19,899::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0358725 s, 28.5 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:51:21,710::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:51:21,710::task::595::TaskManager.Task::(_updateState) Task=`f86d1da1-771f-4ad5-aa2f-aa80e3a3b29b`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:51:21,711::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:51:21,711::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:51:21,711::task::1185::TaskManager.Task::(prepare) Task=`f86d1da1-771f-4ad5-aa2f-aa80e3a3b29b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:51:21,711::task::595::TaskManager.Task::(_updateState) Task=`f86d1da1-771f-4ad5-aa2f-aa80e3a3b29b`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:51:21,712::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:51:21,712::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:51:21,712::task::990::TaskManager.Task::(_decref) Task=`f86d1da1-771f-4ad5-aa2f-aa80e3a3b29b`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:51:21,749::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:51:21,749::task::595::TaskManager.Task::(_updateState) Task=`6eac385a-834f-4451-b4f4-24e7e6a2c71c`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:51:21,750::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:51:21,750::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`255fcf5e-ebe0-422e-932d-f1407d4e8de6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:51:21,750::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:51:21,751::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:51:21,751::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`255fcf5e-ebe0-422e-932d-f1407d4e8de6`::Granted request >Thread-34::DEBUG::2014-07-24 11:51:21,751::task::827::TaskManager.Task::(resourceAcquired) Task=`6eac385a-834f-4451-b4f4-24e7e6a2c71c`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:51:21,751::task::990::TaskManager.Task::(_decref) Task=`6eac385a-834f-4451-b4f4-24e7e6a2c71c`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:51:21,752::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:51:21,752::task::1185::TaskManager.Task::(prepare) Task=`6eac385a-834f-4451-b4f4-24e7e6a2c71c`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:51:21,752::task::595::TaskManager.Task::(_updateState) Task=`6eac385a-834f-4451-b4f4-24e7e6a2c71c`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:51:21,753::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:51:21,753::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:51:21,753::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:51:21,753::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:51:21,753::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:51:21,754::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:51:21,754::task::990::TaskManager.Task::(_decref) Task=`6eac385a-834f-4451-b4f4-24e7e6a2c71c`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:51:21,764::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 23aa0606-edc3-4882-a4aa-18aa1983458f >Thread-18::DEBUG::2014-07-24 11:51:21,764::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with LvMetadataRW backend >Thread-18::DEBUG::2014-07-24 11:51:21,765::blockSD::336::Storage.Misc.excCmd::(readlines) '/bin/dd iflag=direct skip=0 bs=2048 if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:51:21,793::blockSD::336::Storage.Misc.excCmd::(readlines) SUCCESS: <err> = '1+0 records in\n1+0 records out\n2048 bytes (2.0 kB) copied, 0.0170825 s, 120 kB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:51:21,793::misc::264::Storage.Misc::(validateDDBytes) err: ['1+0 records in', '1+0 records out', '2048 bytes (2.0 kB) copied, 0.0170825 s, 120 kB/s'], size: 2048 >Thread-18::DEBUG::2014-07-24 11:51:21,794::persistentDict::234::Storage.PersistentDict::(refresh) read lines (LvMetadataRW)=[] >Thread-18::WARNING::2014-07-24 11:51:21,794::persistentDict::256::Storage.PersistentDict::(refresh) data has no embedded checksum - trust it as it is >Thread-18::DEBUG::2014-07-24 11:51:21,794::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with VGTagMetadataRW backend >Thread-18::DEBUG::2014-07-24 11:51:21,794::lvm::503::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 11:51:21,795::lvm::505::OperationMutex::(_invalidatevgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 11:51:21,795::lvm::513::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 11:51:21,795::lvm::525::OperationMutex::(_invalidatelvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 11:51:21,795::lvm::373::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-18::DEBUG::2014-07-24 11:51:21,796::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgs --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005cdddcba33f2e311|/dev/mapper/360060160128230005ddddcba33f2e311|/dev/mapper/360060160128230005edddcba33f2e311|/dev/mapper/360060160128230005fdddcba33f2e311|/dev/mapper/3600601601282300060dddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " --noheadings --units b --nosuffix --separator | -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:51:21,926::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:51:22,006::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357006 s, 28.7 MB/s\n'; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:51:22,039::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:51:22,041::lvm::415::OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-18::DEBUG::2014-07-24 11:51:22,041::persistentDict::234::Storage.PersistentDict::(refresh) read lines (VGTagMetadataRW)=['LEASETIMESEC=60', 'CLASS=Data', 'VERSION=3', 'TYPE=ISCSI', 'DESCRIPTION=ISCSI', 'LEASERETRIES=3', 'IOOPTIMEOUTSEC=10', 'LOCKRENEWALINTERVALSEC=5', 'PHYBLKSIZE=512', 'LOGBLKSIZE=512', 'VGUUID=NcXMoX-W9x1-3FqM-DfEl-3mM2-jQYV-iP8Rrs', u'PV0=pv:360060160128230005ddddcba33f2e311,uuid:ZPyT7g-cVNz-8Gww-h9O9-G7gH-3u72-rAX4tw,pestart:0,pecount:317,mapoffset:0', 'SDUUID=23aa0606-edc3-4882-a4aa-18aa1983458f', 'LOCKPOLICY=', 'POOL_DOMAINS=23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'POOL_DESCRIPTION=DS1', 'MASTER_VERSION=1', 'ROLE=Master', 'POOL_UUID=637ea13c-81a8-4b44-8cab-961458b01883', 'POOL_SPM_ID=1', '_SHA_CKSUM=a749afdc7119a2d6aad840af5c63c9b28c0b612c', 'POOL_SPM_LVER=0'] >Thread-18::INFO::2014-07-24 11:51:22,042::sd::384::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_imageNS already registered >Thread-18::INFO::2014-07-24 11:51:22,042::sd::392::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_volumeNS already registered >Thread-18::INFO::2014-07-24 11:51:22,042::blockSD::452::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 23aa0606-edc3-4882-a4aa-18aa1983458f_lvmActivationNS already registered >Thread-18::DEBUG::2014-07-24 11:51:22,043::lvm::296::Storage.Misc.excCmd::(cmd) '/usr/bin/sudo -n /sbin/lvm vgck --config " devices { preferred_names = [\\"^/dev/mapper/\\"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ \'a|/dev/mapper/360060160128230005ddddcba33f2e311|\', \'r|.*|\' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } " 23aa0606-edc3-4882-a4aa-18aa1983458f' (cwd None) >Thread-18::DEBUG::2014-07-24 11:51:22,195::lvm::296::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-07-24 11:51:22,196::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:51:22,207::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000915478 s, 4.5 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:51:24,019::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:51:24,096::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351659 s, 29.1 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:51:26,108::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:51:26,186::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357652 s, 28.6 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:51:27,188::task::595::TaskManager.Task::(_updateState) Task=`44855f11-4168-43fd-bf7e-daaa5b95ce1a`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:51:27,188::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:51:27,189::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000915478', 'lastCheck': '5.0', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:51:27,189::task::1185::TaskManager.Task::(prepare) Task=`44855f11-4168-43fd-bf7e-daaa5b95ce1a`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000915478', 'lastCheck': '5.0', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:51:27,189::task::595::TaskManager.Task::(_updateState) Task=`44855f11-4168-43fd-bf7e-daaa5b95ce1a`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:51:27,189::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:51:27,189::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:51:27,189::task::990::TaskManager.Task::(_decref) Task=`44855f11-4168-43fd-bf7e-daaa5b95ce1a`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:51:28,198::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:51:28,276::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361506 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:51:30,288::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:51:30,363::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0322308 s, 31.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-07-24 11:51:31,821::vmChannels::95::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-13::DEBUG::2014-07-24 11:51:31,822::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:51:31,822::task::595::TaskManager.Task::(_updateState) Task=`e53453ea-e3aa-4da5-bd19-48ea51189185`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:51:31,823::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:51:31,823::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:51:31,823::task::1185::TaskManager.Task::(prepare) Task=`e53453ea-e3aa-4da5-bd19-48ea51189185`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:51:31,823::task::595::TaskManager.Task::(_updateState) Task=`e53453ea-e3aa-4da5-bd19-48ea51189185`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:51:31,824::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:51:31,824::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:51:31,824::task::990::TaskManager.Task::(_decref) Task=`e53453ea-e3aa-4da5-bd19-48ea51189185`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:51:31,855::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:51:31,855::task::595::TaskManager.Task::(_updateState) Task=`078c4f5e-6885-4046-91b7-636b60f4c4cc`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:51:31,856::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:51:31,856::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`99df3405-dca8-4db9-a4b0-0aa9d6e4fe7f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:51:31,856::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:51:31,857::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:51:31,857::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`99df3405-dca8-4db9-a4b0-0aa9d6e4fe7f`::Granted request >Thread-34::DEBUG::2014-07-24 11:51:31,857::task::827::TaskManager.Task::(resourceAcquired) Task=`078c4f5e-6885-4046-91b7-636b60f4c4cc`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:51:31,857::task::990::TaskManager.Task::(_decref) Task=`078c4f5e-6885-4046-91b7-636b60f4c4cc`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:51:31,858::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:51:31,858::task::1185::TaskManager.Task::(prepare) Task=`078c4f5e-6885-4046-91b7-636b60f4c4cc`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:51:31,858::task::595::TaskManager.Task::(_updateState) Task=`078c4f5e-6885-4046-91b7-636b60f4c4cc`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:51:31,859::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:51:31,859::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:51:31,859::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:51:31,859::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:51:31,859::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:51:31,860::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:51:31,860::task::990::TaskManager.Task::(_decref) Task=`078c4f5e-6885-4046-91b7-636b60f4c4cc`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:51:32,211::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:51:32,223::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.000665759 s, 6.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:51:32,375::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:51:32,451::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338307 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:51:34,463::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:51:34,541::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350492 s, 29.2 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:51:36,553::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:51:36,634::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0375076 s, 27.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:51:38,646::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:51:38,730::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033758 s, 30.3 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:51:40,742::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:51:40,820::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354615 s, 28.9 MB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:51:41,936::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-13::DEBUG::2014-07-24 11:51:41,937::task::595::TaskManager.Task::(_updateState) Task=`d0cc4d1e-5262-4046-8c54-e692b88be8c9`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:51:41,937::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-13::INFO::2014-07-24 11:51:41,937::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:51:41,937::task::1185::TaskManager.Task::(prepare) Task=`d0cc4d1e-5262-4046-8c54-e692b88be8c9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 0}} >Thread-13::DEBUG::2014-07-24 11:51:41,938::task::595::TaskManager.Task::(_updateState) Task=`d0cc4d1e-5262-4046-8c54-e692b88be8c9`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:51:41,938::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:51:41,938::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:51:41,938::task::990::TaskManager.Task::(_decref) Task=`d0cc4d1e-5262-4046-8c54-e692b88be8c9`::ref 0 aborting False >Thread-34::DEBUG::2014-07-24 11:51:42,005::BindingXMLRPC::251::vds::(wrapper) client [10.35.163.76] >Thread-34::DEBUG::2014-07-24 11:51:42,006::task::595::TaskManager.Task::(_updateState) Task=`b13f10e2-cbe2-4d18-9ff5-5a2ea35e9619`::moving from state init -> state preparing >Thread-34::INFO::2014-07-24 11:51:42,006::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='637ea13c-81a8-4b44-8cab-961458b01883', options=None) >Thread-34::DEBUG::2014-07-24 11:51:42,006::resourceManager::198::ResourceManager.Request::(__init__) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`afcc098b-4a1b-4f04-b21f-6ad111d406b7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2572' at 'getStoragePoolInfo' >Thread-34::DEBUG::2014-07-24 11:51:42,006::resourceManager::542::ResourceManager::(registerResource) Trying to register resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' for lock type 'shared' >Thread-34::DEBUG::2014-07-24 11:51:42,007::resourceManager::601::ResourceManager::(registerResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free. Now locking as 'shared' (1 active user) >Thread-34::DEBUG::2014-07-24 11:51:42,007::resourceManager::238::ResourceManager.Request::(grant) ResName=`Storage.637ea13c-81a8-4b44-8cab-961458b01883`ReqID=`afcc098b-4a1b-4f04-b21f-6ad111d406b7`::Granted request >Thread-34::DEBUG::2014-07-24 11:51:42,007::task::827::TaskManager.Task::(resourceAcquired) Task=`b13f10e2-cbe2-4d18-9ff5-5a2ea35e9619`::_resourcesAcquired: Storage.637ea13c-81a8-4b44-8cab-961458b01883 (shared) >Thread-34::DEBUG::2014-07-24 11:51:42,007::task::990::TaskManager.Task::(_decref) Task=`b13f10e2-cbe2-4d18-9ff5-5a2ea35e9619`::ref 1 aborting False >Thread-34::INFO::2014-07-24 11:51:42,008::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:51:42,008::task::1185::TaskManager.Task::(prepare) Task=`b13f10e2-cbe2-4d18-9ff5-5a2ea35e9619`::finished: {'info': {'name': 'DS1', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '23aa0606-edc3-4882-a4aa-18aa1983458f:Active', 'master_uuid': '23aa0606-edc3-4882-a4aa-18aa1983458f', 'version': '3', 'spm_id': 1, 'type': 'ISCSI', 'master_ver': 1}, 'dominfo': {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'status': 'Active', 'diskfree': '31943819264', 'isoprefix': '', 'alerts': [], 'disktotal': '42547019776', 'version': 3}}} >Thread-34::DEBUG::2014-07-24 11:51:42,008::task::595::TaskManager.Task::(_updateState) Task=`b13f10e2-cbe2-4d18-9ff5-5a2ea35e9619`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-07-24 11:51:42,009::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.637ea13c-81a8-4b44-8cab-961458b01883': < ResourceRef 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', isValid: 'True' obj: 'None'>} >Thread-34::DEBUG::2014-07-24 11:51:42,009::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-07-24 11:51:42,009::resourceManager::616::ResourceManager::(releaseResource) Trying to release resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' >Thread-34::DEBUG::2014-07-24 11:51:42,009::resourceManager::635::ResourceManager::(releaseResource) Released resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' (0 active users) >Thread-34::DEBUG::2014-07-24 11:51:42,009::resourceManager::641::ResourceManager::(releaseResource) Resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883' is free, finding out if anyone is waiting for it. >Thread-34::DEBUG::2014-07-24 11:51:42,010::resourceManager::649::ResourceManager::(releaseResource) No one is waiting for resource 'Storage.637ea13c-81a8-4b44-8cab-961458b01883', Clearing records. >Thread-34::DEBUG::2014-07-24 11:51:42,010::task::990::TaskManager.Task::(_decref) Task=`b13f10e2-cbe2-4d18-9ff5-5a2ea35e9619`::ref 0 aborting False >Thread-18::DEBUG::2014-07-24 11:51:42,228::blockSD::600::Storage.Misc.excCmd::(getReadDelay) '/bin/dd if=/dev/23aa0606-edc3-4882-a4aa-18aa1983458f/metadata iflag=direct of=/dev/null bs=4096 count=1' (cwd None) >Thread-18::DEBUG::2014-07-24 11:51:42,243::blockSD::600::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.00459398 s, 892 kB/s\n'; <rc> = 0 >Thread-13::DEBUG::2014-07-24 11:51:42,581::task::595::TaskManager.Task::(_updateState) Task=`4a1efee5-c6f5-49ec-8676-29d6e824befb`::moving from state init -> state preparing >Thread-13::INFO::2014-07-24 11:51:42,581::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-13::INFO::2014-07-24 11:51:42,581::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00459398', 'lastCheck': '0.3', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:51:42,581::task::1185::TaskManager.Task::(prepare) Task=`4a1efee5-c6f5-49ec-8676-29d6e824befb`::finished: {'23aa0606-edc3-4882-a4aa-18aa1983458f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00459398', 'lastCheck': '0.3', 'valid': True}} >Thread-13::DEBUG::2014-07-24 11:51:42,582::task::595::TaskManager.Task::(_updateState) Task=`4a1efee5-c6f5-49ec-8676-29d6e824befb`::moving from state preparing -> state finished >Thread-13::DEBUG::2014-07-24 11:51:42,582::resourceManager::940::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-13::DEBUG::2014-07-24 11:51:42,582::resourceManager::977::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-13::DEBUG::2014-07-24 11:51:42,582::task::990::TaskManager.Task::(_decref) Task=`4a1efee5-c6f5-49ec-8676-29d6e824befb`::ref 0 aborting False >Dummy-33::DEBUG::2014-07-24 11:51:42,832::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:51:42,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373765 s, 27.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:51:44,924::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:51:45,010::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0436715 s, 23.4 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:51:47,022::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:51:47,099::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0333856 s, 30.7 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:51:49,111::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:51:49,189::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343773 s, 29.8 MB/s\n'; <rc> = 0 >Dummy-33::DEBUG::2014-07-24 11:51:51,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) 'dd if=/rhev/data-center/637ea13c-81a8-4b44-8cab-961458b01883/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000' (cwd None) >Dummy-33::DEBUG::2014-07-24 11:51:51,279::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351535 s, 29.1 MB/s\n'; <rc> = 0
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 1119664
: 920468